filearray 0.2.0
- Additional audo_set_headersto functionfilearray_load_or_createto avoid automatically setting
headers, with default beingTRUEfor compatibility
concerns
filearray 0.1.9
- Fixed CRANcheck issue brought bytestthatupdate, which requiresbit64when checkingint64arrays. Addedbit64toSuggestsfield to mitigate this check error
filearray 0.1.8
- Fixed a bug where C++errors are not correctly thrown
due to a recentRcppupdate. This bug may cause erroneous
code to execute ignoring try-catch statement and imbalanced protecting
stacks (fwhich,mapreduce)
filearray 0.1.7
- Removed non-API R C interface
- Allows subsetAssignto assign when value length is 1
(thanks@talegariissue#9)
- Allows more flexible fwhichfunction with functionalvalinput and options to include corresponding values as
part of return (thanks@talegariissue#10)
- Fixed mapreducebug when partition length is way larger
than the buffer size, causing buffer to stop updating
- Fixed other C++issues, such as unused buffer
allocation in subset-assign, andmin_offset insub_vec_range. These issues are not considered bugs since
they don’t affect the results, but the performance is slightly increased
after fix.
- Replaced dipsauswith more updatedravetoolsin the vignette performance profiling
- Updated examples to get rid of warning messages and out-dated
arguments.
filearray 0.1.6
- Removed c++11from system requirement andMakevars
- Used TinyThreadsinstead ofOpenMPto get
parallel working onOSX
- Added as_filearraymethod, and support optionalfloat
- Added array proxy class, allowing arrays to lazy-evaluate simple
operators
- Allows user-defined temporary file array path
- Fixed fmapissues, using better guesses for default.input_size
- Fixed a memory bug caused when partition margin has elements greater
than 1 and when FARR_subset_sequentialis used
- Used fastmapto avoid environment look-up
- fa_eval_opsallows dimension names
- Larger default buffer size to allow 2^20in single
partition
- Disabled single indexing
- Fixed endianissue onbig-endianplatforms
filearray 0.1.5
- Fixed a bug when trying to read array data sequentially. The bug is
caused by buffer size being greater than the array length, making in a
pointer that controls the partition number exceed the end of vector,
resulting in undefined behavior. The functions affected are:
fmap,fmap2. The bug has been fixed and passedvalgrindmemory check.
filearray 0.1.4
- Fixed a bug when allocated memory is one byte short than requested.
The bug would crash R when triggered in certain cases.
- Removed limit to the maximum number of partitions when writing. The
previous implementation creates and opens related file descriptors all
at once before writing. This setup will raise errors when the number of
connections reach to certain limit, often defined by the operating
systems. This update only opens the connection on demand. The
performance might be impacted when writing to disk, but in return, the
program will be more robust
- Fixed subsetfunction environment not resolved
correctly when using formula
- Added filearray_load_or_createas an alternative tofilearray_checkloadby automatically replace existing
obsolete array files if the headers, dimensions, or data types don’t
match. Alsoon_missingargument is provided to allow array
initialization if new array is created.
filearray 0.1.3
- Automatically detect whether symbolic-link works and show
warnings
- Warnings can be suppressed
- Allow extra headers to be set in metafile
- Added header signature method
- Fixed symbolic-link issues on Windowswhen partition
sizes are 0
- Added check-load function filearray_checkloadto
validate header
- Fixed collapse method when dimnamesare set
- Fixed an unprotected variable in C++code
- filearray_bindcan use cache if the header signatures
agree
- filearray_bindcan choose to force overwrite
- Added package digesttoImports
- Fixed a typo and several small bugs
filearray 0.1.2
- Removed flushin saving data to let system decide when
to flush to hard drive
- Allowed array to expand along the partition margin
- Fixed dimension name getting dropped under certain situations
- Use 2 cores by default when R CMD checkis
detected
filearray 0.1.1
- Added OpenMPflag in theMakeVars
- Fixed critical bugs that could cause segfaults
- Can store complexandfloatdata
types
- Re-implemented read/write functions to use memory map
- Allowed dimnamesto be set
- Added generics subsetto subset usingdimnames
- Added vignette to compare performance
- Added speed comparisons in README.md
- Added collapseto calculate marginal summation with
little memory overhead
- Added fmap,fmap2to apply functions to
one or multiple file arrays with little memory overhead (also very
fast)
- Fixed ‘unprotected’ issues warned by rchk
filearray 0.1.0
- Added a NEWS.mdfile to track changes to the
package.
- Initial implementation