- Fix external-sorting piping system
- Use more extensive pipeline() functions to avoid listening to explicit stream signals which are tricky to understand
- Restore external-sorting pure-JS sort
- More accurately determine end of stream
- Use GNU sort instead of javascript NPM external-sort module, this should be significantly faster for the sort step and may help with potential memory leak issues
- Use commonjs + es2015 instead of relying on es5 setting to make commonjs modules
- Automatically optimize prefix size. Previously this was manually provided or defaulted to 5. We now automatically try to calculate this if no prefix size is provided. This will try to make each bin from the ixx index approximately 64kb
- Export the makeIxx function
- Add configurable prefixSize parameter to ixIxx and ixIxxStream, can be used if many of the features you are indexing have similar ID prefixes
- Fix flaky error from external-sorting module sometimes failing
- Use pipeline instead of pump
- Add better error handling on stream
- Fix issue where nulls appear in stream on older node versions, but are stripped out xref GMOD/jbrowse-components#2451
- Fix issue where streamFinished is not called always, so use close instead
- Improved streaming strategy and also fix intermittent failure. Thanks to @bbimber for reporting GMOD/jbrowse-components#2354
- Cleanup files when done
- Revert #6 transformer change
- Change from external-sort -> external-sorting npm module due to bug in their module
- Use transform to reduce amount of data introduced to disk
- Fix issue with last element not being written to index
- Cleanup temp files
- Use a smaller maxHeap size for faster operation
- Use simple string compare rather than localeCompare
- Use new external sorting module that is ~2x faster than external-sorting
- Use external sorting module for better scalability, using the great external-sorting package on NPM
- Use fs.createWriteStream instead of fs/promises for writing outputs
- Fix writing ix and ixx files to await the filehandle.writeFile call
- Print usage message for CLI tool
- Attempt to fix error "Cannot find module 'fs/promises'...
- Avoid potential file handle leak on error with try/finally
- Ensure ix is written before calculating ixx
- Fix borked typescript definitions again
- Fix typescript definitions on stream functions
- Redo borked release of 1.0.0
- Initial release