JetBrains-Research / big

BigWIG, BigBED and TDF for the JVM
MIT License
13 stars 2 forks source link

Streaming in 'BigFile#write' #26

Closed superbobry closed 8 years ago

superbobry commented 8 years ago

Currently #write requires storing all of the data (e.g. WIG sections) in memory. This can be too expensive with large (> Gb) files.

A better approach is to stream the data without ever loading it wholly into memory.