sebhtml / ray

Ray -- Parallel genome assemblies for parallel DNA sequencing
http://denovoassembler.sf.net
Other
65 stars 12 forks source link

rewrite the checkpointing code to dump 1 file per process instead of many files, use large offsets #149

Open sebhtml opened 11 years ago

sebhtml commented 11 years ago

format:

` magicNumber (64 bits) format (32 bits) kmerLength (32 bits) numberOfMPIRanks (32 bits) sections (32 bits)

` sectionKey will be handles for checkpoints, in the source code, these will be associated to string names.
sebhtml commented 11 years ago

will need a Ray option to manage checkpoints

like:

Ray manage-checkpoints list checkpointDirectory -----> list checkpoints Ray manage-checkpoints remove checkpointDirectory checkpointName -----> remove a checkpoint