search

neurodata / ndgrutedb

Pipeline and tools for estimating human connectomes from Diffusion, Structural, and Functional MRI
http://neurodata.io
Apache License 2.0
29 stars 13 forks source link

Corrupted graphs need to be rerun at some point #157

Closed disa-mhembere closed 8 years ago

disa-mhembere commented 8 years ago

While running the parallel converter some graphs failed to be read -- I decided to assemble them here.

NKI-ENH_0186697_biggraphs.graphml Jung2015_M87160886_biggraphs.graphml Jung2015_M87164774_biggraphs.graphml Jung2015_M87183242_biggraphs.graphml

Jung2015_M87109104_biggraphs.graphml Jung2015_M87138290_biggraphs.graphml M87164412-bg.graphml M87111487-bg.graphml

@gkiar please reassign as necessary

wrgr commented 8 years ago

Is it obvious what's wrong? I'm curious if big graphs are failing to run (perhaps file size << normal graph) or corrupted in some less obvious way.

Best, Will

On Mon, Oct 12, 2015 at 12:05 PM, Disa Mhembere notifications@github.com wrote:

While running the parallel converter some graphs failed to be read -- I decided to assemble them here.

NKI-ENH_0186697_biggraphs.graphml Jung2015_M87160886_biggraphs.graphml Jung2015_M87164774_biggraphs.graphml Jung2015_M87183242_biggraphs.graphml

Jung2015_M87109104_biggraphs.graphml Jung2015_M87138290_biggraphs.graphml

@gkiar https://github.com/gkiar please reassign as necessary

— Reply to this email directly or view it on GitHub https://github.com/openconnectome/m2g/issues/157.

disa-mhembere commented 8 years ago

That would work for some, but sadly not all. The igraph write operation seems to not be atomic from what I can tell, so pretty large files that are partial writes exist.

On Mon, Oct 12, 2015 at 12:16 PM, William Gray notifications@github.com wrote:

Is it obvious what's wrong? I'm curious if big graphs are failing to run (perhaps file size << normal graph) or corrupted in some less obvious way.

Best, Will

On Mon, Oct 12, 2015 at 12:05 PM, Disa Mhembere notifications@github.com wrote:

While running the parallel converter some graphs failed to be read -- I decided to assemble them here.

NKI-ENH_0186697_biggraphs.graphml Jung2015_M87160886_biggraphs.graphml Jung2015_M87164774_biggraphs.graphml Jung2015_M87183242_biggraphs.graphml

Jung2015_M87109104_biggraphs.graphml Jung2015_M87138290_biggraphs.graphml

@gkiar https://github.com/gkiar please reassign as necessary

— Reply to this email directly or view it on GitHub https://github.com/openconnectome/m2g/issues/157.

— Reply to this email directly or view it on GitHub https://github.com/openconnectome/m2g/issues/157#issuecomment-147449644.

gkiar commented 8 years ago

Believe I've redone all of these. Reopen if I'm wrong, @disa-mhembere