search

kharchenkolab / Baysor

Bayesian Segmentation of Spatial Transcriptomics Data
https://kharchenkolab.github.io/Baysor/
MIT License
152 stars 31 forks source link

Baysor crashes with OutOfMemoryError() when prior segmentation column contains large integers #83

Closed pakiessling closed 1 year ago

pakiessling commented 1 year ago

I verified this behavior in baysor 0.5.2 and 0.6.1

See the attached csv that crashes baysor when prior segmentation is set to cell_id but not when set to a small integers derived from the id in the column baysor_id.

This is an issue as technology like Vizgen's Merscope use large integers as cell id by default.

baysor_troubleshoot.csv

VPetukhov commented 1 year ago

Thank you for the example! Fixed it in the develop branch.

VPetukhov commented 1 year ago

And now it's released!