Address the ~140 GB worm.db issue with movement data

openworm / OpenData

Repo for Google Summer of Code Open Data Project 2019

MIT License

4 stars 2 forks source link

Address the ~140 GB worm.db issue with movement data #29

Open slarson opened 5 years ago

slarson commented 5 years ago

If the total install size of POW goes up this high, it will be a problem downstream for users... we should try to see if we can find any bugs that may be overinflating the size

slarson commented 5 years ago

@mwatts15 Did you get a chance to talk to @EST09 about this?

mwatts15 commented 5 years ago

The solution is to switch to SQLite storage. The database is still quite large, but manageable.