Dallinger / Griduniverse

Welcome to the Griduniverse.
7 stars 3 forks source link

Jupyter performance #188

Closed MatthewWilkes closed 6 years ago

MatthewWilkes commented 6 years ago

Various fixes for performance when replaying under Jupyter

1) Reduces the amount of JSON written to serialize the grid 2) Writes grid status to JSONB column, not text 3) Rewrite of events_for_replay function to return the absolute minimal set of events required

MatthewWilkes commented 6 years ago

Also, it might be best to test this with newly generated data files, as it does fix a bug in the output, but in case you want to try old files I'll attach an untested script that should fix up the data. I'm afraid I'm out of hours this week, but if it doesn't work and it's nonobvious I can look at it in a later iteration if needed.

https://gist.github.com/MatthewWilkes/e97dfc2b65c78c0e346c07c2c3dde462