search

skinkie / reference

Personal repository where I collect working examples to understand inner workings while building PyNeTExConv
GNU Affero General Public License v3.0
1 stars 1 forks source link

pickle performance improvement #158

Open skinkie opened 3 weeks ago

skinkie commented 3 weeks ago

2344 ScheduledStopPoints, stored in pickle format (highest protocol), then queried. First is pickle, second is xml.

2344
0.6774206161499023

real    0m8.590s
user    0m8.237s
sys     0m1.191s

2344
1.5347440242767334

real    0m9.560s
user    0m9.029s
sys     0m1.337s

There are some things like embeddings and references which must be fixed too. Ideally I would be able to switch this dynamically.