jpalpant
commented
8 years ago There are conflicts with this pull, which is why I assigned you - should I rebase on master or is there another way to go about it? I don't see what has changed that would conflict, unless it's the changes to dictionary_test.
Serialization and deserialization using MessagePack are several times faster than plain loading, and more disk space efficient. Some custom serialization code is required, and that will have to be maintained if ClueDB changes, but it's worth it for the ~60% decrease in loading time. Pickling was an option, but even cPickle was slower than MessagePack and it still required custom serialization code because pickle doesn't handle lambda expressions.