Investigate warning generated by random_states_s.to_hdf(self._hdf_file(), 'random_states') in __init__():
The warning is:
/usr/local/lib/python3.6/site-packages/pandas/core/generic.py:1996 PerformanceWarning:
your performance may suffer as PyTables will pickle object types that it cannot
map directly to c-types [inferred_type->mixed,key->values] [items->None]
Speed up convert_checkpoints by using MakeDataFrame to build aggregate_states_df.
Have hdf use disk more efficiently; for unknown reasons, in one example hdf uses 4.4M to store the data in 52 pickle files of 8K each, more than 10x less efficient than pickle.
(Includes unfinished parts of #70.)
random_states_s.to_hdf(self._hdf_file(), 'random_states')in__init__():The warning is:
Speed up
convert_checkpointsby usingMakeDataFrameto buildaggregate_states_df.Have
hdfuse disk more efficiently; for unknown reasons, in one example hdf uses 4.4M to store the data in 52picklefiles of 8K each, more than 10x less efficient thanpickle.