It turns out that load_from_disk returns a Dataset object that looks like a list but isn't. So trying to mutate the dicts in place silently fails to do anything at all.
Instead of trying to mutate the dataset in-place (which we'll copy into a list anyway), just call a helper function that will deal with mangling the dict as necessary while we enumerate dataset.
It turns out that
load_from_diskreturns aDatasetobject that looks like a list but isn't. So trying to mutate the dicts in place silently fails to do anything at all.Instead of trying to mutate the dataset in-place (which we'll copy into a list anyway), just call a helper function that will deal with mangling the dict as necessary while we enumerate dataset.
Fixes #107.