The CLI commands for data indexing and packing should be simplified. In particular:
The config file used for pack_encoded_data should also be used for create_raw_index
There should be a single config file that handles training, validation and test data in one go. This will avoid having to run the commands modalities data [..] multiple times.
create_raw_index and pack_encoded_data should be replaced by more succinct names, for instance index and pack.
Note that first, #112 should be merged into main though.
The CLI commands for data indexing and packing should be simplified. In particular:
pack_encoded_datashould also be used forcreate_raw_indexmodalities data [..]multiple times.create_raw_indexandpack_encoded_datashould be replaced by more succinct names, for instanceindexandpack.Note that first, #112 should be merged into
mainthough.