Description:
After training, the intervention's artifacts are saved in memory without a good way of saving to disk with other metadata or sharing on huggingface marketplace. This will be a change to provide a smooth way of saving/sharing interventions trained by users.
The key thing will be serializing metadata into a shareable format (i.e., serializing and deserializing need both be tested). It will still require sharing parties to know the counterfactual dataset generation, but it is less of a problem of this library and more about sharing the dataset itself. And dataset sharing could be a separate process not included in this library.
This change should also consider sharing interventions that contain a vector store (some truthful direction for sharing, etc..).
Testing Done:
Local Test Log:
.Removing testing dir ./test_output_dir_prefix-d9080f
Removing testing dir ./test_output_dir_prefix-dff621
Removing testing dir ./test_output_dir_prefix-9227e2
Removing testing dir ./test_output_dir_prefix-6cb8c4
Removing testing dir ./test_output_dir_prefix-67cd73
Ran 25 tests in 4.280s
OK
- New Tutorial Added `tutorials/basic_tutorials/Load_Save_and_Share_Interventions.ipynb`.
Description: After training, the intervention's artifacts are saved in memory without a good way of saving to disk with other metadata or sharing on huggingface marketplace. This will be a change to provide a smooth way of saving/sharing interventions trained by users.
The key thing will be serializing metadata into a shareable format (i.e., serializing and deserializing need both be tested). It will still require sharing parties to know the counterfactual dataset generation, but it is less of a problem of this library and more about sharing the dataset itself. And dataset sharing could be a separate process not included in this library.
This change should also consider sharing interventions that contain a vector store (some truthful direction for sharing, etc..).
Testing Done:
Ran 25 tests in 4.280s
OK