Let's push all CSV files, that were aggregated during the build, to the HuggingFace dataset. To do this, let's define PUSH_HF=<true|false> environment variable that we will look inside the container. HuggingFace token can be obtained from provided HF_TOKEN environment variable.
Let's push all CSV files, that were aggregated during the build, to the HuggingFace dataset. To do this, let's define
PUSH_HF=<true|false>environment variable that we will look inside the container. HuggingFace token can be obtained from providedHF_TOKENenvironment variable.