search

hassonlab / 247-pickling

Contains code to create pickles from raw/processed data
1 stars 10 forks source link

No need to download model for concatenation in tfsemb_concat.py #115

Open hvgazula opened 1 year ago

hvgazula commented 1 year ago

https://github.com/hassonlab/247-pickling/blob/b8253c6a5088c5b2f8e75e6a5cf7f3440b82cbf5/scripts/tfsemb_config.py#L45

hvgazula commented 1 year ago

This is a hassle. Talk to folks to find an alternative.

hvgazula commented 1 year ago

After https://github.com/hassonlab/247-pickling/issues/134, it is possible to add a hf_flag to setup_environ() specifying whether or not to download the model and tokenizer.