farach / huggingfaceR

Hugging Face state-of-the-art models in R
Other
136 stars 16 forks source link

hf_load_pipeline() from zzz.R is changed to hf_import_pipeline() to b… #26

Closed jpcompartir closed 2 years ago

jpcompartir commented 2 years ago

hf_load_pipeline() from zzz.R is changed to hf_import_pipeline() to better reflect what it does.

hf_load_model() changed to hf_load_pipeline() to better reflect what it does. hf_load_model() introduced - loads a model. hf_load_autotokenizer changed to hf_import_autotokenizer hf_load_automodel -> hf_import_automodel hf_load_sentence_transformers -> hf_import_sentence_transformers hf_load_datasets_transformers -> hf_import_datasets_transformers

... fed into hf_pipline, as hf_load_pipeline() accepts ..., but hf_pipeline() does not. This is an issue because hf_pipline() had a bunch of named arguments, but no way of passing them onto the py$pipeline() call.

added tests for hf_load_pipeline() and hf_load_tokenizer()

added ... to hf_load_tokenizer and tests added accordingly.