webis-de / small-text

Active Learning for Text Classification in Python
https://small-text.readthedocs.io/
MIT License
547 stars 60 forks source link

Pass local_files_only kwarg in TransformerBasedClassification #17

Closed chschroeder closed 1 year ago

chschroeder commented 2 years ago

Feature description

Provide a way to set local_files_only in TransformerBasedClassification. https://github.com/huggingface/transformers/issues/2867

Motivation

The integration tests are too slow and a majority of the time can be avoided with this setting. Moreover, in environments without an internet connection the current state will fail.

Addition comments

-

James4Ever0 commented 1 year ago

search for "from_pretrained" then add parameters like "local_files_only" or "local_files_first"

chschroeder commented 1 year ago

Thanks for your input! This has also been on my todo list for a while. I have started to work on this and it will be part of the next release.