bigscience-workshop / metadata

Experiments on including metadata such as URLs, timestamps, website descriptions and HTML tags during pretraining.
Apache License 2.0
30 stars 12 forks source link

build: upgrade transformers for a consistent version of huggingface_hub #166

Closed tianjianjiang closed 2 years ago

tianjianjiang commented 2 years ago

Since transformers 4.22, huggingface_hub must be >=0.9.0.

In other words, huggingface-hub in the requirements-dev.txt should have been managed by transformers via requirements.txt.