We've recently added support for Hugging Face Inference Endpoints through the huggingface_hub python package. We now need to reference models that are available on Hugging Face (model name, number of parameters).
Solution
Possible solutions:
Scrapping at runtime (possibly not a good idea)
Telemetry (update in a github action triggered by package telemetry?)
...
Description
We've recently added support for Hugging Face Inference Endpoints through the
huggingface_hub
python package. We now need to reference models that are available on Hugging Face (model name, number of parameters).Solution
Possible solutions:
Ping @aqwvinh