huggingface / transformers

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
https://huggingface.co/transformers
Apache License 2.0
135.56k stars 27.13k forks source link

Centralized Page for Domain Whitelisting (Hugging Face Models) #33947

Open AghaDurrani opened 1 month ago

AghaDurrani commented 1 month ago

Feature request

Is it possible to create a dedicated page that lists all the domains where Hugging Face models, such as those stored on cdn-lfs.hf.co, are hosted? This page would serve as a reference for users working in corporate environments, where whitelisting of individual domains is required.

Motivation

Many organizations, particularly those behind corporate networks, require that domains be whitelisted individually for security and access reasons. For users working in such environments, identifying and manually whitelisting the necessary domains for model access can be a cumbersome process. A centralized list of the domains Hugging Face uses to host and serve models would significantly streamline this process, ensuring seamless access to models across corporate networks without delays or security issues.

ArthurZucker commented 1 month ago

cc @Wauplin more your domain! 🤗

Wauplin commented 1 month ago

Ping @XciD on this one. Would be worth having an exhaustive list somewhere in the docs

XciD commented 1 month ago

Hey,

Current list is:

cdn-lfs-us-1.hf.co
cdn-lfs-eu-1.hf.co
cdn-lfs.hf.co

We could maybe create something like: https://api.github.com/meta

Dim10p commented 1 month ago

thanks for the list!