Hugging Face just released a client for the Hub that helps with uploading and download files from hub repos, among other things. The download function should be leveraged to make data loading easier.
User enter their embedding model and the script does the rest: download embeddings.parquet for associated repo and load into db.
Hugging Face just released a client for the Hub that helps with uploading and download files from hub repos, among other things. The download function should be leveraged to make data loading easier.
User enter their embedding model and the script does the rest: download embeddings.parquet for associated repo and load into db.