mlfoundations / open_clip

An open source implementation of CLIP.
Other
9.93k stars 959 forks source link

How to load hf-hub:microsoft/BiomedCLIP-PubMedBERT_256-vit_base_patch16_224 without internet access #724

Open zhaozh10 opened 11 months ago

zhaozh10 commented 11 months ago

Huggingface has recently been banned in some countries, so I manually download files under biomedclip repo and hope to load it total from local file.

I tried open_clip.get_tokenizer('hf-hub:microsoft/BiomedCLIP-PubMedBERT_256-vit_base_patch16_224', cache_dir='/home/sdb/preTrain/biomedclip/') but the connection error still raise.

Any ideas?

Tranquil1ty commented 11 months ago

You can refer to this https://github.com/mlfoundations/open_clip/issues/528. I'm also experiencing the same issue. If you have any other solutions, please get in touch with me.

LIKP0 commented 9 months ago

Hello all, I've tried to download the bin file from BiomedCLIP/repo, but model, preprocess = create_model_from_pretrained(model_name='ViT-B-16', pretrained="/home/BiomedCLIP/open_clip_pytorch_model.bin") still don't work. Any idea?

MyHogsmeade commented 3 weeks ago

Do you know how to fix it

Hello all, I've tried to download the bin file from BiomedCLIP/repo, but model, preprocess = create_model_from_pretrained(model_name='ViT-B-16', pretrained="/home/BiomedCLIP/open_clip_pytorch_model.bin") still don't work. Any idea?

sheng-z commented 1 week ago

Didn't expect many needs to load from local files. I added an example snippet here: https://huggingface.co/microsoft/BiomedCLIP-PubMedBERT_256-vit_base_patch16_224#22-load-from-local-files