CLIP CPU - Githubissues

Ravn-Tech / HyperTag

HyperTag - Intuitive Knowledge Management WebApp & CLI for Humans using Deep Learning & Tags

Other

191 stars 14 forks source link

CLIP CPU #62

Closed mszarski closed 3 years ago

mszarski commented 3 years ago

Hi,

Great project!

@shawwn converted the CLIP model weights to load on a cpu (https://github.com/shawwn/CLIP/blob/dev/clip_cpu.py). This works fine for HyperTag as long as the torch device is correctly set everywhere. However, urlretrieve() uses a Python user-agent to fetch the weights for which his server gives a 403 so the inline download fails. I'm not sure about weight hosting or licensing in general so I've not modified the UA.

Hopefully this is helpful.

SeanPedersen commented 3 years ago

Cool work! Hmm not sure how we deal with the downloading / licensing of the converted weights. But I would expect them to be under the same license as OG CLIP models.

SeanPedersen commented 3 years ago

Ok, I made following changes:

I went ahead and just removed the UA (CPU download works now, but we should probably rehost somewhere else)
I added explicit CPU toggle option
I fixed model loading for CUDA

SeanPedersen commented 3 years ago

Ok looks good to me! Merged.