search

soruly / trace.moe

Anime Scene Search by Image
https://trace.moe
MIT License
4.53k stars 233 forks source link

Can it be run on Hugging Face (huggingface.co)? If so, how? #88

Closed My12123 closed 8 months ago

My12123 commented 1 year ago

Hugging Face supports the following environments: 2023-01-21_18-24-16 Can it be run on Hugging Face (huggingface.co)? If so, how?

My12123 commented 1 year ago

2023-01-21_18-25-36

soruly commented 1 year ago

The current system requires 128GB RAM and ~200GB nvme SSD storage to run. I don't know if it's possbile to run on hugging face.

Leslie-Wong-H commented 1 year ago

2023-01-21_18-25-36

I checked Huggingface's documentation. They just support running a single docker container now.

If you are familiar with docker-compose, you can use this optimized search engine to try, https://github.com/shotit/shotit/blob/main/docker-compose.yml.

It instead uses a vector database under the hood to provide blazing-fast search functionality. Deployed at a 4V32G Ubuntu machine, it can search 70 million vectors 3700+ episodes in seconds, with long-term RAM of about 20G.

v0.9.3 is working, yet not much documentation is provided at the moment. Sorry.

The procedure is similar to what soruly have described at README here. docker-compose up -d and place /anlist/epsode.mp4 files to volumes/shotit-incoming

git clone https://github.com/shotit/shotit.git

image

soruly commented 8 months ago

Let's get back to this when hugging face supports docker-compose