Closed xiaozhuka closed 1 year ago
Is the demo on the HuggingFace website using CPU or GPU to inference?
Testing with sample data is a little too slow. It took bout 500s to show the result.
What about the demo on Gradio, it's better. About 10s.
Thank you for your interest in the project! Actually we don't have budget to get GPU support from huggingface so we can only use CPU there, but the gradio demo is built on our own server with GPU.
Is the demo on the HuggingFace website using CPU or GPU to inference?
Testing with sample data is a little too slow. It took bout 500s to show the result.
What about the demo on Gradio, it's better. About 10s.