Create local_hugging_face_server.py

alexanderatallah / window.ai

Use your own AI models on the web

https://windowai.io

MIT License

806 stars 70 forks source link

Create local_hugging_face_server.py #8

Closed handrew closed 1 year ago

handrew commented 1 year ago

Example server.py file which allows users to serve local Hugging Face models downloaded on their machine to localhost:8000/completions. Currently you would have to write a import_and_return_<model> function for the inference logic, but that can usually be found on the model's page on Hugging Face.

vercel[bot] commented 1 year ago

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name	Status	Preview	Comments	Updated (UTC)
window-ai	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	Apr 9, 2023 4:18am