hitomi-team / sukima

A ready-to-deploy container for implementing an easy to use REST API to access Language Models.
GNU General Public License v2.0
64 stars 13 forks source link

Migration to FastAPI #1

Closed zielo-hue closed 3 years ago

zielo-hue commented 3 years ago

This changes the web API engine from Flask to FastAPI, primarily due to automatic documentation handled by FastAPI as well as better compatibility for concurrent operations which will be crucial for heavy computational tasks (e.g. inference).

Please note! Sensitive authentication-related endpoints and endpoints that require authentication themselves no longer have authentication checks. This will be mitigated for in a future PR once I incorporate factory pattern architecture.