search

openfoundry-ai / model_manager

Model Manager is a Python package that simplifies the process of deploying an open source AI model to your own cloud.
https://www.openfoundry.ai
MIT License
282 stars 18 forks source link

Fast api #14

Closed arthurchi93 closed 5 months ago

arthurchi93 commented 5 months ago

Adds initial fastapi endpoints and switches to Pydantic models. We have to rename a few of the fields because model_ is reserved in this library

Introduces a Query interface to encapsulate the query string, context, and parameters (for text generation inference)