I want to preliminary investigate the deployment of our model with localai
So that we get familiar with localai and we can already identify possible problems.
Acceptance criteria
Key documentation of how to integrate our model with localai is identified and consulted
Identification of possible problems of the integration of the model into localai
Possible problems with the integration of our model into localai are identified
Possible problems are summarized
Possible problems are communicated to the POs so that they can be tackled with issues in the next sprint
A suggestion is made of how we should set up a frontend to work with localai (either own implementation or usage of an example chatbot with permissive license that may exist)
Further information
Our industry partner is currently setting up a cluster in which localai is deployed. So localai will run on the target infrastructure where we should deploy our model and we should make our model accessible using the API of localai
User story
Acceptance criteria
Further information
Definition of done (DoD)
DoD general criteria