search

AI-Citizen / SolidGPT

Developer AI Persona Search Agent
Creative Commons Attribution 4.0 International
2.01k stars 130 forks source link

Deploy with Llama2 #76

Open Libresse opened 11 months ago

Libresse commented 11 months ago

Hi SolidGPT team,

Are there any ways I can deploy your product with Llama2 or any other open source model?

I saw you have Llama manager but didn't find a way to use it.

BR,

wwwwww1020 commented 11 months ago

Yes, we are working on using opensource model Llama2 as the LLM core to implement fully local deployment. We will update more about this cool feature in the future. Btw, we will publish our roadmap real soon

Libresse commented 11 months ago

@wwwwww1020 Does the SolidGPT fully support Azure integration, any best practice for that?

kodiii commented 11 months ago

would be great if was possible to use with LM Studio app

wwwwww1020 commented 11 months ago

Yes you can easily deploy the project into Azure with Static App , container app and blob storage. We have provide the blob storage client manager let user easily store their data into the blob. We will provide more context about deployment in the further

wwwwww1020 commented 11 months ago

would be great if was possible to use with LM Studio app

good idea we will do some research on this

Libresse commented 11 months ago

So are you going to support Chinese LLM like ERNIE in the future?

wwwwww1020 commented 11 months ago

So are you going to support Chinese LLM like ERNIE in the future?

Yes we are going to adding more model like ERNIE

bhupesh-sf commented 4 weeks ago

Hey, did we have any update on LM Studio or anything similar which gives openAI compatible API?