lepton search client config gpt-4

leptonai / search_with_lepton

Building a quick conversation-based search demo with Lepton AI.

https://search.lepton.run

Apache License 2.0

7.51k stars 964 forks source link

lepton search client config gpt-4 #75

Open mqd273 opened 2 months ago

mqd273 commented 2 months ago

how we can config the gpt-4 model. using leaton search client

ng-fukgin commented 1 month ago

First apply the gpt api, and then modify it base_url=f"https://{self.model}.lepton.run/api/v1/", to base_url=f""https://api.openai.com/v1"
and change "LLM_MODEL": "mixtral-8x7b", the model name here

ng-fukgin commented 1 month ago

啊，我英语不太好，就是你先申请gpt4 的api，然后修改这里的，改为base_url=f""https://api.openai.com/v1" 以及这里的的 ""LLM_MODEL":mixtral-8x7b"