Problems about additional OpenAI-API-compatible models

simonw / llm

Access large language models from the command-line

https://llm.datasette.io

Apache License 2.0

3.48k stars 180 forks source link

Problems about additional OpenAI-API-compatible models #442

Open Alex4210987 opened 3 months ago

Alex4210987 commented 3 months ago

Sorry but I cannot find solutions to this. Hope this problem won't waste your guys' time.

my question is： my extra-openai-models.yaml under the project root folder looks like:

- model_id: test
  model_name: gpt-3.5-turbo
  api_base: "https://a_website/v1/chat"
  completion: true

but when I run llm -m test 'What is the capital of France?' the output is: Error: 'test' is not a known model I don't know, maybe I've messed up with the yaml file?

msmithstubbs commented 3 months ago

Where did you place the file? I put extra-openai-models.yaml in ~/Library/Application\ Support/io.datasette.llm/ (I'm on a mac) and then it recognised the test model