Other Models result in error

TheJedinator commented 5 months ago

When I try other models that I have access to I receive an error consistently. Sometimes it starts printing the response, sometimes it only prints the error...

{
  "data": {
    "id": "chatcmpl-91yH74w78DzwnwgfeB8pH1dvl7raP",
    "object": "chat.completion.chunk",
    "created": 1710257053,
    "model": "gpt-4-0613",
    "system_fingerprint": null,
    "choices": [
      {
        "index": 0,
        "delta": { "content": "Weather" },
        "logprobs": null,
        "finish_reason": null
      }
    ]
  }
}

my toml is set as

api_key = "REDACTED"
model = "gpt-4"
max_tokens = 2048
temperature = 0.8

patrykchojecki commented 5 months ago

Same issue here. Gpt-3.5-turbo works with no issues, but as soon as I switch model to gpt-4 I get the same issue as OP. I'm usage tier 1, so I have access to gpt-4.

Am I missing something?

rikhuijzer commented 5 months ago

@TheJedinator, @patrykchojecki, @u-foka version 2.0.3 is now available in Brew (https://github.com/Homebrew/homebrew-core/pull/165965). It should be installed automatically when doing brew upgrade.

Please let me know whether the issue is fixed for you all.

rikhuijzer / ata

Other Models result in error #35