GPT-4 doesn't seem to work

ersinakinci commented 4 months ago

Thanks for this awesome app.

When I try to set the model to GPT-4 and I ask "Are you GPT-4?", ChatGPT responds with "No, I am GPT-3, the third iteration of the Generative Pretrained Transformer model developed by OpenAI. As of my training, GPT-4 had not yet been released."

Here's my ~/.config/chatgpt/config.json:

{
  "api_key": "xxx",
  "endpoint": "https://api.openai.com/v1",
  "prompts": {
    "default": "You are ChatGPT, a large language model trained by OpenAI. Answer as concisely as possible."
  },
  "conversation": {
    "prompt": "default",
    "context_length": 6,
    "model": "gpt-4",
    "temperature": 1,
    "stream": true,
    "max_tokens": 1024
  }
}

Any idea what's going on?

j178 commented 4 months ago

Hi, can you share the config part of your~/.config/chatgpt/conversations.json file?

ersinakinci commented 4 months ago

@j178:

{
  "config": {
    "prompt": "default",
    "context_length": 6,
    "model": "gpt-4",
    "stream": true,
    "temperature": 1,
    "max_tokens": 1024
  }
  ...
}

j178 commented 4 months ago

Ah, so that's the genuine response from GPT-4! :)

ersinakinci commented 4 months ago

You know what, this is really weird but I think you're right. I just checked my billing and I was charged for GPT-4 credits.

Why would it claim to be GPT-3? It even gives the wrong date for training data:

You: Wait a second, is this GPT-3? I thought I was using GPT-4
ChatGPT: As of my last training data in September 2021, the most version from OpenAI is GPT-3. If any updates such as a GPT-4 have been released after this period, you'd need to check OpenAI's official resources to get the most current information.

Another one:

        {
          "question": "Are you GPT-4?",
          "answer": "No, I am not GPT-4. I am GPT-3, the third iteration of OpenAI's Generative Pre-trained Transformer model. As of my current update, GPT-4 has not yet been released."
        },
        {
          "question": "I think you're wrong. When I chat with you, I go to my OpenAI billing page and I see that I'm only being charged for GPT-4 credits.",
          "answer": "I apologize for any confusion. As an AI model, I can only provide information up to the point when I was last trained, which is up until GPT-3. If you're seeing charges for GPT-4 in your billing, then it's possible OpenAI has released a new model, but I wouldn't be able to provide information about it. Please refer to OpenAI's official documentation or resources for the most accurate and up-to-date information."
        }

Closing because I don't think the problem is on chatgpt-cli's end. I'm not even sure that there's a problem 😅

j178 commented 4 months ago

This seems like a common question:

j178 / chatgpt

GPT-4 doesn't seem to work #87