ChristianMontecchiani / ChatGPT-Failure

The ChatGPT Failures Archive is a repository that collects and documents instances where ChatGPT, a language model developed by OpenAI, does not provide accurate or satisfactory responses. It serves as a valuable resource for researchers, developers, and users interested in understanding the limitations and potential pitfalls of ChatGPT.
4 stars 1 forks source link
chatbot chatgpt failures issues openai

ChatGPT-Failure

ChatGPT is a Large Language Model and it is highly capable with respect to the other public chatbots. However, this system presents different problems that can be categorized in the following list:

  1. Reasoning
  2. Factuality
  3. Bias
  4. Age Risk
  5. Abstraction
  6. Emotional Limitation

1. Reasoning

Critical thinking, decision making, and problem solving are all crucila activities that rely heavily on the fundamental aspect of human intellingece known as reasoning. Models like ChatGPT lack a world model, meaning they do not possess a complete understanding of the physical and social world, or the capability to reason about the connections between concepts and entities, following a causality principle. Adapted from A Categorical Archive of ChatGPT Failures

2. Factuality

ChatGPT commits errors due to inaccuracies in information or sattementes that are not in accordance with reality or the truth.(A Categorical Archive of ChatGPT Failures)

3. Bias

Bias in a language model refers to the systematic inaccuracies or stereotypes in the generated language output, which are influenced by the training data and reflect the societal and cultural prejudices that exist in that data. (Investigating Gender Bias in Language Models Using Causal Mediation Analysis)

4. Age risk

OpenAI does not have age controls to stop people under the age of 13 from using the text generation system. (Wired Article)

5. Abstraction

ChatGPT still lacks the human ability to abstract. We as human have the ability to abstract representations and manipulating symbols. Abstraction can facilitate reasoning, problem solving and learning across many domains. Adapted from (Abstraction Article)

6. Emotional Limitation

The capability of understanding when a discussion becomes/is emotionally hurting for the person interacting with and it is modified/stopped accordingly.