plandex-ai / plandex

AI driven development in your terminal. Designed for large, real-world tasks.
https://plandex.ai
GNU Affero General Public License v3.0
10.78k stars 751 forks source link

→ Token limit exceeded before adding conversation #89

Closed SerJernautAmedia closed 6 months ago

SerJernautAmedia commented 7 months ago

I am using open ai key that can work with GPT-4, GPT-4 turbo, GPT-3 turbo. But when I use plandex tell I receive this error: → Token limit exceeded before adding conversation Can't start work with plandex(

SerJernautAmedia commented 7 months ago

image

danenania commented 7 months ago

Hi @SerJernautAmedia, could you show the output you get from plandex current as well as plandex models?

danenania commented 6 months ago

Closing this pending more info.

benjaminmgross commented 3 months ago

@danenania , I'm having similar issues. I've tried to update the token limit in all of the different ways.

(base) ➜  maas-fractional-coo pdx current
+----------------------+---------+---------+--------+----------+----------+
|     CURRENT PLAN     | UPDATED | CREATED | BRANCH | CONTEXT  |  CONVO   |
+----------------------+---------+---------+--------+----------+----------+
| consulting-framework | 15s ago | 1h ago  | main   | 29420 🪙 | 79321 🪙 |
+----------------------+---------+---------+--------+----------+----------+
(base) ➜  maas-fractional-coo pdx models
+-------------------------------------+
| consulting-framework Model Settings |
+-------------------------------------+

🎛️  Current Model Set
+------------------------------------------------------------------+
|                          gpt-4o-latest                           |
+------------------------------------------------------------------+
| Uses OpenAI's latest gpt-4o model, first released on 2024-05-13, |
| for heavy lifting, and latest version of gpt-3.5-turbo for       |
| lighter tasks.                                                   |
+------------------------------------------------------------------+

🤖 Models
+-----------------+----------+---------------+-------------+-------+
|      ROLE       | PROVIDER |     MODEL     | TEMPERATURE | TOP P |
+-----------------+----------+---------------+-------------+-------+
| planner         | openai   | gpt-4o        |         0.3 |   0.3 |
| summarizer      | openai   | gpt-4o        |         0.2 |   0.2 |
| builder         | openai   | gpt-4o        |         0.1 |   0.1 |
| names           | openai   | gpt-3.5-turbo |         0.8 |   0.5 |
| commit-messages | openai   | gpt-3.5-turbo |         0.8 |   0.5 |
| auto-continue   | openai   | gpt-4o        |         0.1 |   0.1 |
| verifier        | openai   | gpt-4o        |         0.2 |   0.2 |
| auto-fix        | openai   | gpt-4o        |         0.1 |   0.1 |
+-----------------+----------+---------------+-------------+-------+

🧠 Planner Defaults
+------------+------------------+------------------------+
| MAX TOKENS | MAX CONVO TOKENS | RESERVED OUTPUT TOKENS |
+------------+------------------+------------------------+
|     128000 |            10000 |                   4096 |
+------------+------------------+------------------------+

⚙️  Planner Overrides
+------------------------+--------+
|          NAME          | VALUE  |
+------------------------+--------+
| Max Tokens             | 100000 |
| Max Convo Tokens       | 100000 |
| Reserved Output Tokens | 100000 |
+------------------------+--------+
(base) ➜  maas-fractional-coo pdx t "Please create a markdown table of the services found in `services-analysis.md` and append to the document, with the columns, 'Service, Short Description, Profitability'"
zsh: command not found: services-analysis.md
✅ Context is up to date

 💬 User prompt 👇

  Please create a markdown table of the services found in  and append to the
  document, with the columns, 'Service, Short Description, Profitability'

🚨 Server error
  → Token limit exceeded before adding conversation
(base) ➜  maas-fractional-coo