Closed MinhNgyuen closed 2 weeks ago
If you could point to where in the code we could implement this I can take a stab at adding this functionality.
This issue is stale because it has been open for 30 days with no activity. Remove stale label or comment or this will be closed in 5 days.
This issue was closed because it has been stalled for 5 days with no activity.
Right now if you give an Agent a task to write a long report and a lot of context, it will run out of output_tokens and stop midway through its response. There is no option to have the LLM continue generating the report in the case the LLM ran out of output tokens.
Similar to the ChatGPT web ui, add an option to continue output generation and finalize the output.
Here's some example code of how its done with OpenAI