search

webpilot-ai / Webpilot

https://www.webpilot.ai
GNU General Public License v3.0
1.78k stars 179 forks source link

Prompt context length is still short #91

Open webmasterfsd opened 11 months ago

webmasterfsd commented 11 months ago 
          Hi @CocoSgt

Thanks. It's saving the longer prompts now, but the prompt context length is still short for me; how can I increase its context length to 1000 words or 6000 characters?

Thanks,

Originally posted by @webmasterfsd in https://github.com/webpilot-ai/Webpilot/issues/87#issuecomment-1804773956

webmasterfsd commented 11 months ago

You can see in the screenshot that after a specific limit, I can't write more words in the new prompt. I counted this length, stopping at 329 words or 2,010 characters. And I want to increase it to 1000 words or 6000 characters.

Screenshot_154

CocoSgt commented 11 months ago

In the previous version, gpt3.5 had a default maximum of 4096 tokens, so the prompt was limited to a maximum of 2000 tokens. In the next version, this limitation will be lifted (and will support some features of gpt-4v).