Maximum context length is 8192 tokens.

exoascension / vault-chat

A ChatGPT bot trained on your vault notes. Ask your AI questions about your own thoughts and ideas!

GNU General Public License v3.0

113 stars 7 forks source link

Maximum context length is 8192 tokens. #41

Open HedyRaymond opened 6 months ago

HedyRaymond commented 6 months ago

The plugin fails at indexing rendering it unusable. Chunks seem to be too big.

{
  "error": {
    "message": "This model's maximum context length is 8192 tokens, however you requested 9663 tokens (9663 in your prompt; 0 for the completion). Please reduce your prompt; or completion length.",
    "type": "invalid_request_error",
    "param": null,
    "code": null
  }
}