IQSS / askdataverse

Experimental code leveraging LLM applications within Dataverse
MIT License
5 stars 2 forks source link

Not sure what this error is, feel free to update this issue when someone figures it out #2

Open sbarbosadataverse opened 8 months ago

sbarbosadataverse commented 8 months ago

I asked the data a question, and got this

Screen Shot 2024-02-26 at 12 31 58 PM
antonpolishko commented 8 months ago

The error means that the data is too long for the context window for the LLM used.

Either changes in chunking needed on the askdataverse bot side, or upgrade to model with bigger context window on API endpoint side.