Question about max_reference_length when used with Doc Q&A

LagPixelLOL / ChatGPTCLIBot

ChatGPT Bot in CLI with long term memory support using Embeddings.

MIT License

341 stars 38 forks source link

Question about max_reference_length when used with Doc Q&A #29

Closed NeauraNightsong closed 11 months ago

NeauraNightsong commented 1 year ago

since document Q&A can be used with all kinds of documents, I am curuous what the [max_reference_length] setting determines with Document Q&A, as I am looking for the ideal value to set it to

LagPixelLOL commented 11 months ago

It's the max count of pieces to be referenced in each request.