search

microsoft / PubSec-Info-Assistant

Information Assistant, built with Azure OpenAI Service, Industry Accelerator
MIT License
264 stars 519 forks source link

Increase maximum question length #694

Closed PaulineJaquot closed 1 month ago

PaulineJaquot commented 1 month ago

Hi,

In the frontend, the maximum question length is set at 1000 characters. This seems to be defined in the "app\frontend\src\components\QuestionInput\QuestionInput.tsx" module. Our users would like to write larger prompts. Is it possible to manually increase the maximum length without any impact on the processing of the query ?

dayland commented 1 month ago

You can simply update the code to increase the size a user can enter. You need to be aware of the Max Request (tokens) for the model you are using. Assuming you are using a model with a large enough Max Request (tokens) then you will be ok.

You can find the full list of token capacity per model at https://learn.microsoft.com/en-us/azure/ai-services/openai/concepts/models

PaulineJaquot commented 1 month ago

Perfect, thanks !