I uploaded the file and started the chat and AOAI returned an error saying that the token limit has been reached.
I have taken care of this by changing the search limit from 10 to 5 as a simple solution,
However, since this did not occur with the previous UI, we thought there might be another problem and investigated, and discovered that the chunk size was different.
Currently the upper limit is 2300, but previously it was 1000.
We believe that although the chunk size has changed, the search limit has not, and therefore the tokens sent have reached the limit.
Note that we are using gpt-3.5-16k as the model.
We believe that individual users will modify this according to their situation, but we would like to inform you that this phenomenon has occurred.
everyone
I uploaded the file and started the chat and AOAI returned an error saying that the token limit has been reached.
I have taken care of this by changing the search limit from 10 to 5 as a simple solution, However, since this did not occur with the previous UI, we thought there might be another problem and investigated, and discovered that the chunk size was different.
Currently the upper limit is 2300, but previously it was 1000.
We believe that although the chunk size has changed, the search limit has not, and therefore the tokens sent have reached the limit.
Note that we are using gpt-3.5-16k as the model.
We believe that individual users will modify this according to their situation, but we would like to inform you that this phenomenon has occurred.