user_query not included in prompt when default_query_system_prompt too long

zylon-ai / private-gpt

Interact with your documents using the power of GPT, 100% privately, no data leaks

https://privategpt.dev

Apache License 2.0

54.21k stars 7.29k forks source link

user_query not included in prompt when default_query_system_prompt too long #1586

Open friesel opened 9 months ago

friesel commented 9 months ago

When I enter a string of say 500 characters for default_query_system_prompt in the settings file the actual prompt being generated omits the user_query.

when I rerun with a shorter default_query_system_prompt then the user_query IS included.

Any ideas? Thx

icsy7867 commented 9 months ago

Maybe increase your max_new_tokens setting?