bifrostlab / llm-assistant

Multifunctional LLM Assistant for Discord
8 stars 6 forks source link

Get error when LLM response is longer than 2000 characters #35

Closed rodonguyen closed 6 months ago

rodonguyen commented 7 months ago

I asked: /ask model:phi prompt:hi what model are you? are you from openai? GPT 3.5 or 4? You can reproduce this by asking it to write an essay longer than 2000 chars for example.

Output: Ignoring exception in cmd `/ask`: HTTPException: 400|Bad Request: content BASE_TYPE_MAX_LENGTH: Must be 2000 or fewer in length.

This is because Discord messages limit the length to <= 2000 chars. Maybe prompt engineer it somehow to tell it to response shortly, Team AI Engineer?