feature request: allow providing "Max tokens" parameter in web UI

epam / ai-dial-core

The main component of AI DIAL, which provides unified API to different chat completion and embedding models, assistants, and applications

https://epam-rail.com

Apache License 2.0

55 stars 16 forks source link

feature request: allow providing "Max tokens" parameter in web UI #331

Open justrp opened 4 months ago

justrp commented 4 months ago

DIAL core (API) allows you to specify max_prompt_tokens parameters, but DIAL Chat (web UI) does not. As a user of Web UI (DIAL Chat), I want to be able to specify that parameter.

This issue will collect user feedback to see if team needs to prioritize this feature. Currently we have a single request.

astsiapanay commented 3 months ago

@justrp isn't the issue of https://github.com/epam/ai-dial-chat. I guess the Core has nothing to do here.