Gemini maximum number of tokens is set up as 2048. Actually in Google AI Studio, there is no such a cap

langgenius / dify

Dify is an open-source LLM app development platform. Dify's intuitive interface combines AI workflow, RAG pipeline, agent capabilities, model management, observability features and more, letting you quickly go from prototype to production.

https://dify.ai

Other

45.86k stars 6.47k forks source link

Gemini maximum number of tokens is set up as 2048. Actually in Google AI Studio, there is no such a cap #1890

Closed WSDzju closed 8 months ago

WSDzju commented 8 months ago

Self Checks

[X] I have searched for existing issues search for existing issues, including closed ones.
[X] I confirm that I am using English to file this report (我已阅读并同意 Language Policy).

Dify version

0.4.1

Cloud or Self Hosted

Cloud

Steps to reproduce

cannot set the number of tokens more than 2048

✔️ Expected Behavior

No response

❌ Actual Behavior

No response

crazywoola commented 8 months ago

But there is a limitation for API

maxOutputTokens 1-2048 gemini-pro：8192 gemini-pro-vision 2048

WSDzju commented 8 months ago

But there is a limitation for API

maxOutputTokens 1-2048 gemini-pro：8192 gemini-pro-vision 2048

The limitation for Gemini-pro is 8192? The actual output tokens can be 8192 when choosing gemini-pro?

crazywoola commented 8 months ago

I don’t think so because the valid range is maximum to 2048 according to the docs.