search

googleapis / python-aiplatform

A Python SDK for Vertex AI, a fully managed, end-to-end platform for data science and machine learning.
Apache License 2.0
615 stars 330 forks source link

Would geminipro supports logit_bias #3272

Closed indiejoseph closed 7 months ago

indiejoseph commented 7 months ago

logit_bias is a common generation config to control LLM's output, it appears in other vertexai's language model family such as text-bison, would it happen to having logit_bias in geminipro model's generation configs?

ZhenyiQ commented 7 months ago

Hi @indiejoseph ,

Thanks for bringing this up! We don't plan to add support for logit_bias for Gemini in the foreseeable near future.