Open kaptinlin opened 1 month ago
This is the behavior of the underlying service right now, and we don't want to add SDK-specific error checks. Right now, models return a single candidate.
If you're interested, you can ask SDK-agnostic questions on the forum at https://discuss.ai.google.dev/
Description of the bug:
When using the
SetCandidateCount
method to set the number of candidates to 2 for thegemini-1.5-flash-latest
model, the response still only returns 1 candidate. This issue occurs consistently and is not aligned with the expected behavior of the API.Steps to reproduce:
genai.NewClient
method.model.SetCandidateCount(2)
.Code snippet:
Actual vs expected behavior:
Expected: The response should contain 2 candidates as specified by SetCandidateCount. Actual: The response only contains 1 candidate.
Any other information you'd like to share?
The issue occurs consistently, regardless of the input message or context. This behavior may indicate a potential bug in the SetCandidateCount method or an API configuration issue.