[BUG] Gemini 1.5 Pro 002 and Flash 002 Models - Service Parsing Issue

darthalex2014 commented 2 months ago

Description

When using the new Gemini 1.5 Pro 002 and Flash 002 models, a service parsing issue occurs, resulting in an error message. This issue seems to be related to the "index" field within the "candidates" array in the response data, which is expected to be a number but is received as undefined.

Expected Behavior: The response should not contain any error messages and the "index" field within the "candidates" array should be populated with a number.

Actual Behavior: The response contains an error message indicating a service parsing issue related to the missing "index" field.

Affected Models: Gemini 1.5 Pro 002 Gemini 1.5 Flash 002

Aix.Gemini (dispatch-parse): [Service Parsing Issue] Gemini: [ { "code": "invalid_type", "expected": "number", "received": "undefined", "path": [ "candidates", 0, "index" ], "message": "Required" } ]. Input data: {"candidates": [{"content": {"parts": [{"text": "The"}],"role": "model"}}],"usageMetadata": {"promptTokenCount": 29239,"totalTokenCount": 29239}}. Please open a support ticket. POST /api/trpc-edge/aix.chatGenerateContent?batch=1 200 in 2452ms