[Feature Request] Use proper JSON Mode for Gemini Models instead of Tool calling

langchain-ai / langchain-google

MIT License

117 stars 149 forks source link

[Feature Request] Use proper JSON Mode for Gemini Models instead of Tool calling #531

Closed strentom closed 1 month ago

strentom commented 1 month ago

It seems with_structured_output in current ChatVertexAI is implemented using tool calling (JsonOutputToolsParser) instead of JSON mode. Note that these are different things. Gemini now supports JSON mode as documented here.