feat(main.py): Gemini (Google AI Studio) - Support Function Calling, Inline images, etc.

[krrishdholakia]

Title

Gemini (Google AI Studio) - Support Function Calling, Inline images, etc.

Relevant issues

Closes https://github.com/BerriAI/litellm/issues/3365 Closes https://github.com/BerriAI/litellm/issues/2756

Type

🆕 New Feature 🧹 Refactoring

Changes

• [x] Moves gemini/ calling logic to just use vertex_httpx.py
• [x] Uses the same calling logic for google ai studio/vertex ai. Simplifies logic, gives google ai studio integration all of vertex ai features.
• [x] Implement async streaming support
• [x] handle system instruction correctly based on model

[REQUIRED] Testing - Attach a screenshot of any new tests passing locall

If UI changes, send a screenshot/GIF of working UI fixes

• covered by existing gemini testing

[vercel[bot]]

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name	Status	Preview	Comments	Updated (UTC)
litellm	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	Jun 18, 2024 2:51am