search

BerriAI / litellm

Python SDK, Proxy Server to call 100+ LLM APIs using the OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]
https://docs.litellm.ai/docs/
Other
12.3k stars 1.43k forks source link

[Feature]: support dbrx client for getting credentials in spark notebooks #5732

Open krrishdholakia opened 2 days ago

krrishdholakia commented 2 days ago

The Feature

Allow users to use litellm in spark notebooks without needing to explicitly set api key / api base.

Motivation, pitch

Make it easier for users to use DSPy in databricks notebooks

Twitter / LinkedIn details

cc: @dbczumar

krrishdholakia commented 2 days ago

Creating a ticket to track the issue given recent conversations on https://github.com/BerriAI/litellm/pull/5725

dbczumar commented 2 days ago

Thanks @krrishdholakia :D

krrishdholakia commented 2 days ago

from linkedin conversation w/ @dbczumar looks like we might be able to use w.config.authenticate() to update the headers with the correct config

dbczumar commented 2 days ago

Filed https://github.com/BerriAI/litellm/pull/5733 to adopt w.config.authenticate() :). Thanks @krrishdholakia !

krrishdholakia commented 2 days ago

do you mean https://github.com/BerriAI/litellm/pull/5746 ? @dbczumar

dbczumar commented 2 days ago

do you mean #5746 ? @dbczumar

Yeah #5746 :)