Closed matt-bernstein closed 1 month ago
Attention: Patch coverage is 49.18033%
with 62 lines
in your changes missing coverage. Please review.
Project coverage is 58.49%. Comparing base (
41f0270
) to head (fba2889
). Report is 3 commits behind head on master.
:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.
Pass through azure params needed to LiteLLM, and abstract away common inference params into a Settings class, removing 100 lines of redundant parameter plumbing+docs and ensuring all litellm-derived Runtimes have the same API.
Other QoL improvements
splitter
arg in runtimesExample of an Azure payload is at the end of test_server.py.