Move litellm.api_base - Githubissues

yujonglee / eval

Evaluate your LLM apps, RAG pipeline, any generated text, and more!

MIT License

0 stars 0 forks source link

Closed yujonglee closed 1 year ago

yujonglee commented 1 year ago

After https://github.com/BerriAI/litellm/issues/260 resolved, litellm has api_base param in completion function.

Blocker is:

Since this is test-runner specific, hesitating to move this to llm.py. Not strong preference though
How about litellm.headers?

yujonglee commented 1 year ago

BTW, code modified in #102.

yujonglee commented 1 year ago

We better just to do raw HTTP request to proxy server on CI runner env.

yujonglee commented 1 year ago

This is no longer need after #112