search

getmetal / motorhead

🧠 Motorhead is a memory and information retrieval server for LLMs.
https://getmetal.io
Apache License 2.0
843 stars 79 forks source link

Support base_url for client #100

Closed bdqfork closed 8 months ago

bdqfork commented 9 months ago

Can you please support me in modifying the base_url as I am currently using some OpenAI-like services?

Czechh commented 9 months ago

we're using async-openai for out client, and it seems like they support setting api_base https://docs.rs/async-openai/latest/async_openai/config/struct.OpenAIConfig.html#method.with_api_base

Is this what you're looking for? setting this as an env variable to overwrite that default api base?

kranthi419 commented 8 months ago

yes @Czechh

kranthi419 commented 8 months ago

also, can u please add a support for custom embedding configuration.

bdqfork commented 8 months ago

we're using async-openai for out client, and it seems like they support setting api_base https://docs.rs/async-openai/latest/async_openai/config/struct.OpenAIConfig.html#method.with_api_base

Is this what you're looking for? setting this as an env variable to overwrite that default api base?

Yes, I want to set this as an env variable to overwrite that default api base.

kranthi419 commented 8 months ago

@bdqfork https://github.com/getmetal/motorhead/pull/102 please vote this pr.