search

sobelio / llm-chain

`llm-chain` is a powerful rust crate for building chains in large language models allowing you to summarise text and complete complex tasks
https://llm-chain.xyz
MIT License
1.32k stars 130 forks source link

Add support for setting Open Api Base Url in options! #271

Open prabirshrestha opened 7 months ago

prabirshrestha commented 7 months ago

Ollama now support openai compatible api layer. https://ollama.com/blog/openai-compatibility.

Would be good if BaseUrl was added in Opt enum for open ai.

https://github.com/sobelio/llm-chain/blob/bb57935f3086cbd4a8832e7be82411741f7a0513/crates/llm-chain/src/options.rs#L334C1-L335C20