codelion / optillm

Optimizing inference proxy for LLMs
Apache License 2.0
1.6k stars 128 forks source link

Add a web search plugin that can be used to ground the responses #97

Open codelion opened 6 days ago

codelion commented 6 days ago

Based on the idea here - https://www.reddit.com/r/ollama/comments/1grlewl/comment/lxdd6hr/?context=3