intuit / Trapheus

This tool automates restoration of RDS database instances from snapshots into any dev, staging or production environments. It supports individual RDS Snapshot as well as cluster snapshot restore operations.
https://intuit.github.io/Trapheus/
MIT License
101 stars 52 forks source link

Integrate local LLMs and define a query optimiser to pick the best LLM based on user query #216

Closed stationeros closed 4 months ago

stationeros commented 4 months ago

We have already integrated ollama as a pilot use case https://github.com/intuit/Trapheus/pull/215 , the idea of this issue is to give user the same option of a localLLM but instead of Llama evaluate the best LLM model from a range of models that can best answer the query and return the output from that model