[FEAT] how can I use LLM from huggingface as the provider of the Trulens feedback?

truera / trulens

Evaluation and Tracking for LLM Experiments

https://www.trulens.org/

MIT License

2.17k stars 189 forks source link

[FEAT] how can I use LLM from huggingface as the provider of the Trulens feedback? #1651

Open Anchang8 opened 4 days ago

Anchang8 commented 4 days ago

I want to use the local model downloaded from Hugging Face as the provider of Trulens feedback for the RAG Evaluation project. If this feature is already available, how can I use it? Thank you.

sfc-gh-jreini commented 2 days ago

Hi @Anchang8 - we don't currently have this feature through models running locally from Hugggingface, but we can run local LLMs as feedback providers using Ollama (via LiteLLM) if that would meet your needs.

Here's an example notebook:

Ollama Quickstart