truera / trulens

Evaluation and Tracking for LLM Experiments
https://www.trulens.org/
MIT License
1.84k stars 163 forks source link

[FEAT] Support for multi-modal RAG evaluation (including images, tables, etc.) #1218

Closed joly-chen closed 2 weeks ago

joly-chen commented 2 weeks ago

Feature Description Support for multi-modal RAG evaluation (including images, tables, etc.)

Reason Multi-modal RAG is becoming more important.

sfc-gh-jreini commented 2 weeks ago

Hi @joly-chen - multimodal RAG evaluation is already supported. Here's an example notebook you can adapt to your use case: https://github.com/truera/trulens/blob/main/trulens_eval/examples/expositional/models/gemini_multi_modal.ipynb