-
Issue is to track evaluation of RAG implementations.
Frameworks:
- F
Papers:
- F
- F
One-Offs:
- https://github.com/microsoft/promptflow/tree/main/examples/flows/evaluation/eval-qna-rag…
-
-
## 🚀 Feature Request
MoA is a framework to enhance Agent ability. MoA (Mixture of Agents) uses hybrid agents to enhance large language model capabilities, aiming to iteratively collaborate through …
-
Big noob here. Any help is much appreciated. 🙏 The interface gets stuck in a loading loop, with some pages full or partially loaded. LLM calls are made successfully to OpenAI (the only API that ha…
-
blocks #11
Process the audio transcript to try and identify important metrics like symptoms, diet, supplement and show the identified loggable metrics as a list to the user for their approval.
Ad…
-
Hi, thanks for your great work! I have read your MovieChat+ paper and noticed that the Zero-shot QA Evaluation result of MovieChat on EgoSchema is 53.5, while the evaluation result in this CVPR paper(…
-
Code is pretty simple:
Imports:
```
from dsrag.llm import OpenAIChatAPI, OllamaAPI
from dsrag.reranker import NoReranker
from dsrag.knowledge_base import KnowledgeBase
from dsrag.embedding i…
-
### Describe the issue
Code :
```
import ollama
prompt = "What all finanicial data is there in this pdf?"
image = "bank statement.pdf"
result = ollama.generate(
model='llava',
…
-
Achieving Faster Open-Source Llama3 Serving with SGLang Runtime (vs. TensorRT-LLM, vLLM)
https://lmsys.org/blog/2024-07-25-sglang-llama3/
gemma 2 update
https://huggingface.co/google/gemma-2-2b
…
-
As the title suggests, Langchain using any of the common LLM models uses the following prompt
```
You are an agent designed to interact with a SQL database.
Given an input question, create a syn…