-
Evaluation failed: 'CustomOllama' object has no attribute 'set_run_config', what is the solution,
Ragas Version: 0.1.7
**Code Examples**
# Define a simple dataset using Pandas DataFrame
data…
-
# Input Size Mismatch in `goat_skill_chain` Evaluation
## Problem Description
When running the evaluation of `goat_skill_chain`, two main issues are encountered:
1. The checkpoint file `ckpt.…
-
**Proposal**: Assess critical variables affecting semantic search quality on legal corpus before implementing semantic search on CL.
**Key Variables**:
- Embedding model
- Chunking strategy
- I…
-
### System Info
```Shell
'Accelerate version: 0.31.0
Platform: Linux-5.4.0-1131-aws-fips-x86_64-with-glibc2.35
'accelerate bash location: /databricks/python3/bin/accelerate
Python version: 3…
-
### Title
Embedding based approach over Traditional LDA for AdHoc Retrieval
### Team Name
Retrieval Kings
### Email
202311021@daiict.ac.in
### Team Member 1 Name
Bhavan Bhatt
#…
-
### Is there an existing issue for this?
- [X] I have searched the existing issues
### Topic
A lot of user is curious about how fast those embeddings are and how it can be improved.
We should ad…
-
I have finetuned a couple of **BAAI/bge-base-en** on my own dataset for the Retrieval task.
I have a train and a validation split. Now I need to need a metric to verify which model performed better…
-
### Title
Domain-specific conversational AI using RAG
### Team Name
RAGxperts
### Email
202318039@daiict.ac.in
### Team Member 1 Name
Vrishmi Parikh
### Team Member 1 Id
202318013
### Team M…
-
```python
import argparse
from pathlib import Path
from C_MTEB.tasks import *
from flag_dres_model import FlagDRESModel
from mteb import MTEB
import openai
import tiktoken
import pickle
imp…
-
Thanks for your works! I'm confusing about the video_feat_encoder class, which is used in "Diff-Foley/evaluation/config/eval_classifier.yaml" for evaluation. This encoder is a nn.module, operating nn…