-
Hello, author. May I ask if you can share the relevant files of these TVQA datasets? Thank you!
# TVQA dataset
ann_path="datasets/evaluation_datasets/tvqa_short/tvqa_val.json"
videos_path= "/ibex…
-
Currently the evaluation is only performed during the pipeline execution. However we later might want to evaluate the models produced in this pipeline on more datasets, and we shouldn't need to re-exe…
-
Here is the result for [SpeechTokenizer](https://github.com/ZhangXInFD/SpeechTokenizer).
The bit rate is 2kbps, following are the results:
**Results in exps/results.txt**
Codec SUPERB applica…
-
Hi, thanks for your nice work! It's quite impressive!
I was going to follow your work and reproduce it. But after I successfully trained the model, I met some problems when I try to evaluate it (on…
-
### What
Hugging Face Datasets support [Slice Splits](https://huggingface.co/docs/datasets/v2.19.0/loading#slice-splits)
```py
datase_10pc = datasets.load_dataset("mydataset", split="test[:10%]")…
-
Could the author please provide the evaluation code? I am only achieving 10 cIoU on RefCOCO datasets (using LISA-like evaluation script). Thank you.
-
The FewGLUE benchmark contains training sets consisting of 32 prompts to be prepended with a given prompt as added context to the model. However, what do we use as the prompts to evaluate model perfor…
-
# 16 kHz 2kbps
## parameter size:
encoder (including quantizer) : 29MB decoder: 40MB
### exps/results.txt
Codec SUPERB application evaluation
Stage 1: Run speech emotion recognition.
Acc: 74.…
-
for the 16kHz Codec model: the bitrate is 2kbps;
for the 44.1kHz Codec model: the bitrate is 6.89kbps;
for the 48kHz Codec model: the bitrate is 7.5kbps;
#1、Here is the exps/results.txt
Codec SU…
-
- [x] I have checked the [documentation](https://docs.ragas.io/) and related resources and couldn't resolve my bug.
**Describe the bug**
I am using ragas for my application where i am calling raga…