-
Hi team! First things first, thank you for creating this wonderful benchmark!
I believe its curation and evaluation required a lot of effort, so I really appreciate it that you open-sourced the data…
-
### 🚀 The feature, motivation and pitch
The idea here is to use the approach in this paper:
https://arxiv.org/pdf/2406.06443
If possible, to detect if a model has been trained on any of the bench…
-
Hi! Awesome work and datasets collection! Is there a way (or plan to release such a script) to launch a model's benchmark evaluation on the full set of data and obtain a comprehensive report on all th…
-
# Task Name
Covid-19 Cough Audio Classification
## Task Objective
To develop and validate a machine learning model that uses audio cough recordings to accurately **identify and differentiate betw…
-
# Task Name
Covid Detection aims to detect whether a person has covid-19 based on a record of their voice which might include cough. The COSWARA dataset (https://github.com/iiscleap/Coswara-Data) i…
-
Hi there,
I'm trying to set up public datasets for evaluation listed in Table 9, but got different train/test size for some datasets:
1. Facial Emotion Recognition 2013
Dataset I found on [Kaggl…
-
### Is your feature request related to a problem? Please describe.
Importance of Understanding Mental Health in Tech:
1) Stigma Reduction: Promotes awareness and encourages open discussions, fosteri…
-
I'm currently working on adding Facebook AI's DETR model (end-to-end object detection with Transformers) to HuggingFace Transformers. The model is working fine, but regarding evaluation, I'm currently…
-
I am currently verifying all tasks under the `lm-evaluation-harness`. I will raise the issues I encounter one after another in this issue thread. Thank you for your inspection and response! @haileysch…
-
I have checked the [documentation](https://docs.ragas.io/) and related resources and couldn't resolve my bug.
**Describe the bug**
I am trying to run the template code from the Github ReadMe page.…