-
### Is this a unique feature?
- [X] I have checked "open" AND "closed" issues and this is not a duplicate
### Is your feature request related to a problem/unavailable functionality? Please describe.…
-
### Is this a unique feature?
- [X] I have checked "open" AND "closed" issues and this is not a duplicate
### Is your feature request related to a problem/unavailable functionality? Please descr…
-
From https://github.com/OpenAdaptAI/OmniParser/issues/3:
1. **Objective**:
- Implement fine-tuning for OmniParser’s YOLO model to enhance detection accuracy on small icons and UI elements.
2…
-
## Description
We must implement a robust evaluation suite for the text-based retrieval systems on the `anatomy` split from the [MMLU benchmark](https://huggingface.co/datasets/cais/mmlu).
## Pr…
-
**Description:**
I'm experiencing an issue with calculating metrics after saving predictions using `--predict_only` and then attempting to compute metrics with `--from_log`. It appears that the `fr…
-
Draft of `ex11` based on `ex09`.
For full testing you need to sync with the `dg-commons` spaceship model, you can start with some boilerplate, goal definition, evaluation metrics and so on. Please …
-
I create a subclass of baseragassembeddings. because I already have all the embeddings for context, query, and question. I did this to not use the openai API key. because it is costly and also I want …
-
Aim: to conduct an analysis of predicting the overall ratings of NHL players using various parameters and relevant metrics.
Comparisons between the pipelines are made using several performance met…
-
**Learning Goals:**
- Understand the concept and use of the Random Forest Classifier and K-Nearest Neighbors (KNN) algorithm.
- Learn how to preprocess medical data for machine learning, particula…
-
### Feature request
I would like to make an example notebook for evaluating the peft model for reproducable tasks and metrics using the lm-eval harness if possible .
Library here - https://github.…