-
### Issues Policy acknowledgement
- [X] I have read and agree to submit bug reports in accordance with the [issues policy](https://www.github.com/mlflow/mlflow/blob/master/ISSUE_POLICY.md)
### W…
-
IOB2 is supported as input as you told in the readme, but the evaluation metrics is not in iob2 way. It's in iob1 way. So, you can either provide option for people to choose evaluation scheme for iob1…
-
Content:
1. Context
2. Problem Statement
3. Scope of Problem
4. Goals
5. Project Stakeholders
6. Analytics Approach
7. Metrics Evaluation
-
Hi Haonan,
I want to run the pure inference on unlabeled data but it seems that your code only support run prediction on the data with ground truth, which is not what I expect (seems have to gone…
-
### Product Version
- [ ] Amazon SageMaker Studio Classic
- [X] Amazon SageMaker Studio
- [ ] Issue is not related to SageMaker Studio
### Issue Description
I created a SageMaker Pipeline w…
-
[ ] I have checked the [documentation](https://docs.ragas.io/) and related resources and couldn't resolve my bug.
**Describe the bug**
A clear and concise description of what the bug is.
Ragas …
-
**Context**
Evaluation suite - Need to be able to address multiple input situations - Either a single pair of reference / output or a folder of matching pairs or numpy arrays already loaded to memory…
-
**Describe the bug**
Using multi-metric scoring in DistGridSearchCV results in an NameError:
File "/home//.local/lib/python3.6/site-packages/skdist/distribute/search.py", line 315, in fit
not…
-
Trying to coalesce a few things we've been discussing regarding making transforms more efficient.
## 1. Partial `basis.evaluate`
When calling `basis.evaluate` you should be able to specify which c…
-
Evaluation des metrics
- [x] création de l'environnement et de l'index
- [x] tests de search en fonction des metrics et des documents (boucle)
- [ ] mise sous csv des résultats
- [x] nettoyage…