-
### Issues Policy acknowledgement
- [X] I have read and agree to submit bug reports in accordance with the [issues policy](https://www.github.com/mlflow/mlflow/blob/master/ISSUE_POLICY.md)
### Where…
-
**Describe the bug**
Local LLMs either raise Timeout error or Fails to parse output.
Ragas version: 0.1.15
Python version: 3.11.3
**Code to Reproduce**
```python
from transformers import Aut…
-
I’m working on a multi task classification with DistilBert with 4 labels, based on your repo, and I was wondering if maybe you could help me, since I'm having a hard time trying tor each the hugging f…
-
### Discussed in https://github.com/Lightning-AI/torchmetrics/discussions/1462
Originally posted by **blazejdolicki** January 26, 2023
Hey everyone, I am trying to log the metric Dice(average=…
-
[Blog post about MLDB Hacktoberfest 2016](http://blog.mldb.ai/blog/posts/2016/10/hacktoberfest2016/)
---
Rationale: Many Kaggle competitions use evaluation metrics that are currently not reported by…
-
### Question Validation
- [X] I have searched both the documentation and discord for an answer.
### Question
When evaluating a RAG retrieval service using the llama-index evaluation method, I encou…
-
[ ] I have checked the [documentation](https://docs.ragas.io/) and related resources and couldn't resolve my bug.
**Describe the bug**
I am able to calculate 4 metrics {'faithfulness': 1.0000, 'an…
-
I have observed a significant performance regression in XGBoost version 1.7 when using the fit method with evaluation sets in sklearn estimators. The issue appears to have been introduced by [this com…
-
### System Info
Transformers: 4.40.2
### Who can help?
@muellerzr @SunMarc @ArthurZucker
### Information
- [ ] The official example scripts
- [ ] My own modified scripts
### Tasks
- [ ] An off…
-
When i follow the example on this page:
https://docs.confident-ai.com/docs/metrics-introduction
and try to use Mistral-7B as evaluation-model, i always get this error when running the exact code …