-
When [ `exact_coverage_calculation`](https://github.com/thoglu/jammy_flows/blob/4ca7aeccba04bc3c73d33f158f3f1dbea366381b/jammy_flows/main/default.py#L1972) is set to true, an error occurs because the …
-
### Reminder
- [X] I have read the README and searched the existing issues.
### System Info
llamafactory-version 0.8.3.dev0
python 3.11.9
AWS EC2 instance
### Reproduction
```
llamafactory…
-
We currently leverage some llm based evaluation metrics from ragas: https://github.com/explodinggradients/ragas
namely, `llm_context_precision`, `llm_context_recall` and `llm_answer_relevance` in thi…
-
suggested here: https://evals-workspace.slack.com/archives/C055R8EUUR1/p1727115739118329
-
This probably requires doing something like this: https://auth0.com/blog/securing-a-python-cli-application-with-auth0/
Proposed flow:
1. User runs `viv login`
2. viv CLI opens / gives the user …
-
@sdjordjevicTT:
While debugging MNIST inference, I observed a transpose operation in the linear layer. I noticed that in some of the tt-forge passes(seems to be consteval), we move this transpose up …
-
## Problem
Systematically evaluate the performance of our multimodal model by comparing it to a baseline benchmark.
Baseline is a cascaded system of Whisperspeech TTS + LLaMA3.1.
## Suggestions
- LM…
-
In GenAIEval/evals/benchmark/README.md (and others), the first step in the instructions is,
```
pip install -r ../../requirements.txt
```
There's a non-stated assumption of the current direct…
-
change core-eval for priceFeed, vaults, auctions
later ones need to be coordinated with earlier ones using promises
## Test Plan
include a3p test
-
**Environment**:
*(Hint: "Report Extension Issue on Github" command will fill these out for you.)*
**Version information**
Gemini code assist 2.17.0 (September 2024)
VScode 1.93.1
Cloud Cod…