-
Hi, thanks for your nice work. I have a question about reproducing the driving score shown in the paper. I run the evaluation with the following configurations:
```
preception_model = 'memfuser_…
-
### Prerequisites
- [X] I am running the latest code. Mention the version if possible as well.
- [X] I carefully followed the [README.md](https://github.com/ggerganov/llama.cpp/blob/master/README.md)…
-
### Willingness to contribute
Yes. I would be willing to contribute a document fix with guidance from the MLflow community.
### URL(s) with the issue
https://mlflow.org/docs/latest/llms/llm-evaluat…
-
### Confirm that this is a metadata correction
- [X] I want to file corrections to make the metadata match the PDF file hosted on the ACL Anthology.
### Anthology ID
2024.eacl-demo.23
### Type of …
-
PandaLM: An Automatic Evaluation Benchmark for LLM Instruction Tuning Optimization. PandaLM is the first to evaluate llm using a finetuned llm.
-
**What would you like to be added/modified**:
A benchmark suite for multimodal large language models deployed at the edge using KubeEdge-Ianvs:
1. Modify and adapt the existing edge-cloud data c…
-
**Thanks for your fantastic work!**
I'm trying to reproduce your work by the leading and the checkpoints posted on the repo, but I get bad results.
I used the official code and model weights, conduc…
TLDBN updated
1 month ago
-
Hello Authors,
I am a researcher reproducing your paper.
As others have mentioned (#2), the code base released here cannot reproduce the paper's results. The function `call_fix_bug`, for example…
-
-
Hi team, thanks for open source this awesome tool. I am new to the tool and try to ask some questions on LLM evaluation
1. Seems `evaluate` already create some evaluators (Some libs call it tasks I…