-
### System Info
- nvidia:535.129.03
- cuda_version:12.4
- GPU:L40S
- OS:Ubuntu 22.04.4 LTS(docker)
- tensorrt-llm: 0.11.0.dev2024060400
### Who can help?
_No response_
### Information
…
-
I need to use it with french data, but the automatic prompt adaptation is not integrated with the evaluation.
-
**Describe the bug**
Can't get the automatic language adaption going for testset generation. I retried this about 10 times.
Ragas version: 0.1.4
Python version: 3.11
**Code to Reproduce**
Sha…
-
![image](https://github.com/InternLM/xtuner/assets/145842232/83f12831-573f-4a42-8f19-905e8a5d57e6)
How do I solve this problem? The error is as above, and the config is attached below
# Copyri…
-
**What would you like to be added/modified:**
1. Build a collaborative code intelligent agent alignment dataset for LLMs:
- The dataset should include behavioral trajectories, feedback, and i…
-
Hello,
I've been trying with different LLMs but I haven't been able to make it works. Could you bring some light?
```shell
luispoveda93@LUIS-PC:~/mlmm-evaluation$ bash scripts/run.sh es micro…
-
What I've done: I have used your main function to get weight-only quantized versions of LLMs (from local LLM safetensors to local LLM safetensors) and then use the quantized versions to evaluate on lm…
-
I will list the test results of various open-source models here. You can refer to these data to select models and configure devices. Of course, the evaluation of LLM is quite subjective. I also sugges…
-
### Question Validation
- [X] I have searched both the documentation and discord for an answer.
### Question
Hi,
I was wondering on what base the prompt used by these metrics were defined.
Was…
-
**What would you like to be added/modified**:
A benchmark suite for large language models deployed at the edge using KubeEdge-Ianvs:
1. Interface Design and Usage Guidelines Document;
2. Implem…