-
### Reminder
- [X] I have read the README and searched the existing issues.
### System Info
when I just add one line in the `examples/extras/adam_mini/qwen2_full_sft.yaml` got a error below.
```…
-
### Reminder
- [X] I have read the README and searched the existing issues.
### System Info
Have installed all the requirements for Qwen2-vl
### Reproduction
train_mm_proj_only:True
Hello, I wan…
-
### What happened?
We expected to see similar performance in llama.cpp when compared to ipex-llm. But llama.cpp was almost two times slower than ipex-llm given all the parameters were the same.
…
-
[ ] I have checked the [documentation](https://docs.ragas.io/) and related resources and couldn't resolve my bug.
Hi experts,
I use the answer_correctness as the metric, but it failed due to **A…
-
Hello, when i try to run ```bash scripts/llm_collection.sh``` to generate the training corpus for "MLDT", i got the error :
Traceback (most recent call last):
File "/share/home/202320143457/guo…
-
你好,请问llm_cot_probe.py中第333,334行中的if reg:
reg_answer = reg_answer[eval(label)-1], 返回的reg_answer 是什么样子的啊?Demo文件中并没有这种类型的数据实例呢
-
(This is continuation / expansion of #112 which was closed without any explanation.)
Looking at the latest `main` branch code...
For some components, there are different dependency versions list…
-
Thank you for building a fantastic tool!
**Describe the bug**
I'm trying to use LLM rubric with a custom provider and it errors with a cryptic message "Cannot read properties of undefined 'startsW…
-
**Describe the bug**
Trying to use an Azure API Key to run a LLM evaluation using UpTrain. I received a 404 error message saying that the deployment is not found. However, there is no deployment name…
-
Hi,
I want to evaluate gpt4o and other gpt related models on SWE bench dataset. Can someone guide by giving what steps to follow?
I have azure openai access key but it is not getting configured. So,…