-
When I try to evaluate the quantized AWQ models using the video evalaution script, I'm getting FileNotFoundError.
```
FileNotFoundError: No such file or directory: "/hfhub/hub/models--Efficient-La…
-
```
from ipex_llm import optimize_model
from transformers import LlavaForConditionalGeneration
model = LlavaForConditionalGeneration.from_pretrained('llava-hf/llava-1.5-7b-hf', device_map="cpu")
m…
-
This blog post described unique challenges in doing evaluation for LLMs:
https://medium.com/@ptannor/deepchecks-new-major-release-evaluation-for-llm-based-apps-82786e1ea109
Does there exist a tu…
-
### Describe the bug
So I want to evaluate a particular trace in which my answer and citations are both in the output.
So I gave the following prompt to it
 root@autodl-container-d293479255-f53de588:~/autodl-tmp/data# xtuner train sh/internlm2_5_chat_7b_qlora_oasst1_e3_copy.py --deepspeed deepspeed_zero2
报错信息：10/18 16:45:32 - mmengine - W…