-
### Confirm that this is a metadata correction
- [X] I want to file corrections to make the metadata match the PDF file hosted on the ACL Anthology.
### Anthology ID
2024.eacl-demo.23
### Type of …
-
Hi, I noticed in the tech report of LLama3-8B-80K that, the authors evaluate the vanilla LLama-8K-Instruct in the LongBench dataset with 8K context length, and obtain the following results:
![image](…
-
Hi, thanks for your nice work. I have a question about reproducing the driving score shown in the paper. I run the evaluation with the following configurations:
```
preception_model = 'memfuser_…
-
Hi, I am trying to evaluate the model RLHFlow/LLaMA3-iterative-DPO-final with MT Bench. I use the inference environment in ReadME and follow the scripts from https://github.com/lm-sys/FastChat/tree/ma…
-
运行xtuner train /root/autodl-tmp/ft/config/internlm2_chat_7b_qlora_alpaca_e3_copy.py --work-dir /root/autodl-tmp/ft/train时
`[2024-05-30 17:18:47,089] [INFO] [real_accelerator.py:203:get_accelerator] S…
-
[ ] I checked the [documentation](https://docs.ragas.io/) and related resources and couldn't find an answer to my question.
**Your Question**
How can I integrate EvaluatorChain with an existing Ru…
-
Hi Team,
Thanks for designing RAG Evaluation package this was a much needed thing in LLMs projects.
I wanted to know how can I create/convert my dataset into the format which I can use in Inspect…
-
Hello everyone,
I am trying to implement the trace user feedback. And this seems to be working well (the endpoint returns a 200 code response). However, I don't see the span/traces on the online d…
-
### Action
Update publication
### Title
Evaluating In-Context Learning of Libraries for Code Generation
### Shorthand
icl-libraries
### Author
Arkil Patel
### Names
Arkil Patel, Siva Reddy, D…
-
### What happened?
`GGML_ASSERT: D:\a\llama.cpp\llama.cpp\ggml.c:12853: ne2 == ne02`
### Name and Version
```
version: 2965 (03d8900e)
built with MSVC 19.39.33523.0 for x64
```
### What operati…