-
Hi, thanks for your nice work. I have a question about reproducing the driving score shown in the paper. I run the evaluation with the following configurations:
```
preception_model = 'memfuser_…
-
### What happened?
`GGML_ASSERT: D:\a\llama.cpp\llama.cpp\ggml.c:12853: ne2 == ne02`
### Name and Version
```
version: 2965 (03d8900e)
built with MSVC 19.39.33523.0 for x64
```
### What operati…
-
I have some questions about the submission format. Do we need to include the conversation template of the LLM in the submission? For example, should the submission be formatted like
```
[INST] How t…
-
Thank you for your inspiring work and for releasing your dataset~
However, I couldn't find the code for the PaCE experiments. Could you please release the experimental code as well?
-
step1
pretrain_projector_image_encoder.sh
step2
pretrain_projector_video_encoder.sh
step3
finetune_dual_encoder.sh
step4
eval/vcgbench/inference/run_ddp_inference.sh
step5
eval/vcgbench/gpt_e…
-
运行xtuner train /root/autodl-tmp/ft/config/internlm2_chat_7b_qlora_alpaca_e3_copy.py --work-dir /root/autodl-tmp/ft/train时
`[2024-05-30 17:18:47,089] [INFO] [real_accelerator.py:203:get_accelerator] S…
-
I am inquiring about the potential integration of an evaluation pipeline to enhance the tracking of LLM performance.
### Suggestion:
I propose the integration of an evaluation pipeline that levera…
-
Hi Team,
Thanks for designing RAG Evaluation package this was a much needed thing in LLMs projects.
I wanted to know how can I create/convert my dataset into the format which I can use in Inspect…
-
### Action
Update publication
### Title
Evaluating In-Context Learning of Libraries for Code Generation
### Shorthand
icl-libraries
### Author
Arkil Patel
### Names
Arkil Patel, Siva Reddy, D…
-
There's mention of scored steps for the solutions for each of the 100 Questions, which also accompany the corresponding questions in the json files.
Are their purpose only to serve as a better evalua…