-
Need to add a wiki page with the judges profiles
-
The general categories for the vSDHC have been determined, but now I need to create the outline for the judges that breaks down the categories a bit more.
-
A form to allow admins to add an individual Judge.
**Form fields:** (* marks required fields)
- UserFields *
- Title
- Highest Degree
-
Judges can publicly self-register, and then need approval.
CQ: Should a judge be able to look up a previous account, or should we just do it automatically?
Judges can be invited and then need t…
-
We need three panelist judges. The goal is to raise enough money to pay them a $500 honorarium plus train travel. Though funding of team registration and prizes takes higher priority.
-
When running `ilab model evaluate` the absolute path is needed when passing models to the model, base-model, or judge-model commands. This should not be the case.
-
Hi how can I add a proxy judge manually ? I cant find any judges with links in visual studio
-
Your score breakdown:
224 points total (you placed 10th, which you probably already knew)
- 114 points for passing tests
- 110 points for the judge's section
ghost updated
9 years ago
-
Say me pleeease
-
hello,
我想咨询一下在MT-bench上测试时,使用的reference answer 是通过 gen_api_answer.py --model gpt-4-0125-preview这个命令来获取的吗?
生成的reference answer有80个,然后把其中100~130个用official comment[https://github.com/lm-sys/FastChat/…