instructkr LogicKor issues

instructkr / LogicKor

한국어 언어모델 다분야 사고력 벤치마크

175 stars 31 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

Self-report (NCSOFT/Llama-VARCO-8B-Instruct)

#51 sjh6319 closed 1 month ago
1
Update LogicKor Hard

#50 shing100 opened 2 months ago
0
Add files via upload (self-report)

#49 KyujinHan closed 1 month ago
4
EEVE 템플릿 질문

#48 Chad4545 closed 3 months ago
3
add Mistral-Nemo-Instruct-2407

#47 shing100 closed 3 months ago
1
Add gemma2 stop tokens

#46 upskyy closed 3 months ago
1
Add .ruff.toml and remove noqa

#45 kimdwkimdw closed 3 months ago
0
[Feature] Add Gemini Client for generations

#44 sigridjineth closed 4 months ago
0
style: implement black, isort, ruff again

#43 sigridjineth closed 4 months ago
0
[Feature] Add azure openai client to evaluator.py

#42 upskyy closed 4 months ago
2
Add Azure openai client

#41 upskyy closed 4 months ago
1
fix readme.md & evaluator.py

#40 4N3MONE closed 4 months ago
1
bug in generator.py

#39 4N3MONE closed 4 months ago
2
fix : fix typo and depreciated argment in example

#38 4N3MONE closed 4 months ago
0
LogicKor V2 Update

#37 StableFluffy closed 4 months ago
1
Add CI with pre-commit

#36 kimdwkimdw closed 4 months ago
1
Fix pandas to_json, read_json usage.

#35 kimdwkimdw closed 4 months ago
1
generator_openai.py PROMPT_STRATEGY 추가 및 openai api 호환 지원

#34 boxqkrtm closed 4 months ago
1
generator_openai.py PROMPT_STRATEGY 추가 및 openai api 호환 지원 (코드 문제가 있어 close처리)

#33 boxqkrtm closed 4 months ago
0
feat: update score, add tqdm

#32 shing100 closed 4 months ago
1
[Feature] Generator OpenAI & Claude

#31 sigridjineth closed 4 months ago
0
yi-large-preview 결과 추가

#30 HeegyuKim closed 4 months ago
0
Update generator_vllm.py

#29 kimdwkimdw closed 4 months ago
0
Proposal for adding Korean knowledge evaluation data

#28 js-lee-AI closed 5 months ago
1
Add Qwen2 Chat Template & Update chat completion generator.py

#27 sigridjineth closed 5 months ago
0
Scoring inconsistency in multi-turn reasoning questions

#26 smartdolphin closed 4 months ago
1
Add reasoning question

#25 smartdolphin closed 5 months ago
2
feat: score.py update

#24 shing100 closed 5 months ago
0
request for add chat template for our model (akallama, mirlab/AkaLlama-llama3-70b-v0.1)

#23 pull-ups closed 6 months ago
0
Japanese Translation

#22 sigridjineth closed 4 months ago
0
Fix KeyError on processing batches

#21 appleparan closed 4 months ago
4
Rollback: "[Refactor] generator.py to enhance gpu memory util usage

#20 sigridjineth closed 6 months ago
0
Reporting Bugs and Errors

#19 sanghyuk-choi closed 5 months ago
2
feat: add chat template for llama3

#18 sigridjineth closed 5 months ago
0
add chat template for llama3

#17 sigridjineth closed 5 months ago
0
Create judge_CarrotAI_OpenCarrot-Mix-7B.jsonl

#16 shing100 closed 6 months ago
1
Add judge_microsoft_WizardLM-2-8x22B

#15 Kesta-bos closed 5 months ago
0
Create judge_OpenCarrot-Mistral-7B-Instruct-v0.2.jsonl

#14 shing100 closed 7 months ago
0
Add Vicuna Template

#13 Kesta-bos closed 7 months ago
1
Request additional support for models not supported by vLLM

#12 ai-yeongji closed 4 months ago
1
Add generator for vllm api requests

#11 sigridjineth closed 7 months ago
0
[Refactor] generator.py to enhance gpu memory util usage

#10 sigridjineth closed 7 months ago
0
Add Gemma tokenizer stop tokens

#9 lemon-mint closed 7 months ago
0
Register more prompt templates

#8 sigridjineth closed 4 months ago
2
minor modify judgement.py

#7 Liberatedwinner closed 7 months ago
0
minor cleanup generator.py

#6 Liberatedwinner closed 7 months ago
1
feat: add template-gemma

#5 shing100 closed 7 months ago
1
update results

#4 sigridjineth closed 7 months ago
0
chore: add chat template for orion, add judge for solar-mini-chat and orion-14b-chat

#3 sigridjineth closed 7 months ago
0
reference 오류

#2 simpleusername96 closed 7 months ago
1