fgenie rims_minimal issues

fgenie / rims_minimal

Been lazy enough to pull over again to the end!

0 stars 1 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

add phi3-small

#52 strutive07 closed 1 week ago
0
phi3-mini result

#51 strutive07 closed 1 week ago
0
run baseline

#50 strutive07 closed 1 week ago
0
Wonjun refactor 1.1 - Missing code commit

#49 strutive07 closed 3 weeks ago
0
removing unnecessary try-excepts, checking each function

#48 fgenie closed 2 weeks ago
0
Refactor si

#47 fgenie closed 3 weeks ago
0
refactoring - indiv query

#46 strutive07 closed 3 weeks ago
0
VLLM 서빙 및 포워딩

#45 fgenie closed 1 month ago
4
현재 실험이 수행되고 있는 최신버전의 코드

#44 fgenie closed 3 months ago
0
p2c/pal 결과 처리과정 수정

#43 fgenie closed 3 months ago
1
(WIP) select_fewshots: [x] cot [ ] pal [ ] p2c

#42 fgenie closed 3 months ago
0
Migrate

#41 fgenie closed 3 months ago
0
더 올바른 OCW, MATH 평가를 위한 parsing, evaluation 함수 테스트 및 업데이트 사항 추가

#40 fgenie closed 3 months ago
0
added example script for the experiment

#39 fgenie closed 4 months ago
0
어떻게 하면 response 받을 수 있나요? 포트?

#38 fgenie closed 4 months ago
1
회의록 Feb 11~

#37 fgenie opened 4 months ago
35
hanging problem circumvent: records into small chunks

#36 fgenie closed 4 months ago
4
최최최종 결과 모으기

#35 fgenie opened 4 months ago
3
added "--backbone chatgpt0613long"

#34 fgenie closed 4 months ago
0
To appendix: [합친 결과 테이블]

#33 fgenie opened 5 months ago
1
Migrate to openai 1.11.0

#32 fgenie closed 5 months ago
1
[OCW 결과]

#31 fgenie closed 4 months ago
1
Added + validated is_equiv_ocw() and its related functions

#30 fgenie closed 5 months ago
1
added safety lines to get_concordant_answer()

#29 fgenie closed 5 months ago
1
[bug] OCW: is_equiv_ocw() 가 제대로 동작하지 않음

#28 fgenie closed 5 months ago
2
Points to discuss

#27 fgenie opened 5 months ago
2
run_evaluation_each.py (cot pal p2c 각각의 정확도 재는 스크립트) 추가

#26 fgenie closed 5 months ago
0
[RIMS ablation] few shot blurb에서 mistake을 포함한 윗부분을 제거하고 아랫 부분 (맞는 풀이) 부분만 남긴 경우?

#25 fgenie closed 4 months ago
0
[한가지 method만 사용하였을 경우 데이터셋 별 성능]

#24 fgenie closed 4 months ago
1
[SVAMP 결과 기록]

#23 fgenie closed 4 months ago
3
[GSM결과 기록] prealgebra 실험하면서 많은 디버깅을 거쳤기 때문에 다시 측정

#22 fgenie closed 4 months ago
2
IndexError 문제 해결 + baseline selection prompt 수정사항

#21 fgenie closed 5 months ago
2
[MATH 결과 기록] selection prompt 오류 수정후 RIMS-GSM prompt 성능

#20 fgenie closed 4 months ago
5
pqdm now + gpt4turbo causes IndexError (not happened before)

#19 fgenie closed 5 months ago
8
safe_execute_turbo() 에서 "import " 로 시작하는 부분을 코드에 포함하여 읽도록 변경해야함

#18 fgenie closed 5 months ago
2
fix: do not convert to string if None

#17 seanexp closed 5 months ago
0
[BUG] None 이 string 으로 변환되어 get_concordant_answer 에서 걸러지지 않는 문제

#16 seanexp closed 5 months ago
0
fix bug on get_concordant_answer

#15 seanexp closed 5 months ago
3
FIX: get_concordant_answer 에서 majority_ans 를 제대로 뽑지 못하는 문제

#14 seanexp closed 5 months ago
0
MATH 결과

#13 seanexp closed 5 months ago
6
KeyError: "None of ['index'] are in the columns"

#12 seanexp closed 5 months ago
2
fix: fill missing requirements

#11 seanexp closed 5 months ago
0
Incomplete requirements.txt

#10 seanexp closed 5 months ago
0
fix: Object of type * is not JSON serializable

#9 seanexp closed 5 months ago
0
[FIX] Object of type Fraction is not JSON serializable

#8 seanexp closed 5 months ago
0
변경점 [7b5b90]

#7 fgenie closed 5 months ago
2
feat: Add MATH eval

#6 seanexp closed 5 months ago
0
Add MATH eval

#5 seanexp closed 5 months ago
0
feat: Add MATH-prealgebra downloading script

#4 seanexp closed 5 months ago
1
MATH-prealgebra 데이터셋 다운로드 스크립트 및 데이터셋 추가

#3 seanexp closed 5 months ago
0