IINemo lm-polygraph issues

IINemo / lm-polygraph

MIT License

84 stars 18 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

Direct model api

#214 rvashurin opened 1 week ago
0
Added BLEU

#213 ArtemVazh closed 2 weeks ago
0
Added BLEU metric

#212 ArtemVazh closed 2 weeks ago
0
External models

#211 rvashurin closed 1 week ago
0
Fix/registers

#210 rvashurin opened 3 weeks ago
0
Automatic publish to PyPI when creating new release

#209 SpeedOfMagic closed 3 weeks ago
2
Non-critical typing errors fixed

#208 Aktsvigun closed 2 weeks ago
0
About the generation metric for questions with multiple correct answers

#207 caiqizh opened 4 weeks ago
2
Dockerfile adjustments

#206 SuperCoolCucumber opened 1 month ago
3
Fix warning

#205 rvashurin closed 3 weeks ago
0
OpenAI chat try-except added, prompt fixed

#204 Aktsvigun closed 1 month ago
0
Fix claims extraction

#203 cant-access-rediska0123 closed 1 month ago
0
My latest updated it includes the extraction and check for claims

#202 bodasadallah opened 2 months ago
0
modulating claim extraction code

#201 bodasadallah opened 2 months ago
0
Claim level Chinese

#200 ruixing76 closed 1 week ago
0
Monotonic calibration

#199 rvashurin closed 3 weeks ago
1
Calibration

#198 rvashurin closed 2 months ago
0
Fix entropy calculation

#197 rvashurin closed 3 months ago
0
Fix gsm8k config

#196 ArtemVazh closed 3 months ago
0
Entropy calculation maybe wrong?

#195 atharvajk98 closed 3 months ago
6
updated configs for gsm8k

#194 ArtemVazh closed 3 months ago
0
Fix mmlu config, coqa config and xsum prompting

#193 rvashurin closed 3 months ago
0
Claim level

#192 cant-access-rediska0123 closed 1 month ago
0
Use target texts from arg list + fix wmt14 config

#191 rvashurin closed 3 months ago
0
Typo microfix

#190 rvashurin closed 3 months ago
0
Change mmlu config

#189 rvashurin closed 3 months ago
0
CCP hotfix second attempt

#188 IINemo closed 3 months ago
1
Revert dataset refactor

#187 rvashurin closed 3 months ago
0
Benchmark fixes

#186 rvashurin closed 3 months ago
0
Hotfix for CCP

#185 IINemo closed 3 months ago
2
Revert dataset refactor

#184 rvashurin closed 3 months ago
0
Generate until

#183 rvashurin closed 3 months ago
0
CCP

#182 cant-access-rediska0123 closed 3 months ago
0
Move stat calculators registration to separate function

#181 cant-access-rediska0123 closed 3 months ago
1
Experimental configs overhaul

#180 rvashurin closed 3 months ago
0
Added generation parameters to eval script

#179 ArtemVazh closed 3 months ago
1
added min_new_tokens

#178 ArtemVazh closed 3 months ago
0
added generation params to sample function

#177 ArtemVazh closed 3 months ago
2
fix blackbox stats

#176 ArtemVazh closed 3 months ago
0
Added new metrics

#175 ArtemVazh closed 3 months ago
0
Tacl exps

#174 rvashurin closed 3 months ago
0
Improve model parametrization

#173 rvashurin closed 3 months ago
2
Do not copy dataset when subsampling

#172 rvashurin closed 3 months ago
0
CCP

#171 cant-access-rediska0123 closed 3 months ago
1
May I know how to run an ensemble-based uncertainty estimation method?

#170 he159ok closed 4 months ago
2
Update notebooks, remove old experimental methods

#169 cant-access-rediska0123 closed 4 months ago
0
Fix citation for NumSemSets

#168 cant-access-rediska0123 closed 4 months ago
0
Fix readme

#167 ArtemVazh closed 4 months ago
0
using the openai API for a BlackBox model for non OPENAI hosted platforms

#166 psteinb opened 5 months ago
4
[Question] Pipeline integration (Langchain)

#165 Rebell-Leader closed 4 months ago
1