issues
search
IINemo
/
lm-polygraph
MIT License
111
stars
21
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Experimental configs overhaul
#180
rvashurin
closed
4 months ago
0
Added generation parameters to eval script
#179
ArtemVazh
closed
4 months ago
1
added min_new_tokens
#178
ArtemVazh
closed
4 months ago
0
added generation params to sample function
#177
ArtemVazh
closed
4 months ago
2
fix blackbox stats
#176
ArtemVazh
closed
4 months ago
0
Added new metrics
#175
ArtemVazh
closed
4 months ago
0
Tacl exps
#174
rvashurin
closed
4 months ago
0
Improve model parametrization
#173
rvashurin
closed
4 months ago
2
Do not copy dataset when subsampling
#172
rvashurin
closed
5 months ago
0
CCP
#171
cant-access-rediska0123
closed
4 months ago
1
May I know how to run an ensemble-based uncertainty estimation method?
#170
he159ok
closed
5 months ago
2
Update notebooks, remove old experimental methods
#169
cant-access-rediska0123
closed
6 months ago
0
Fix citation for NumSemSets
#168
cant-access-rediska0123
closed
6 months ago
0
Fix readme
#167
ArtemVazh
closed
6 months ago
0
using the openai API for a BlackBox model for non OPENAI hosted platforms
#166
psteinb
opened
6 months ago
4
[Question] Pipeline integration (Langchain)
#165
Rebell-Leader
closed
6 months ago
1
What is the different between pe_uncertainties and ep_uncertainties?
#164
HuihuiChyan
opened
6 months ago
2
AutoModelForCausalLM max_length
#163
amayuelas
closed
6 months ago
1
Docs
#162
rvashurin
closed
1 month ago
1
Added new methods
#161
ArtemVazh
closed
6 months ago
4
Error Handling
#160
rvashurin
closed
7 months ago
0
Set highest working transformers version
#159
rvashurin
closed
7 months ago
0
fix errors in demo
#158
ArtemVazh
closed
8 months ago
0
Log softmax bug fixed
#157
Aktsvigun
closed
8 months ago
0
Add vicuna and all seq ue methods except excentricity
#156
rvashurin
closed
9 months ago
0
Get the uncertainty scores without rerun the models (for NumSets, Deg, Ecc)
#155
caiqizh
closed
6 months ago
2
Flake8 fixes wo length
#154
rvashurin
closed
9 months ago
0
Add black to gh actions
#153
rvashurin
closed
9 months ago
0
Ood detection optimized
#152
ArtemVazh
closed
9 months ago
0
Make build failing if flake8 reports errors
#151
rvashurin
closed
9 months ago
0
Test run of black
#150
rvashurin
closed
9 months ago
0
Improve test suite, add tests for ensemble methods
#149
rvashurin
closed
9 months ago
0
Make improvements to token restoration procedure
#148
rvashurin
closed
9 months ago
0
Error loading larger models - You shouldn't move a model when it is dispatched on multiple devices
#147
avi-jain
closed
1 month ago
5
Modularize ensmbles code, fix dimenstion problems with ensemble data structures
#146
rvashurin
closed
9 months ago
0
Set deberta on the same device as LM
#145
cant-access-rediska0123
closed
9 months ago
0
Get the uncertainty scores without rerun the models
#144
caiqizh
closed
9 months ago
4
Update manager.py
#143
cant-access-rediska0123
closed
9 months ago
0
Demo doesn't work.
#142
caiqizh
closed
9 months ago
4
Ensemble configs
#141
rvashurin
closed
9 months ago
0
Calculate ensembles after single-model stuff
#140
rvashurin
closed
9 months ago
1
Move generation_metrics to hydra config
#139
SpeedOfMagic
closed
9 months ago
0
Move dataset preprocessing into separate file
#138
SpeedOfMagic
closed
4 months ago
0
Allow project to be uploaded to pypi
#137
SpeedOfMagic
closed
6 months ago
4
Fix issue for lists as dataset names
#136
rvashurin
closed
9 months ago
0
Use up-to-date experimental configs
#135
rvashurin
closed
9 months ago
0
Add chat templates for models
#134
rvashurin
closed
9 months ago
0
Remove attention from greedy calc
#133
rvashurin
closed
9 months ago
0
Collect garbage after each run
#132
rvashurin
closed
9 months ago
0
Notify if 1 dollar spent in OpenAI
#131
cant-access-rediska0123
closed
9 months ago
0
Previous
Next