EleutherAI elk issues - Githubissues

EleutherAI / elk

Keeping language models honest by directly eliciting knowledge encoded in their activations.

MIT License

174 stars 32 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

Can this code suppot free-form QA task?

#298 Tan-Hexiang opened 5 days ago
2
pip install from git doesn't work

#297 Butanium opened 5 months ago
0
Made into a `pytest.fixture`

#296 RohitRathore1 opened 5 months ago
2
Make into a `pytest.fixture` which was a TODO in `test_smoke_eval.py`

#295 RohitRathore1 opened 5 months ago
0
inference server duplication check

#294 AlexTMallen closed 8 months ago
0
Answer tokenization

#293 AlexTMallen closed 8 months ago
0
MAJOR UPDATE: Remove CCS, VINC

#292 AlexTMallen closed 8 months ago
0
Add log softmax to model_logits

#291 norabelrose closed 10 months ago
0
"None" ensembling for classfication accuracy

#290 derpyplops closed 10 months ago
1
Add option to save probabilities

#289 AlexTMallen closed 8 months ago
1
add platt scaling for burns + fix for leace

#288 lauritowal closed 10 months ago
0
Add `--no_balance` flag to not balance datasets

#287 AlexTMallen opened 10 months ago
0
Select metric choice for visualization

#286 reaganjlee opened 10 months ago
0
[Don't merge this] Platt burns

#285 derpyplops closed 10 months ago
0
fix: remove first layer (embeddings) from layer_indices

#284 lauritowal closed 11 months ago
0
remove calling self.leace.update twice

#283 lauritowal closed 11 months ago
0
my fixes for layer ensembling

#282 derpyplops closed 11 months ago
0
Update README.md

#281 AlexTMallen closed 11 months ago
0
Fix transfer plot bug

#280 reaganjlee closed 11 months ago
1
Fix sweep ds config bug

#279 reaganjlee closed 11 months ago
0
[pre-commit.ci] pre-commit autoupdate

#278 pre-commit-ci[bot] opened 11 months ago
0
output LM stats for , fix debug logging

#277 AlexTMallen closed 11 months ago
0
Evaluate LM output performance in `elk eval`

#276 norabelrose closed 11 months ago
0
Fix bug with non-editable installs

#275 norabelrose closed 11 months ago
0
remove duplicate normalization

#274 lauritowal closed 11 months ago
0
ignore embeddings in extraction process

#273 lauritowal closed 11 months ago
0
[pre-commit.ci] pre-commit autoupdate

#272 pre-commit-ci[bot] closed 11 months ago
0
train probe per prompt

#271 derpyplops opened 12 months ago
0
Fix seed not exposed

#270 AugustasMacijauskas closed 12 months ago
0
[pre-commit.ci] pre-commit autoupdate

#269 pre-commit-ci[bot] closed 12 months ago
0
Linear Discriminant Analysis MVP

#268 norabelrose opened 12 months ago
0
Remove check_separability

#267 norabelrose closed 1 year ago
0
fix argument passthrough for sweep

#266 derpyplops opened 1 year ago
0
[pre-commit.ci] pre-commit autoupdate

#265 pre-commit-ci[bot] closed 1 year ago
0
Fixed bug with encoder only models not expecting "labels" argument in forward pass

#264 AugustasMacijauskas closed 1 year ago
3
Fixes 256 - ValueError mutable default

#263 artkpv closed 9 months ago
2
Encoder-only models do not expect `labels` argument to be passed to forward

#262 AugustasMacijauskas closed 1 year ago
2
Use shrinkage for (cross-)covariance estimation

#261 norabelrose opened 1 year ago
3
[pre-commit.ci] pre-commit autoupdate

#260 pre-commit-ci[bot] closed 1 year ago
0
Ensembling over layers

#259 lauritowal opened 1 year ago
1
Add per prompt norm

#258 lauritowal closed 11 months ago
0
--max_examples seems to be broken

#257 derpyplops closed 1 year ago
2
Cannot run README command `elk elicit microsoft/deberta-v2-xxlarge-mnli imdb`

#256 rusheb opened 1 year ago
1
Write smoke test for eval

#255 derpyplops opened 1 year ago
0
[pre-commit.ci] pre-commit autoupdate

#254 pre-commit-ci[bot] closed 1 year ago
0
Add git hash in config

#253 derpyplops closed 11 months ago
0
Use concept-erasure implementation of LEACE and SAL

#252 norabelrose closed 1 year ago
2
Fix reading datasets with slash

#251 derpyplops closed 1 year ago
0
Add check for model and dataset existence before running

#250 derpyplops closed 1 year ago
0
[pre-commit.ci] pre-commit autoupdate

#249 pre-commit-ci[bot] closed 1 year ago
0