issues
search
EleutherAI
/
elk
Keeping language models honest by directly eliciting knowledge encoded in their activations.
MIT License
186
stars
33
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Roadmaps of elk
#299
merlinarer
opened
1 month ago
0
Can this code suppot free-form QA task?
#298
Tan-Hexiang
opened
4 months ago
2
pip install from git doesn't work
#297
Butanium
opened
9 months ago
0
Made into a `pytest.fixture`
#296
RohitRathore1
opened
10 months ago
2
Make into a `pytest.fixture` which was a TODO in `test_smoke_eval.py`
#295
RohitRathore1
opened
10 months ago
0
inference server duplication check
#294
AlexTMallen
closed
1 year ago
0
Answer tokenization
#293
AlexTMallen
closed
1 year ago
0
MAJOR UPDATE: Remove CCS, VINC
#292
AlexTMallen
closed
1 year ago
0
Add log softmax to model_logits
#291
norabelrose
closed
1 year ago
0
"None" ensembling for classfication accuracy
#290
derpyplops
closed
1 year ago
1
Add option to save probabilities
#289
AlexTMallen
closed
1 year ago
1
add platt scaling for burns + fix for leace
#288
lauritowal
closed
1 year ago
0
Add `--no_balance` flag to not balance datasets
#287
AlexTMallen
opened
1 year ago
0
Select metric choice for visualization
#286
reaganjlee
opened
1 year ago
0
[Don't merge this] Platt burns
#285
derpyplops
closed
1 year ago
0
fix: remove first layer (embeddings) from layer_indices
#284
lauritowal
closed
1 year ago
0
remove calling self.leace.update twice
#283
lauritowal
closed
1 year ago
0
my fixes for layer ensembling
#282
derpyplops
closed
1 year ago
0
Update README.md
#281
AlexTMallen
closed
1 year ago
0
Fix transfer plot bug
#280
reaganjlee
closed
1 year ago
1
Fix sweep ds config bug
#279
reaganjlee
closed
1 year ago
0
[pre-commit.ci] pre-commit autoupdate
#278
pre-commit-ci[bot]
opened
1 year ago
0
output LM stats for , fix debug logging
#277
AlexTMallen
closed
1 year ago
0
Evaluate LM output performance in `elk eval`
#276
norabelrose
closed
1 year ago
0
Fix bug with non-editable installs
#275
norabelrose
closed
1 year ago
0
remove duplicate normalization
#274
lauritowal
closed
1 year ago
0
ignore embeddings in extraction process
#273
lauritowal
closed
1 year ago
0
[pre-commit.ci] pre-commit autoupdate
#272
pre-commit-ci[bot]
closed
1 year ago
0
train probe per prompt
#271
derpyplops
opened
1 year ago
0
Fix seed not exposed
#270
AugustasMacijauskas
closed
1 year ago
0
[pre-commit.ci] pre-commit autoupdate
#269
pre-commit-ci[bot]
closed
1 year ago
0
Linear Discriminant Analysis MVP
#268
norabelrose
opened
1 year ago
0
Remove check_separability
#267
norabelrose
closed
1 year ago
0
fix argument passthrough for sweep
#266
derpyplops
opened
1 year ago
0
[pre-commit.ci] pre-commit autoupdate
#265
pre-commit-ci[bot]
closed
1 year ago
0
Fixed bug with encoder only models not expecting "labels" argument in forward pass
#264
AugustasMacijauskas
closed
1 year ago
3
Fixes 256 - ValueError mutable default
#263
artkpv
closed
1 year ago
2
Encoder-only models do not expect `labels` argument to be passed to forward
#262
AugustasMacijauskas
closed
1 year ago
2
Use shrinkage for (cross-)covariance estimation
#261
norabelrose
opened
1 year ago
3
[pre-commit.ci] pre-commit autoupdate
#260
pre-commit-ci[bot]
closed
1 year ago
0
Ensembling over layers
#259
lauritowal
opened
1 year ago
1
Add per prompt norm
#258
lauritowal
closed
1 year ago
0
--max_examples seems to be broken
#257
derpyplops
closed
1 year ago
2
Cannot run README command `elk elicit microsoft/deberta-v2-xxlarge-mnli imdb`
#256
rusheb
opened
1 year ago
2
Write smoke test for eval
#255
derpyplops
opened
1 year ago
0
[pre-commit.ci] pre-commit autoupdate
#254
pre-commit-ci[bot]
closed
1 year ago
0
Add git hash in config
#253
derpyplops
closed
1 year ago
0
Use concept-erasure implementation of LEACE and SAL
#252
norabelrose
closed
1 year ago
2
Fix reading datasets with slash
#251
derpyplops
closed
1 year ago
0
Add check for model and dataset existence before running
#250
derpyplops
closed
1 year ago
0
Next