for LMs: add rank of true word in each prediction

hassonlab / 247-pickling

Contains code to create pickles from raw/processed data

1 stars 10 forks source link

for LMs: add rank of true word in each prediction #79

Closed zkokaja closed 2 years ago

zkokaja commented 2 years ago

we should add the rank of true word as part of process_extracted_logits functionality so we can easily classify correct/incorrect words based on arbitrary k.

hvgazula commented 2 years ago

duplicate https://github.com/hassonlab/247-pickling/issues/56