language-brainscore / langbrainscore

[Marked for Deprecation. please visit https://github.com/brain-score/language for the migrated project] Benchmarking of Language Models using Human Neural and Behavioral experiment data
https://language-brainscore.github.io/langbrainscore/
MIT License
4 stars 1 forks source link

add functionality to compute importance measures for predictor variables #15

Open benlipkin opened 2 years ago

benlipkin commented 2 years ago

add functionality to drop (or permute) single X dimensions to evaluate their relative contribution to downstream performance R^2? or final metric? (note: can look into Shapley Values)