search

language-brainscore / langbrainscore

[Marked for Deprecation. please visit https://github.com/brain-score/language for the migrated project] Benchmarking of Language Models using Human Neural and Behavioral experiment data
https://language-brainscore.github.io/langbrainscore/
MIT License
4 stars 1 forks source link

implement model card feature #25

Open gretatuckute opened 2 years ago

gretatuckute commented 2 years ago

given an ANN / layer, quantify those activations --> understand WHY certain models/layers are good

aalok-sathe commented 2 years ago

is this related to our brief thought about say, paragraph semantics, stimulus features etc affecting brainscore? how do we do this in an automated way?

gretatuckute commented 2 years ago

initial motivation was due to the bigger question of "why are certain models good and how do we easily quantify that" but it is true that one needs to come up with a stimulus set that is somewhat representative so quantify layer / model properties