issues
search
language-brainscore
/
langbrainscore
[Marked for Deprecation. please visit https://github.com/brain-score/language for the migrated project] Benchmarking of Language Models using Human Neural and Behavioral experiment data
https://language-brainscore.github.io/langbrainscore/
MIT License
4
stars
1
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
update main in hopes that docs will update
#38
aalok-sathe
closed
2 years ago
0
Parallelize Mapping `fit_transform` using joblib?
#37
aalok-sathe
opened
2 years ago
0
MWE of CLI is in place
#36
aalok-sathe
closed
2 years ago
1
bug when loading dataset from cache.
#35
benlipkin
opened
2 years ago
3
MWE of caching EncoderRepresentations in `encode()`
#34
aalok-sathe
closed
2 years ago
1
write test cases for ANN encoder
#33
gretatuckute
opened
2 years ago
0
Feature tokenizer based span extraction 1
#32
aalok-sathe
closed
2 years ago
2
We cannot rely on out-of-context tokenization to calculate tokenized offset lengths
#31
aalok-sathe
closed
2 years ago
1
come up with 'base' sentence material set for model card
#30
gretatuckute
opened
2 years ago
0
add memory profiling as well (similar to #26), cf. https://github.com/bloomberg/memray
#29
aalok-sathe
opened
2 years ago
1
implement zarr-based caching for major classes
#28
aalok-sathe
opened
2 years ago
2
support other models than from HuggingFace
#27
gretatuckute
opened
2 years ago
0
add code time profiling to understand execution bottlenecks
#26
aalok-sathe
opened
2 years ago
0
implement model card feature
#25
gretatuckute
opened
2 years ago
2
preprocessing of ann encoder embeddings
#24
gretatuckute
closed
2 years ago
1
add flag to compute brainscore grouped by some neuroid coordinate or some sample coordinate, e.g., in RSA/CKA IdentityMaps
#23
aalok-sathe
opened
2 years ago
0
Use GPU when available
#22
aalok-sathe
closed
2 years ago
0
Implement finite-size caching of ANN encoder outputs
#21
aalok-sathe
closed
2 years ago
1
figure out storage format
#20
gretatuckute
closed
2 years ago
2
fix case of special tokens in encoder
#19
benlipkin
closed
2 years ago
2
develop automated packaging script from input table and list of columns
#18
benlipkin
opened
2 years ago
1
deal with caching ANN encoder representations
#17
gretatuckute
opened
2 years ago
0
write class for checking embeddings
#16
gretatuckute
opened
2 years ago
0
add functionality to compute importance measures for predictor variables
#15
benlipkin
opened
2 years ago
0
add functionality for null permutations
#14
benlipkin
opened
2 years ago
0
build out "ceiling" calculation module
#13
benlipkin
opened
2 years ago
0
add argument to chunk brain-encoded data on subject or other neuroid dimension.
#12
benlipkin
opened
2 years ago
0
repackage metadata with brainscore xarray object
#11
benlipkin
closed
2 years ago
0
finish end-to-end implementation of IdentityMap+RSA
#10
aalok-sathe
closed
2 years ago
0
revisit mapping splits and sklearn prediction
#9
aalok-sathe
closed
2 years ago
0
Currently, Bidirectional encoding makes it impossible to extract repr of a specific stimulus
#8
aalok-sathe
closed
2 years ago
0
merge updates from main (incl. new package additions) to trigger CI build
#7
aalok-sathe
closed
2 years ago
0
test
#6
aalok-sathe
closed
2 years ago
0
create function for adding stimset to bsc object
#5
gretatuckute
closed
2 years ago
0
create a CV mapping function that allows for across-subject train/test
#4
gretatuckute
opened
2 years ago
0
add possibility of fitting on mean of e.g., ROI/network coordinate
#3
gretatuckute
opened
2 years ago
0
Data loss due to dropping my NaNs. Please fix
#2
aalok-sathe
closed
2 years ago
2
add correct pkg names for deb
#1
aalok-sathe
closed
2 years ago
0