search

hassonlab / 247-pickling

Contains code to create pickles from raw/processed data
1 stars 9 forks source link

Release 0.1 #80

Closed zkokaja closed 1 year ago

zkokaja commented 1 year ago

PR into dev0.1 branch

  1. new conda/pip environment (upgrade python version, etc.)
  2. split base labels from embeddings into separate pickles, instead of coupled.
  3. electrode/signal extraction for 625/676 vs 717 (nans based on convs) #46
  4. embeddings for LLMs (OPT, GPT-NEOX) <= 6.7B
  5. pickle output folder structure changes

Address following issues:

hvgazula commented 1 year ago

All done and in https://github.com/hassonlab/247-pickling/tree/dev_branch

zaidzada commented 1 year ago

This also includes changes that will extract all electrodes, padding a signal, in_model columns moved to a different script.

zkokaja commented 1 year ago

@hvgazula Remove line 21 from tfsemb_LMBase and then we can merge!