search

hassonlab / 247-pickling

Contains code to create pickles from raw/processed data
1 stars 9 forks source link

Folds in pickling #90

Closed hvgazula closed 1 year ago

hvgazula commented 1 year ago

https://github.com/hassonlab/247-pickling/blob/2fa1ef112ec80af92b5d78b2903daee130fb20ec/scripts/tfspkl_parser.py#L26

What are the challenges with creating folds in pickling instead of encoding? aka, preprocessing and then folds vs folds and then preprocessing.

zkokaja commented 1 year ago

A lot of filtering is happening in 247-encoding that sub selects data before creating folds