Closed MoiraZuber closed 2 years ago
This pull request is being automatically deployed with Vercel (learn more).
To see the status of your deployment, click below or on the icon next to each commit.
🔍 Inspect: https://vercel.com/hodcroftlab/covariants/8HXzhETL6vFEh2DSCi9pMXjFaTJW
✅ Preview: https://covariants-git-selectmetadatacolumns-hodcroftlab.vercel.app
I've run this on scicore and it runs without errors, so we're capturing all columns. Will merge in!
Implement pandas read_csv parameter
usecols
to only read selected columns from metadata in order to speed up the script and reduce memory usage.TODO:
dtype
is provided for columns that are apparently not used throughout the script?)