search

peng-lab / BaSiCPy

MIT License
66 stars 22 forks source link

Test data migration #8

Closed yfukai closed 2 years ago

yfukai commented 2 years ago

We would like to migrate large test data out of the repository. There're two things to decide:

yfukai commented 2 years ago

where to put the data

we decided to create a Zenodo dataset and retrieve by DOI.

yfukai commented 2 years ago

deleting existing large data from repo

BFG cleaner https://rtyley.github.io/bfg-repo-cleaner/ https://docs.github.com/en/enterprise-server@3.0/authentication/keeping-your-account-and-data-secure/removing-sensitive-data-from-a-repository Will rewrite the history, but may be safe at this point.

tdmorello commented 2 years ago

Whenever we get a chance, we should register for a zenodo account. It should probably be @tying84 's

yfukai commented 2 years ago

Thanks @tdmorello for your comment! My Zenodo account is yfukai just in case.

yfukai commented 2 years ago

Zenodo dataset is already created: https://doi.org/10.5281/zenodo.6334810 The remaining task is to clean up the data in the current repo.