search

ePSIC-DLS / Hyperspy_Workshop_2024

Notebooks used during the 2024 Hyperspy Workshop at ePSIC, Diamond Light Source.
GNU General Public License v3.0
7 stars 7 forks source link

Distributing large datesets? #5

Open magnunor opened 6 months ago

magnunor commented 6 months ago

How are we thinking about distributing the large datasets? Putting them in the GitHub repo itself is maybe not the best?

M0hsend commented 6 months ago

Maybe Zenodo? They seem to be OK with up to 50GB per dataset.

M0hsend commented 6 months ago

@magnunor if you want to share link to the data with me, I'd be happy to put it on Zenodo.

magnunor commented 6 months ago

@M0hsend, here is the large datafile. It is a zipped version of a ZSPY file (directory file): https://filesender.sikt.no/?s=download&token=57ce9ab0-fa9a-4317-a64c-5db48d49819f

So the participants have to unzip it first

M0hsend commented 6 months ago

@magnunor Can you give more info on this data: Who created it? Has it been published (can you share DOI, if so)? What is the sample? etc. Would be good to make it better labelled.

magnunor commented 6 months ago

It is a cropped .zspy version of this dataset: https://zenodo.org/records/4727847

M0hsend commented 6 months ago

Zenodo keeps freezing while uploading this file... I have shared for now here