pyxem / pyxem-demos

Examples and tutorials of multi-dimensional diffraction microscopy workflows using pyxem.
29 stars 38 forks source link

Reducing Data Size, Adding in Binder Links etc. #72

Closed CSSFrancis closed 1 year ago

CSSFrancis commented 3 years ago

At some point we moved from uploading the necessary datasets for the demos. I really like the idea of making binder links for each of the files and automating building documentation from the demos. Github has pretty strict limits about not uploading a file that is larger than 100 mb but I think that we should think about if we can reduce the size of the example datasets by:

The problem datasets are:

I'll probably just try to go forward with this when I have time. But let me know if anyone has any concerns.

magnunor commented 3 years ago

Good idea! It should be possible to create a dataset which is under 100 MB in Demo 10, and still hit the "learning aims" intended in the notebook. In fact, that is what is (almost) being done already, where it is cropped to reduce the processing times.

I have several magnetic STEM-DPC datasets, and some of them are probably more suited for being "reduced". Feel free to ping me after Wednesday 23., and I'll see if I can make the dataset.

pc494 commented 3 years ago

I think demo 06 should be fine to be rebinned down.

CSSFrancis commented 3 years ago

Okay, I'll start trying to get those working in the next couple of days!

CSSFrancis commented 2 years ago

PR #76 should close this