search

carpentries-incubator / cwl-novice-tutorial

Introduction to Workflows with Common Workflow Language
https://carpentries-incubator.github.io/cwl-novice-tutorial/
Other
11 stars 20 forks source link

use a smaller dataset #88

Closed mr-c closed 2 years ago

mr-c commented 2 years ago

Fixes #51 Builds upon @douglowe 's work in https://github.com/douglowe/cwl-tutorial-material-prototype

netlify[bot] commented 2 years ago

Add Deploy Preview notifications as pull request comments when Deploy Preview succeeds

Name Link
Latest commit 4d00bb56cdb1e84e4881548124f77ed278c0c137
Latest deploy log https://app.netlify.com/sites/thirsty-hoover-1e0704/deploys/623c60e208e1c80009fd8c29
Deploy Preview https://deploy-preview-88--thirsty-hoover-1e0704.netlify.app
Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify site settings.

mr-c commented 2 years ago

Ah, this means we will have to re-make the graphs that @aluesink made :-/

douglowe commented 2 years ago

I'm trying the new setup out now.

The final build step in the setup page is still taking a long time (8 minutes, and counting). 3Gb is getting closer to a reasonable size for direct download - do you have a download link for this anywhere?

Otherwise, it might be we have to specify that setup is done before the teaching session - perhaps as an organised 1 hour setup session a day or two beforehand?

mr-c commented 2 years ago

The final build step in the setup page is still taking a long time (8 minutes, and counting)

To speed it up, I personally edited the CWL description to specify coresMin: 4 (the number of real CPUs in my laptop) under ResourceRequirement

3Gb is getting closer to a reasonable size for direct download - do you have a download link for this anywhere?

I can upload this somewhere, yes. Do you have a recommend location?

mr-c commented 2 years ago

Otherwise, it might be we have to specify that setup is done before the teaching session - perhaps as an organised 1 hour setup session a day or two beforehand?

Could be; I might merge this now as the VU Amsterdam class is supposed to start in a number of minutes

douglowe commented 2 years ago

The final build step in the setup page is still taking a long time (8 minutes, and counting)

To speed it up, I personally edited the CWL description to specify coresMin: 4 (the number of real CPUs in my laptop) under ResourceRequirement

Ahh, my laptop has only 2 cores - I could try specifying 2 cores, that might help a little (though I'm at 25 minutes and still counting). Also, I've limited docker to 6Gb RAM, which might be slowing things down too.

3Gb is getting closer to a reasonable size for direct download - do you have a download link for this anywhere?

I can upload this somewhere, yes. Do you have a recommend location?

Perhaps upload to Zenodo? That might be easiest (and free). Or UoM does have a deal with figshare for longterm storage - so I could upload there?

douglowe commented 2 years ago

Otherwise, it might be we have to specify that setup is done before the teaching session - perhaps as an organised 1 hour setup session a day or two beforehand?

Could be; I might merge this now as the VU Amsterdam class is supposed to start in a number of minutes

Yes - good plan.

Good luck with the class!