CellProfiler / tutorials

CellProfiler tutorial pipelines and images
https://tutorials.cellprofiler.org/
BSD 3-Clause "New" or "Revised" License
83 stars 86 forks source link

Speed up build by excluding most directories #40

Closed bethac07 closed 2 years ago

bethac07 commented 2 years ago

Jekyll allows you to add excluded folders (and to allow included individual files in those folders). Right now, build takes ~20+ minutes, and most of it is analyzing and tarballing the whole repo, which we don't need most of for the little webpage. We should be able to take that way down.

rsenft1 commented 2 years ago

Yes this dramatically improved build speed!

image

I experimented with just blanket excluding all with wildcard then including specific folders, but it complained no matter what I tried for selecting all folders (*/, /, **). So right now I'm explicitly excluding each folder.

bethac07 commented 2 years ago

(I looked at the commits, I'm not sure if blanket-excluding all things but then specifying that you definitely weren't excluding the config and the README would have fixed it. But since we don't add new tutorials super regularly, it seems like this is a perfectly fine solution, we may just want to add a "edit the config" section to the "adding a new tutorial" documentation

rsenft1 commented 2 years ago

Yes I tried excluding all folders, then the last commit excluded "everything" with ** but explicitly included the config and readme. The error was always about that line having an unknown character on that line in the _config.yml: did not find expected alphabetic or numeric character while scanning an alias at line 21 column 3. I'm unsure if excluding that way is allowed or if I just have the syntax wrong. Here is what I was working from (that and how it works for .gitignore files), though I haven't found any documentation about how to exclude everything

bethac07 commented 2 years ago

Ah, sorry, missed that one. Line 21 though was your exclude line though, so it seems like it was mad with your exclude rather than your include.

image
bethac07 commented 2 years ago

You might need to put that in quotes - see examples here

rsenft1 commented 2 years ago

Yes it's the exclude that I'm unsure of how to do, the include works fine. Thanks, I'll try out the quotes!