building the website takes too long

robertoostenveld commented 7 months ago

The web hook that is triggered upon a merge of a commit on github is executed on the DCCN HPC cluster. It is scheduled for max 20 minutes execution, but since recently it seems to take longer. Consequently the job is killed before it is finished.

PBS Job Id: [51347122.dccn-l029.dccn.nl](http://51347122.dccn-l029.dccn.nl/)
Job Name:   website.sh
Exec host:  [dccn-c364.dccn.nl/1](http://dccn-c364.dccn.nl/1)
Aborted by PBS Server
Job exceeded its walltime limit. Job was aborted
See Administrator for help
Exit_status=-11
resources_used.cput=00:00:18
resources_used.vmem=996780kb
resources_used.walltime=00:20:22
resources_used.mem=7836kb
resources_used.energy_used=0
req_information.task_count.0=1
req_information.lprocs.0=1
req_information.total_memory.0=204800kb
req_information.memory.0=204800kb
req_information.thread_usage_policy.0=allowthreads
req_information.hostlist.0=[dccn-c364.dccn.nl](http://dccn-c364.dccn.nl/):ppn=1
req_information.task_usage.0.task.0={"task":{"cpu_list":"1","mem_list":"0","cores":0,"threads":1,"host":"[dccn-c364.dccn.nl](http://dccn-c364.dccn.nl/)"}}
Error_Path: [mentat001.dccn.nl](http://mentat001.dccn.nl/):/home/megmethods/roboos/.webhook/3a0593ad-50b4-48ad-bdea-238f1c527723/website.sh.e51347122
Output_Path: [mentat001.dccn.nl](http://mentat001.dccn.nl/):/home/megmethods/roboos/.webhook/3a0593ad-50b4-48ad-bdea-238f1c527723/website.sh.o51347122

On my local computer it also takes very long

ip-213-122> bundle exec jekyll serve --incremental --livereload
Configuration file: /Users/roboos/Sites/fieldtrip-website/_config.yml
            Source: /Users/roboos/Sites/fieldtrip-website
       Destination: /Users/roboos/Sites/fieldtrip-website/_site
 Incremental build: enabled
      Generating... 
                    done in 2290.094 seconds.
 Auto-regeneration: enabled for '/Users/roboos/Sites/fieldtrip-website'
LiveReload address: http://127.0.0.1:35729
    Server address: http://127.0.0.1:4000//
  Server running... press ctrl-c to stop.

This should be addressed...

robertoostenveld commented 7 months ago

It seems to have started on 22 Feb, or at least that is the first time that I can find the problem back.

I wonder whether it has to do with https://github.com/fieldtrip/website/commit/3d19af4fc66c60c67427500f995cb2f8a6850ffb, as that commit affected the formatting of a lot of pages.

robertoostenveld commented 7 months ago

I tried various things with the tags and seealso includes, but nothing really seemed to help. Then I figured to try and update jekyll and its plugins.

I updated jekyll from 3.8.6 to 4.3.3 and that made it much faster: build times went down from ~2000 seconds to ~90 seconds.

robertoostenveld commented 7 months ago

the automated build also seem to work

fieldtrip / website

building the website takes too long #772