richelbilderbeek / pirouette_article

Article about pirouette, by Bilderbeek, Laudanno and Etienne
GNU General Public License v3.0
0 stars 0 forks source link

[RUNNING] 28: Run a distribution of DD trees with same DD settings as exemplary one #89

Closed richelbilderbeek closed 4 years ago

richelbilderbeek commented 4 years ago

This Issue is a bit of a missing link: we already have:

The Issue that was missing (this Issue!) is doing a pir_run with multiple DD trees.

There is already a script to run one or multiple DD trees: https://github.com/richelbilderbeek/pirouette_example_28, but it does not match the settings used to create a single DD tree, as done is done by #75.

TLDR: Change https://github.com/richelbilderbeek/pirouette_example_28 to follow the same DD settings as https://github.com/richelbilderbeek/pirouette_example_30

richelbilderbeek commented 4 years ago

Use the same DD settings, started run:

p230198@peregrine:pirouette_example_28 sbatch scripts/rerun.sh 
Submitted batch job 9592512
richelbilderbeek commented 4 years ago

Run failed, due to plotting on Peregrine.

Removed plotting and try again:

p230198@peregrine:pirouette_example_28 sbatch scripts/rerun.sh 
Submitted batch job 9593530
richelbilderbeek commented 4 years ago
p230198@peregrine:pirouette_example_28 cat slurm-9593530.out 
[1] "1 / 5"
[1] "2 / 5"
[1] "3 / 5"
[1] "4 / 5"
[1] "5 / 5"
[1] "1 / 5"
Registered S3 method overwritten by 'pryr':
  method      from
  print.bytes Rcpp
[1] "2 / 5"
[1] "3 / 5"
[1] "4 / 5"
[1] "5 / 5"
slurmstepd: error: *** JOB 9593530 ON pg-node006 CANCELLED AT 2020-02-17T12:13:07 DUE TO TIME LIMIT ***

###############################################################################
Peregrine Cluster
Job 9593530 for user 'p230198'
Finished at: Mon Feb 17 12:13:09 CET 2020

Job details:
============

Name                : rerun.sh
User                : p230198
Partition           : regular
Nodes               : pg-node006
Cores               : 1
State               : CANCELLED,TIMEOUT
Submit              : 2020-02-17T11:42:11
Start               : 2020-02-17T11:42:38
End                 : 2020-02-17T12:13:08
Reserved walltime   : 00:30:00
Used walltime       : 00:30:30
Used CPU time       : 00:28:56 (efficiency: 94.86%)
% User (Computation): 97.46%
% System (I/O)      :  2.54%
Mem reserved        : 2000M/core
Max Mem used        : 913.37M (pg-node006)
Max Disk Write      : 0.00  (pg-node006)
Max Disk Read       : 51.20K (pg-node006)
richelbilderbeek commented 4 years ago

Set max time to 24 hours.

p230198@peregrine:pirouette_example_28 sbatch scripts/rerun.sh 
Submitted batch job 9594109
richelbilderbeek commented 4 years ago

Done!

errors

These are 5 RNG seeds per setting.

richelbilderbeek commented 4 years ago

Script needs a rewrite, so I'll open up this Issue again

richelbilderbeek commented 4 years ago

Doing a fresh run now :+1:

richelbilderbeek commented 4 years ago

I close this Issue. I use paper now instead :+1: