Do full workflow with gcaer

[richelbilderbeek]

Depends on:

• [x] #13
• [x] #15
• [x] #7
• For now: ignore: [ ] #10

Needed due to GenoCAE not storing the neural network in in-between places of the run

[richelbilderbeek]

Also need to write a script before closing this.

[richelbilderbeek]

[richel@rackham2 ~]$ cat 20_start_issue_18.log 
Starting time: 2022-04-08T10:41:07+0200
Running on computer with HOSTNAME: r44
Running at location /home/richel
gcae_experiment_params_filename: /home/richel/sim_data_issue_18/experiment_params.csv
unique_id: issue_18
sbatch: error: Invalid directive found in batch script: defined
End time: 2022-04-08T10:41:07+0200
Duration: 0 seconds
[richel@rackham2 ~]$ 

[richelbilderbeek]

Can do the full workflow, except for created-on-the-fly models

[richelbilderbeek]

Running!

[richel@rackham2 ~]$ ./nsphs_ml_qt/scripts_rackham/20_start_issue_18.sh 
Starting time: 2022-04-08T11:27:36+0200
Running on computer with HOSTNAME: rackham2.uppmax.uu.se
Running at location /home/richel
gcae_experiment_params_filename: /home/richel/sim_data_issue_18/experiment_params.csv
unique_id: issue_18
jobid_21: 25760509
jobid_22: 25760510
jobid_25: 25760511
End time: 2022-04-08T11:27:36+0200
Duration: 0 seconds
[richel@rackham2 ~]$ q
             JOBID PARTITION     NAME     USER ST       TIME  NODES NODELIST(REASON)
          25760509      core 21_creat   richel PD       0:00      1 (None)
          25760510      core 22_creat   richel PD       0:00      1 (None)
          25760511      core 25_run.s   richel PD       0:00      1 (Dependency)
[richel@rackham2 ~]$ q

[richelbilderbeek]

[richel@rackham2 ~]$ ./nsphs_ml_qt/scripts_rackham/20_start_issue_18.sh 
Starting time: 2022-04-08T16:03:55+0200
Running on computer with HOSTNAME: rackham2.uppmax.uu.se
Running at location /home/richel
gcae_experiment_params_filename: /home/richel/sim_data_issue_18/experiment_params.csv
unique_id: issue_18
jobid_21: 25765778
jobid_22: 25765779
jobid_25: 25765780
jobid_29: 25765781
End time: 2022-04-08T16:03:55+0200
Duration: 0 seconds
[richel@rackham2 ~]$ ./nsphs_ml_qt/scripts_bianca/91_poll.sh 
             JOBID PARTITION     NAME     USER ST       TIME  NODES NODELIST(REASON)
          25765778      core 21_creat   richel PD       0:00      1 (None)
          25765779      core 22_creat   richel PD       0:00      1 (Dependency)
          25765780      core 25_run.s   richel PD       0:00      1 (Dependency)
          25765781      core 29_zip.s   richel PD       0:00      1 (Dependency)

[richelbilderbeek]

This seems to have worked on Rackham:

[richelbilderbeek]

Fails at zipping:

richel@N141CU:~/Downloads$ unzip issue_18.zip 
Archive:  issue_18.zip
warning [issue_18.zip]:  zipfile is empty

[richelbilderbeek]

Done at the end of #5.