search

GeoscienceAustralia / eqrm

Automatically exported from code.google.com/p/eqrm
Other
5 stars 4 forks source link

Problem plotting in parallel? #110

Closed GoogleCodeExporter closed 9 years ago

GoogleCodeExporter commented 9 years ago 

Can confirm that the scenario run on a single node plots fine. This is true 
whether we use the queing system or not.
Please see /short/w84/sandpits/vmiller/eqrm_oq_compare/simulations/PNG/simTest 
- working.
When run on a single node it took ~2.5 hours.

However a scenario simulation run in parallel does not plot correctly, see 
error below.
/short/w84/sandpits/vmiller/eqrm_oq_compare/simulations/PNG/sim5
When you run in parallel it takes only 3 minutes. You could always make this 
faster by changing the parameter us_site_indexes.

Traceback (most recent call last):
  File "plot_histogram.py", line 39, in <module>
    show_graph=False)
  File "/short/w84/sandpits/vmiller/eqrm/eqrm_code/plotting/plot_api.py", line 1224, in fig_scenario_building_loss_percent
    _, _) = om.load_ecloss_and_sites(input_dir, site_tag)
  File "/short/w84/sandpits/vmiller/eqrm/eqrm_code/output_manager.py", line 310, in load_ecloss_and_sites
    assert allclose(array(struct_dic['BID']), BID)
AssertionError

Does this suggest that the EQRM is not assembling scenario results correctly in 
a parallel run.

David sais that to his knowledge noone has ever tried running a scenario 
simulation in parallel before.

Victoria

Original issue reported on code.google.com by duncan.g...@gmail.com on 18 Jan 2013 at 4:34

GoogleCodeExporter commented 9 years ago 
I can reproduce at NCI, using the data data from Victoria's simulation.  I 
could not reproduce it on rhe-compute, using a smaller number of events, same # 
of sites.

Original comment by duncan.g...@gmail.com on 18 Jan 2013 at 5:20

GoogleCodeExporter commented 9 years ago 
On rhe-compute
mpirun -np 34 python ScenLoss_controlfile.py
p plot_histogram.py
This worked.  I didn't scale anything back.

Original comment by duncan.g...@gmail.com on 20 Jan 2013 at 11:35

GoogleCodeExporter commented 9 years ago 
Worked for me on vayu as well.

I can't reproduce this, so I'm closing the ticket.

Original comment by duncan.g...@gmail.com on 21 Jan 2013 at 1:48