Outsource aamks.py to workers

aamks / aamks

Probabilistic fire risk assessment framework

https://aamks.apoz.edu.pl/aamks

GNU General Public License v3.0

16 stars 6 forks source link

Outsource aamks.py to workers #326

Open kowalskiw opened 1 month ago

kowalskiw commented 1 month ago

To improve performance and utilize embarrassingly parallel nature of Monte Carlo simulations we should perform all tasks we can on compute nodes, rather than on server.

This task would require:

major changes in aamks.py;
passing iteration id (sim_id) to manager.OnInit and manager.OnEnd and other methods;
change of logger to iteration-located;
creating mirrors of aamks.sqlite in iteration directory;
...

This task is a natural part of #305.

kowalskiw commented 2 weeks ago

@mmackiewicz97 - could you introduce this feature to redis workers?

kowalskiw commented 1 week ago

Within this issue we should ensure inheritance of proper aamks.sqlite include.Sqlite with necessary (only) objects (i.e. include.Json.s).