CONABIO / antares3

Madmex with open data cube and in python3
2 stars 2 forks source link

Prepare metadata. Use scheduler instead of multiproc #33

Closed palmoreck closed 5 years ago

palmoreck commented 6 years ago

When using multiproc with a distribute cluster there are some warnings using prepare_metadata command. See line:

https://github.com/CONABIO/antares3/blob/develop/madmex/management/commands/prepare_metadata.py#L132

Warnings are related to ... Port 8787 is already in use (because it's bokeh port) and when command finishes there are also some messages... On a production environment with a distribute cluster it's better to avoid this type of warnings

Create a flag on this command to execute it in a distribute fashion when having a distributed cluster. Read scheduler.json instead of multiproc flag