geopython / pywps

PyWPS is an implementation of the Web Processing Service standard from the Open Geospatial Consortium. PyWPS is written in Python.
https://pywps.org
MIT License
178 stars 117 forks source link

updated scheduler extension #482

Closed cehbrecht closed 5 years ago

cehbrecht commented 5 years ago

Overview

This PR updates the scheduler extension. It replaces dill by a json dump/load to transfer the job status to the scheduler working nodes.

It has been tested with slurm. See the updated scheduler docker demo: https://github.com/bird-house/birdhouse-docker-images/tree/master/pywps-scheduler-demo

Related Issue / Discussion

Additional Information

Contribution Agreement

(as per https://github.com/geopython/pywps/blob/master/CONTRIBUTING.rst#contributions-and-licensing)

cehbrecht commented 5 years ago

@tommygod3 maybe you like to try it on your side. There are probably still issues which we can fix in this PR.

coveralls commented 5 years ago

Coverage Status

Coverage increased (+0.6%) to 75.054% when pulling 3ddf237884d9d750e597bd5def7d3fd561f26b6a on cehbrecht:update-scheduler into e9b939aa1992c99cc151c86efed08b890096225a on geopython:master.

tommygod3 commented 5 years ago

@cehbrecht Will have a look

tommygod3 commented 5 years ago

@cehbrecht Tested on SLURM and it works :)

cehbrecht commented 5 years ago

@tommygod3 cool :) Thanks for trying it :)

tommygod3 commented 5 years ago

Think it is safe to say this would close #480

cehbrecht commented 5 years ago

@tommygod3 done.