using RQ to parallelise jobs

matteocao commented 2 years ago

Reference issues/PRs

fixing #95. Improving the parallelisation functionalities over the K8 cluster. automatising deployments

Types of changes

[ ] Bug fix (non-breaking change which fixes an issue)
[X] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to change)

Description

The goal of this feature is, for the users that have access to a K8 cluster, to deploy a whole computational cluster in one click and that would allow to distribute HPO computations Screenshots (if appropriate)

Any other comments?

Checklist

[X] I have read the guidelines for contributing.
[X] My code follows the code style of this project. I used flake8 to check my Python changes.
[X] My change requires a change to the documentation.
[X] I have updated the documentation accordingly.
[X] I have added tests to cover my changes.
[X] All new and existing tests passed. I used pytest to check this on Python tests.

review-notebook-app[bot] commented 2 years ago

Check out this pull request on

See visual diffs & provide feedback on Jupyter Notebooks.

Powered by ReviewNB

CLAassistant commented 2 years ago

All committers have signed the CLA.

giotto-ai / giotto-deep

using RQ to parallelise jobs #94