[WIP] Distributed Scheduler

ratt-ru / QuartiCal

CubiCal, but with greater power.

MIT License

8 stars 4 forks source link

[WIP] Distributed Scheduler #47

Closed sjperkins closed 3 years ago

sjperkins commented 3 years ago

This is still in a somewhat hacky form, but I thought I'd push it up for discussion on what the final version might look like.

One option that occurs is that if parallel address == 'local' then the LocalCluster and associated options could be reinstated.

JSKenyon commented 3 years ago

That seems sensible. In general, we want to support the following in a relatively transparent and interoperable way:

Single-threaded scheduling for debugging.
Threaded scheduling for minimum overhead use at small to mid-scale.
LocalCluster for testing/debugging distributed problems at a reasonable scale.
Client IP for cluster use.

sjperkins commented 3 years ago

https://github.community/t/expected-waiting-for-status-to-be-reported/16727/2 suggests the following for CI status checks:

Hi, Please remove the invalid/outdated status check in the protected branch setting of the repository settings. It’s similar to below ticket which is resolved, thanks. https://github.community/t5/GitHub-Actions/GitHub-Actions-Pull-requests-always-include-some-outdated-checks/td-p/30030

JSKenyon commented 3 years ago

I am happy with this, at least for now - if we elect to extend it later, that is fine. Can I go ahead and merge @sjperkins?

sjperkins commented 3 years ago

Fine by me