Implement the mini daemon (phase 1)

peremunoz / metascheduler

A job-metascheduler developed in Python. Used to manage workflows in a hybrid cluster ecosystem, with Hadoop and SGE as cluster frameworks, and Kubernetes as deployment orchestrator.

0 stars 0 forks source link

Implement the mini daemon (phase 1) #7

Closed peremunoz closed 1 month ago

peremunoz commented 2 months ago

The mini daemon will be responsible for monitoring the jobs table, and depending on the cluster execution mode, and all the cluster queue statuses, send a specific job to a specific queue.

peremunoz commented 1 month ago

[x] Implement metascheduler queue reading.
[x] Implement Hadoop queue reading? (no job queue so I assume no need, only track if there is any job running)
[x] Implement SGE queue reading.