search

oban-bg / oban

💎 Robust job processing in Elixir, backed by modern PostgreSQL and SQLite3
https://oban.pro
Apache License 2.0
3.34k stars 312 forks source link

How can be oban used together with GridEngine #465

Closed zhangzhen closed 3 years ago

zhangzhen commented 3 years ago

I develop bioinformatics pipelines as my job. Sun GridEngine(SGE) is used to dispatch computation intensive jobs of a pipeline to a cluster of compute nodes. Currently, I am trying to build a mini-tool that is able to detect dna sequencing is done, demultiplex sequencing data, launch an analytical pipeline, and generate a report. All these are associated with background job processing, so I want to use oban as the building block.

I hope oban is able to handle submitting a job via qsub as a kind of background job processing, and poll SGE to determine if a job is completed.

sorentwo commented 3 years ago

The issue tracker is reserved for bug reports and feature discussions. Please ask for help or suggestions on the Elixir Forum or in the #oban channel on the Elixir Slack.