refactor: replace machinery with tasqueue

zerodha / dungbeetle

A distributed job server built specifically for queuing and executing heavy SQL read jobs asynchronously. Separate out reporting layer from apps. MySQL, Postgres, ClickHouse.

MIT License

541 stars 77 forks source link

refactor: replace machinery with tasqueue #30

Closed kalbhor closed 1 year ago

kalbhor commented 1 year ago

This MR replaces the underlying job server (machinery) with tasqueue. API wise there are no changes and clients will not face any difference.

Misc:

Added testcase TestDeleteGroup
Due to the nature of Tasqueue, the concurrency is set during task registration. Hence, it is difficult to accommodate a different worker count for groups.

knadh commented 1 year ago

Closing this for the new incoming PR against the refactor branch.