Run persisters in parallel

HubSpot / Singularity

Scheduler (HTTP API and webapp) for running Mesos tasks—long running processes, one-off tasks, and scheduled jobs. #hubspot-open-source

http://getsingularity.com/

Apache License 2.0

823 stars 188 forks source link

Run persisters in parallel #2270

Closed ssalinas closed 2 years ago

ssalinas commented 2 years ago

This allows parallel execution of persister tasks within a type of persister (e.g. 5 parallel executions for the tsak history persister). The number of these is configurable as historyPollerConcurrency

rosalind210 commented 2 years ago

🚢

tcampbell commented 2 years ago

Hey @rosalind210, it looks like you Commented instead of Approved this PR. No big deal here, but in the future, please ensure that your :thumbsup: is reflected as an approval.

Otherwise an audit is triggered by our compliance safeguards.

ssalinas commented 2 years ago

@tcampbell the approval flow as far as I knew doesn't work for the open source projects. In the past they were only hooked up for a direct comment/ 🚢 . If that has changed we can change our workflow

tcampbell commented 2 years ago

You're right, my bad. sorry about that. Please ignore.