[FEATURE REQUEST] Bulk Enqueue Tasks

hibiken / asynq

Simple, reliable, and efficient distributed task queue in Go

MIT License

10.11k stars 722 forks source link

Open FaBeyyy opened 1 year ago

FaBeyyy commented 1 year ago

Is your feature request related to a problem? Please describe. Enqueueing millions of tasks can be slow and annoying.

Describe the solution you'd like Enqueueing multiple tasks should be possible in a single function call

kamikazechaser commented 1 year ago

Related to #535

Are you using client.Enqueue? Because this is expected to be slow when attempting to add millions of keys because of network round trips.

This could be solved with pipelines.