search

opt-elixir / faktory_worker

Elixir Faktory worker https://hexdocs.pm/faktory_worker
MIT License
38 stars 12 forks source link

Broadway buffer config #30

Closed swelham closed 5 years ago

swelham commented 5 years ago

Currently the Broadway producer has a buffer limit of 10k messages per producer which comes from the defaults set in GenStage.

Lets update this to default to :infinity so faktory worker's default is to never discard jobs when pushing to faktory. This should also be overridable at the faktory worker level under the pool settings.

Might be worth a read of these docs about genstage buffering https://hexdocs.pm/gen_stage/GenStage.html#module-buffering.

john-griffin commented 5 years ago

Done in #45