-
I am using `GenStage` to create data processing pipeline.
With a single consumer `PageConsumer` it works fine, but not with multiple processes for the same consumer module `PageConsumer`, instead it …
smahi updated
3 years ago
-
With nostrum `0.5.0-rc1`:
```elixir
21:42:03.931 [error] GenServer Nostrum.Shard.Stage.Cache terminating
** (UndefinedFunctionError) fu…
-
When the `BroadwayKafka.Producer` receives new assignments from from the [:brod_group_coordinator](https://hexdocs.pm/brod/brod_group_coordinator.html#start_link-6) the offset reset policy isn't appli…
-
I have a legacy application that uses `GenStage` for processing messages from an SQS queue.
The processing takes a variable amount of time so I have implemented some sort of registry that handles the…
-
There is one statement in Subscriber's `init/1` function:
```elixir
# We always subscribe in random order so the load is balanced across consumers.
names |> Enum.shuffle() |> Enum.each(&s…
-
I'm using the `:stream_to` parameter to stream data from a HTTP endpoint.
The endpoint streams forever, which means that i cannot wait for an `%HTTPoison.AsyncEnd{}` message.
Is there a way to close …
-
Hi @TurtleAI/eds
A few years back, I wrote a hacky event-sourcing implementation for our Turtle backend. It has worked for us so far, but I'd like to re-implement some core components as a standal…
-
It looks like it is not possible to use multiple pipelines.
```
children = [
...
{ProductReviewFeed.Pipeline.Prepare, []},
{ProductReviewFeed.Pipeline.Batch, []},
{ProductReviewFeed.Pi…
-
Is there a way to suspend a Broadway kafka pipeline from ingesting data without having to fully kill the Genserver ?
-
As far as I can tell I have followed the docs correctly to checkout the db connection and allow Broadway to use it. However I keep getting a DBConnection.OwnershipError
```
13:39:30.453 [basic_con…