search

splunk / pipelines

Concurrent processing pipelines in Go.
MIT License
21 stars 8 forks source link

pipelines: fan-out #6

Closed kalexmills-splunk closed 2 years ago

kalexmills-splunk commented 2 years ago

One thing the current set of pipeline funcs does not do well is allow the caller to control the fan-out in each stage.

It seems to me like this could be handled generically via a buffered channel and a generic fan-out stage, at the cost of only one additional goroutine.

Lng88 commented 2 years ago

Will take a look at this soon 👀

kalexmills-splunk commented 2 years ago

I'm taking this one.