redpanda-data / connect

Fancy stream processing made operationally mundane
https://docs.redpanda.com/redpanda-connect/about/
7.98k stars 786 forks source link

gRPC support #167

Open pjebs opened 5 years ago

pjebs commented 5 years ago

Will this support grpc in the future?

Or https://github.com/twitchtv/twirp

Jeffail commented 5 years ago

Hey @pjebs, what kind of components would you want for working with grpc? I'm not sure what a generic grpc connector would look like or be useful for.

Jeffail commented 5 years ago

Hey @pjebs, closing this ticket for now as it's not very informative but please reopen if you can flesh out the request.

Slach commented 1 year ago

@Jeffail grpc streaming as Input + transform and grpc streaming as output will be nice feature for benthos! Sorry, can't re-open issue

something with url + proto files link in config could be use for data parsing

mihaitodor commented 1 year ago

@Slach Do you recommend using this twirp library that was referenced in the original issue or are there alternatives which should be explored? Are you aware of any other Go data streaming tools which have gRPC support that we could look at?

Slach commented 1 year ago

@mihaitodor twirp it's a grpc alternative currently i propose use general grpc streaming approach which implemented inside https://github.com/ktr0731/evans maybe it could be implement via "subprocess" input