search

stellar / go

Stellar's public monorepo of go code
https://stellar.org/developers
Apache License 2.0
1.29k stars 499 forks source link

Ingestion: unix pipe writer #1394

Open ire-and-curses opened 5 years ago

ire-and-curses commented 5 years ago

A writer for the ingestion system that emits to a Unix pipe, file or socket would provide a convenient way to escape from Go for secondary processing in a language of the user's choice. This would greatly expand the versatility of the pipeline for use by non-Go developers, without adding any additional libraries or middleware.

bartekn commented 4 years ago

This is actually what captive core does now (stream xdr.LedgerCloseMeta). I wonder if we should close this.

ire-and-curses commented 4 years ago

Yeah maybe. Then again that stream still needs to be decoded so it's not like you can just pipe it to grep or something.

ire-and-curses commented 4 years ago

If it was possible and documented with an example then this can be closed. See #2815.

2opremio commented 3 years ago

I think we can close this. @ire-and-curses please reopen if you disagree.

ire-and-curses commented 3 years ago

What I want is a worked example of how to use the ingestion library to dump to stdout. Basically, how do I make a tool that can be composed with other unix command line tools. Do we have that?