search

snowplow / snowbridge

For replicating streams across clouds, accounts and regions
Other
15 stars 7 forks source link

Add generic plugin transformation ability #56

Open jbeemster opened 3 years ago

jbeemster commented 3 years ago

Example scripts included!

The interface requirements:

  1. The plugin should "read" from "stdin" -> each message input will be newline delimited and the reader should process on finding a newline
  2. The plugin must strip the newline and then base64 decode the message
  3. The plugin must re-encode the transformed result in base64
  4. The plugin must always send a value on both stdout & stderr (even if stderr is just an empty string)

The sample bash scripts should illustrate this flow!