MeltanoLabs / Singer-Working-Group

Working group for ongoing development and iteration of the Singer Spec, the de-facto protocol for open source data connectors. Please use "Issues" to create discussion items - or use "Discussions" for general questions.
Apache License 2.0
13 stars 4 forks source link

Draft: BATCH message type #26

Open kgpayne opened 2 years ago

kgpayne commented 2 years ago

Draft proposal for BATCH message type support as raised in #2

Rendered SIP Draft: https://github.com/kgpayne/Singer-Working-Group/blob/kp/batch_messages/proposals/draft/SIPXX%20-%20BATCH%20message%20type.md

Note: In order to support discoverability of capabilities like "BATCH" record types, we may require something like https://github.com/MeltanoLabs/Singer-Working-Group/issues/8

judahrand commented 2 years ago

Really excited for this - it is one of the things which has forced us to go with pure PipelineWise at the moment!