search

estuary / connectors

Connectors for capturing data from external data sources
Other
50 stars 17 forks source link

Request a connector to [capture from | materialize to] [your favorite system] #1816

Open worldturtlefarm opened 3 months ago

worldturtlefarm commented 3 months ago

System Name

Websocket Connector

Type

Capture

Details

Hi there! My name is Jacob Leonard, I've made a few suggestions in the past while working at previous companies, but I wanted to make a request for a general gap in the market service offerings that Im seeing for websockets. Is there any plan on the roadmap for estuary to add a more general websocket connector? or could I do something like that with the CLI?

psFried commented 3 months ago

@worldturtlefarm would you be wanting to capture data that clients send via websocket? If so, then is there a specific protocol that you'd want to see supported? Websockets are move like a transport than a full-fledged protocol. There would need to be some sort of protocol that's able to represent desired transaction boundaries and commit results, etc. We could invent one, but that seems at odds with the idea of a "general websocket" connector.

Do you happen to have a specific use-case in mind that you could share?