ConduitIO / conduit

Conduit streams data between data stores. Kafka Connect replacement. No JVM required.
https://conduit.io
Apache License 2.0
399 stars 49 forks source link

Connector: Surrealdb [Source/Destination] #1594

Open nickchomey opened 6 months ago

nickchomey commented 6 months ago

Resource name

Surrealdb

Resource link

https://surrealdb.com/

Connector type

Source/Destination

Expected connector behavior

Surrealdb is a new and very promising "multi-model" database that covers relational, nosql, graph, vector, full text search, and more. This allows for consolidating many databases/stores into one, as well as affords new functionality.

One of the main obstacles to its adoption, however, is actually importing the data from numerous sources. They have an existing discussion for adding cdc to surreal, where theyve been discussing rolling their own - which makes no sense at all when Conduit exists and supports all the major databases, data stores etc...

https://github.com/orgs/surrealdb/discussions/3

Surreal also has various mechanisms for receiving live updates from the database, so it could very well be a Conduit Source as well - to feed an event driven architecture or whatever.

hariso commented 6 months ago

@nickchomey Thanks for opening this issue! SurrealDB looks like an interesting project.:) The team will definitely consider this connector. When it comes to the connectors that we implement ourselves, we prioritize based on interest shown by the dev community and based on our company's needs. However, if anybody else wants to start implementing the connector sooner than that, our team will be happy to assist with guidelines and advice.

cope commented 2 months ago

This would be quite awesome...