search

ConduitIO / conduit

Conduit streams data between data stores. Kafka Connect replacement. No JVM required.
https://conduit.io
Apache License 2.0
364 stars 41 forks source link

Connector: Surrealdb [Source/Destination] #1594

Open nickchomey opened 1 month ago

nickchomey commented 1 month ago

Resource name

Surrealdb

Resource link

https://surrealdb.com/

Connector type

Source/Destination

Expected connector behavior

Surrealdb is a new and very promising "multi-model" database that covers relational, nosql, graph, vector, full text search, and more. This allows for consolidating many databases/stores into one, as well as affords new functionality.

One of the main obstacles to its adoption, however, is actually importing the data from numerous sources. They have an existing discussion for adding cdc to surreal, where theyve been discussing rolling their own - which makes no sense at all when Conduit exists and supports all the major databases, data stores etc...

https://github.com/orgs/surrealdb/discussions/3

Surreal also has various mechanisms for receiving live updates from the database, so it could very well be a Conduit Source as well - to feed an event driven architecture or whatever.

hariso commented 1 month ago

@nickchomey Thanks for opening this issue! SurrealDB looks like an interesting project.:) The team will definitely consider this connector. When it comes to the connectors that we implement ourselves, we prioritize based on interest shown by the dev community and based on our company's needs. However, if anybody else wants to start implementing the connector sooner than that, our team will be happy to assist with guidelines and advice.