search

embulk / embulk-output-jdbc

MySQL, PostgreSQL, Redshift and generic JDBC output plugins for Embulk
Other
88 stars 86 forks source link

support cratedb #233

Open cmdares opened 6 years ago

cmdares commented 6 years ago

Crate is a new big data solution for the Internet of things, which has been used in many industries. it is hoped that the embulk-output-jdbc can support the efficient ETL solution for cratedb, including insert and update. db ref: https://crate.io/ bulk insert(update) ref: https://crate.io/docs/crate/reference/en/latest/sql/statements/insert.html#id4

Similar to postgre sql feature https://github.com/embulk/embulk-output-jdbc/issues/131 thanks.

hiroyuki-sato commented 6 years ago

Hello, @cmdares

Could you try embulk-output-jdbc + JDBC Driver for Crate ?

General database may possible to use JDBC plugin. Otherwise, someone needs to develop a new plugin.

cmdares commented 6 years ago

https://crate.io/docs/crate/reference/en/latest/general/dml.html#upserts-on-duplicate-key-update upsert feature like mysql and postgresql. So it's still useful.

hiroyuki-sato commented 6 years ago

Hello, @cmdares

Does this mean you need cratedb plugin? Have you ever tried embulk-output-jdbc + JDBC Driver for Crate ? If the plugin doesn't work, it's a good chance for you to create a new plugin by yourself.