search

coursera / dataduct

DataPipeline for humans.
Other
252 stars 82 forks source link

add delta load convenience step #216

Closed tanonev closed 8 years ago

tanonev commented 8 years ago

PTAL @sb2nov

sb2nov commented 8 years ago

Chatted offline and still WIP

sb2nov commented 8 years ago

Actually how is this better than upsert with custom sql. or is the intention just to make it a bit more convenient ?

tanonev commented 8 years ago

This is meant to be a convenience method; the idea is if your upsert statement fits the delta load pattern already, you can switch it from an upsert to a delta load and get a performance benefit (and lack of dependency on full history) for free.

On Tue, Feb 2, 2016 at 11:29 AM, Sourabh Bajaj notifications@github.com wrote:

Actually how is this better than upsert with custom sql. or is the intention just to make it a bit more convenient ?

— Reply to this email directly or view it on GitHub https://github.com/coursera/dataduct/pull/216#issuecomment-178775921.