hibernating-rhinos / rhino-etl

Developer friendly ETL Library for .NET
http://hibernatingrhinos.com/open-source/rhino-etl
BSD 3-Clause "New" or "Revised" License
173 stars 54 forks source link

Incremental Load from ODBC to SQLClient #33

Open DoubleDP opened 6 years ago

DoubleDP commented 6 years ago

I am busy developing an ETL that loads data from SQL Server 7.0 source via a ODBC connection and pushing into Azure destination via a SQLClient connection.

This must be done incrementally and thus a parameterized SP will be called on the source to receive the batches of data.

So far everything is working well in getting the invariant key values from the source's table and the last unique key value pairing written to the destination's table. This was achieved via an InputCommandOperation calling parameter-less SPs on the source and destination respectively.

These 2 datasets have now been merged to produce a list of parameters pairings that must be used to call the SP in iterations based on the rows of parameter pairings.

My problem is this... I cannot use SqlBatchOperation as the connection I am creating is an OdbcConnection, which makes the PrepareCommand(Row row, SqlCommand command) unusable.

Any ideas on how I can overcome the problem I have described?