PEDSnet / pedsnetdcc

CLI tool for PEDSnet data coordinating center ETL tasks
Other
0 stars 0 forks source link

Add merge and transform cli commands #60

Closed gracebrownecodes closed 8 years ago

gracebrownecodes commented 8 years ago

Untested as of yet.

Signed-off-by: Aaron Browne aaron0browne@gmail.com

gracebrownecodes commented 8 years ago

The transform command is now working. I'm still running into some very weird bugs with the merge command where some not null constraints are failing after the merge. It's as if some data is just disappearing during the merge, so there's that.

gracebrownecodes commented 8 years ago

The previously mentioned bug had to do with the use of "TABLE" statements in the merge function, which do not order the columns combined with non-deterministic column order in the site tables after transformation. It is now fixed and this is ready for review.

murphyke commented 8 years ago

OK, merging.