search

moj-analytical-services / etl_manager

A python package to create a database on the platform using our moj data warehousing framework
21 stars 9 forks source link

etl manager should support / default to hive json serde #135

Open isichei opened 4 years ago

isichei commented 4 years ago

https://github.com/moj-analytical-services/etl_manager/blob/e4c3b753fb661f249bf416e379f6b3f4ba2c565f/etl_manager/specs/json_specific.json#L6

Probably should just create a second jsonl table support like we do with CSV

isichei commented 4 years ago

Also creating DDL for json writes the col description as 'from deserializer'