rcongiu / Hive-JSON-Serde

Read - Write JSON SerDe for Apache Hive.
Other
733 stars 391 forks source link

json Many-to-one mapping #220

Open QQhuxuhui opened 5 years ago

QQhuxuhui commented 5 years ago

I encountered the problem of merging different JSON data sources,I solved the problem of mapping different data source fields in the following way:

different field names of source json data are mapped to the same field of the Hive table

configure: `create external table TEST( col1 string, col2 string, col3 string )

partitioned by (dt int) ROW FORMAT SERDE 'org.openx.data.jsonserde.JsonSerDe' with serdeproperties( "mapping.col1" = "key1|key2|key3" ) ` Although key1,key2 and key3 come from different data sources, it represents the same data meaning. By configuring,they will be mapped to col1