Hive creation failed

[rpushpa]

Hi, This was so great tool for simplifing the json record into hive structure. I have created the jar files and used them to generate hive DDL . But the create table statement is failing in hive. can you pls help to resolve the issue?

sample data record: {"country":"uk","state":"ny","city":"fr","street":"nyk","zip":"1009","data":[{"country_code":"uk","state_set":"ny","city_code":"fr","street_code":"nyk","zip_code":"1009"}]}

user@ubuntu:~/lab/programs$ java -jar json-hive-schema-1.0-jar-with-dependencies.jar /home/user/Documents/json_cntry_schema.json CREATE TABLE x ( city string, country string, data array<struct<city_code:string, country_code:string, state_set:string, street_code:string, zip_code:string>>, state string, street string, zip string) ROW FORMAT SERDE 'org.openx.data.jsonserde.JsonSerDe';

hive> CREATE external TABLE jcountry (

city string, country string, data array<struct<city_code:string, country_code:string, state_set:string, street_code:string, zip_code:string>>, state string, street string, zip string) ROW FORMAT SERDE 'org.openx.data.jsonserde.JsonSerDe' LOCATION '/user/data1/jason/'; FAILED: Parse Error: line 4:2 mismatched input 'data' expecting Identifier near ',' in column specification

Thanks , Pushpa

[mtoupsUNO]

This line is wrong:

data array>,

In other words, an array of what?

It looks like your sample is actually an array containing a struct, so maybe something like:

data array<struct<country_code:string, state_set:string, ... >>,

I'll let you finish writing out the struct, but that's the idea.

[rpushpa]

Thanks. I have tried same as array having struct data type and given the DDL as shown above. Still I am failing in creating the table . More information ::My hive version is hive 0.9 version

[mtoupsUNO]

Please provide the CREATE statement you used which is not working.

[rpushpa]

Here is the create table statement i used: CREATE external TABLE jcountry ( city string, country string, data array <struct<city_code:string, country_code:string, state_set:string, street_code:string, zip_code:string>>, state string, street string, zip string) ROW FORMAT SERDE 'org.openx.data.jsonserde.JsonSerDe' LOCATION '/user/data1/jason/';

[rpushpa]

Hi.. Just wanted to check if you need any aditional information on resolving the issue

[mtoupsUNO]

Are you still getting a parse error? If so, what line number? Provide the whole error message here.

[rpushpa]

Yes I get same erro telling the same for issue:

FAILED: Parse Error: line 4:2 mismatched input 'data' expecting Identifier near ',' in column specification

Thanks , Pushpa

[mtoupsUNO]

Oh, data could be a reserved keyword. Try wrapping it in backticks, i.e.

`data` array<struct<...>>

[telebh]

I am trying to generate jar files using "mvn package" but it always freezes as follows. Please can you advise?

[INFO] Scanning for projects... [WARNING] [WARNING] Some problems were encountered while building the effective model for net.thornydev:json-hive-schema:jar:1.0 [WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-compiler-plugin is missing. @ line 13, column 15 [WARNING] [WARNING] It is highly recommended to fix these problems because they threaten the stability of your build. [WARNING] [WARNING] For this reason, future Maven versions might no longer support building such malformed projects. [WARNING] [INFO] [INFO] -------------------< net.thornydev:json-hive-schema >------------------- [INFO] Building json-hive-schema 1.0 [INFO] --------------------------------[ jar ]--------------------------------- Downloading from nexus: http://nexus.elsst.com/content/groups/public/org/apache/maven/plugins/maven-assembly-plugin/2.4/maven-assembly-plugin-2.4.jar Progress (1): 25/226 kB