parse complex json file failed

[timeforce]

my json file is like: {"lastTimestamp": xxxxxxx, "obj":[{"description":"xxxxx", "timestamp": xxxxxxxx, "prefix":"xxx", "tags":{}, "encoding":"xxxx"}], "sucess":"xxxx", "totalResults":"xxx", "elapsedms":"xxx"}

And I tried:

hive> create table json(lastTimestamp string, obj array<struct<description:string, timestamp:string,prefix:string, encoding:string>>, success string,totalResults string,elapsedms string)

ROW FORMAT SERDE 'org.openx.data.jsonserde.JsonSerDe';

But got error:

FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. Could not initialize class org.openx.data.jsonserde.objectinspector.JsonObjectInspectorFactory

I omitted "tags":{} as I don't know how to deal with it in the schema. Is that the root cause?

Thanks

[code-rider]

hi having same issue

[rcongiu]

So, I tried the code above...a few things.

• when entering code in github, please use markdown, otherwise it will get garbled. To use markdown, insert code between three backticks (`)
• 'timestamp' is a reserved keyword in hive, so you have to map it:

 create table json_81(
            lastTimestamp string, 
            obj array<struct<
                        description:string, 
                        ts:string,prefix:string,  
                        encoding:string>>, 
            success string,
            totalResults string,
            elapsedms string)
     ROW FORMAT SERDE 'org.openx.data.jsonserde.JsonSerDe'
WITH SERDEPROPERTIES ( "mapping.ts" = "timestamp" ) ;

see how I replaced 'timestamp' with 'ts' and added the mapping in the serde properties.

hive> select * from json_81;
OK
xxxxxxx [{"description":"xxxxx","ts":"xxxxxxxx","prefix":"xxx","encoding":"xxxx"}]  NULL    xxx xxx

• I tried the code and it works for me. The error you get makes me think the serde may be incorrectly set up. For compatibility with multiple versions of hive I divided the project in multiple modules, you have to get the right jar after building it (json-serde/target/json-serde-1.3-SNAPSHOT-jar-with-dependencies.jar) or it won't work. Can you verify which jar file you installed in HIVE_AUX_JARS_PATH ?

[rcongiu]

Closing as no answer to my observation.