search

facebookarchive / hive-io-experimental

Hive I/O Library
Other
66 stars 30 forks source link

HiveWritableRecord type upgrades #15

Closed nitay closed 11 years ago

nitay commented 11 years ago

HiveWritableRecord should support upgrading types like int => long.

nitay commented 11 years ago

java.lang.ClassCastException: java.lang.Integer cannot be cast to java.lang.Long at org.apache.hadoop.hive.serde2.objectinspector.primitive.JavaLongObjectInspector.get(JavaLongObjectInspector.java:39) at org.apache.hadoop.hive.serde2.lazy.LazyUtils.writePrimitiveUTF8(LazyUtils.java:203) at org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe.serialize(LazySimpleSerDe.java:427) at org.apache.hadoop.hive.serde2.columnar.ColumnarSerDe.serialize(ColumnarSerDe.java:169) at com.facebook.hiveio.output.RecordWriterImpl.serialize(RecordWriterImpl.java:108) at com.facebook.hiveio.output.RecordWriterImpl.write(RecordWriterImpl.java:90) at com.facebook.hiveio.output.RecordWriterImpl.write(RecordWriterImpl.java:41) at com.facebook.hiveio.output.OutputCmd.write(OutputCmd.java:142) at com.facebook.hiveio.output.OutputCmd.singleThreaded(OutputCmd.java:108) at com.facebook.hiveio.output.OutputCmd.execute(OutputCmd.java:100) at com.facebook.hiveio.options.BaseCmd.run(BaseCmd.java:38) at com.facebook.hiveio.cmdline.Main.main(Main.java:36)

nitay commented 11 years ago

Fixed by #40