search

srvarey / gbif-occurrencestore

Automatically exported from code.google.com/p/gbif-occurrencestore
0 stars 0 forks source link

Sqoop out not respecting Numeric types #6

Closed GoogleCodeExporter closed 9 years ago

GoogleCodeExporter commented 9 years ago 
On occurrence_record sqoop out, even though the values all fall in the correct 
range for Mysql smallint unsigned, somehow Mysql is reporting out of bounds 
exception.

For the meantime I have modified the year and cell_id columns to be INT and 
this stops the problem, but this is a temporary fix (Mysql index size is much 
smaller with correct data types)

Original issue reported on code.google.com by timrobertson100 on 17 Apr 2011 at 4:32

GoogleCodeExporter commented 9 years ago 
Might not in fact be Sqoop.  Hive is using smallint in the schema, which does 
not hold the full size of cell_id

Original comment by timrobertson100 on 17 Apr 2011 at 5:14

GoogleCodeExporter commented 9 years ago 
Fixed by using INT instead of SMALLINT

Original comment by timrobertson100 on 18 Apr 2011 at 6:27