RowSerializer: Safe guard against double types with Decimal schema tags

Stratio / crossdata

DISCONTINUED - Easy access to big things. Library for Apache Spark extending and improving its capabilities

https://stratio.atlassian.net/wiki/display/PLATFORM/STRATIO+CROSSDATA

Apache License 2.0

169 stars 51 forks source link

RowSerializer: Safe guard against double types with Decimal schema tags #799

Closed pfcoperez closed 7 years ago

pfcoperez commented 7 years ago

Description

Spark inferences a PARQUET double column schema type as a DecimalType column when it should be Double. The serializer didn't expect this behavior and this PR adds safeguards to avoid failures.

Testing

[x] Unit, integration tests

hdominguez-stratio commented 7 years ago

coveralls commented 7 years ago

Coverage increased (+0.01%) to 33.843% when pulling 5b264abddb5c714238fce8c7ff7899723e831368 on pfcoperez:serializationDecimaSafeguard into 8fcd5d607babbfa44b88f385e5fa3fe796ffbd67 on Stratio:master.