In Spark, a field can have NullType type if it contains only nulls (untyped). It is problematic especially if one expects this field to be an array of something, and calls transform on it - in that case, an exception is thrown.
Feature
Function that would convert all fields with NullTypes to their corresponding type in target schema.
Background
In Spark, a field can have
NullType
type if it contains only nulls (untyped). It is problematic especially if one expects this field to be an array of something, and callstransform
on it - in that case, an exception is thrown.Feature
Function that would convert all fields with NullTypes to their corresponding type in target schema.