crflynn / pbspark

protobuf pyspark conversion
MIT License
21 stars 5 forks source link

convert int64 types to long #33

Closed crflynn closed 2 years ago

crflynn commented 2 years ago

Right now int64 types processed as strings by protobuf for "javascript precision compatibility", which would render them null when converted into spark. Didn't previously catch this because int64 types weren't present in fixtures. This change properly converts int64, uint64 to LongType.