Support reading uint32 types into TF

uber / petastorm

Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet format. It supports ML frameworks such as Tensorflow, Pytorch, and PySpark and can be used from pure Python code.

Apache License 2.0

1.8k stars 284 forks source link

Support reading uint32 types into TF #364

Closed selitvin closed 5 years ago

selitvin commented 5 years ago

The type is converted to int64 since tf.py_func does not support uint32 types. We promote it to be int64.

https://github.com/petewarden/tensorflow_makefile/blob/49c08e4d4ff3b6e7d99374dc2fbf8b358150ef9c/tensorflow/python/lib/core/py_func.cc#L88