Does torcharrow support binary data type?

pytorch / torcharrow

High performance model preprocessing library on PyTorch

https://pytorch.org/torcharrow/beta/index.html

BSD 3-Clause "New" or "Revised" License

647 stars 79 forks source link

Does torcharrow support binary data type? #520

Open Adenialzz opened 1 year ago

Adenialzz commented 1 year ago

I want to use datapipe to read parquet files in which image is stored as binary. But I got error:

NotImplementedError: Unsupported Arrow type: binary

So I wonder does torcharrow support binary data type right now? If not, is there any plan to support more data types? Or is it possible to implement it myself? If not, is there any other solution for my case? Thanks in advance.