search

pytorch / data

A PyTorch repo for data loading and utilities to be shared by the PyTorch domain libraries.
BSD 3-Clause "New" or "Revised" License
1.12k stars 149 forks source link

[TODO] There is current a bug in TorchArrow/Velox related to conversion of arrow arrys to DataFrame that causes #595

Closed VitalyFedyunin closed 2 years ago

VitalyFedyunin commented 2 years ago

This issue is generated from the TODO line https://github.com/pytorch/data/blob/2f29adba451e1b87f1c0c654557d9dd98673fdd8/./examples/criteo_torcharrow/criteo_parquet.py#L17

NivekT commented 2 years ago

@wenleix I don't think this is true anymore right?

If so, I can remove the TODO and close this issue