search

pytorch / torcharrow

High performance model preprocessing library on PyTorch
https://pytorch.org/torcharrow/beta/index.html
BSD 3-Clause "New" or "Revised" License
645 stars 79 forks source link

Sparse feature collation in TorchArrow #321

Closed Miiira closed 2 years ago

Miiira commented 2 years ago

Summary:

  1. IndividualSparse, PackedSparse, JaggedSparse in TorchArrow sparse feature conversion (context at T116491098)
  2. Updates DppReadingService to convert TA conversion to backend enum
  3. Add tests to cover all supported & unsupported & column-type-mismatched conversion cases

Differential Revision: D36208668

facebook-github-bot commented 2 years ago

This pull request was exported from Phabricator. Differential Revision: D36208668

facebook-github-bot commented 2 years ago

This pull request was exported from Phabricator. Differential Revision: D36208668

facebook-github-bot commented 2 years ago

This pull request was exported from Phabricator. Differential Revision: D36208668