Investigate approaches to distribute huge embedding tables in PyTorch

NVIDIA-Merlin / Transformers4Rec

Transformers4Rec is a flexible and efficient library for sequential and session-based recommendation and works with PyTorch.

Apache License 2.0

1.11k stars 145 forks source link

Open gabrielspmoreira opened 3 years ago

gabrielspmoreira commented 3 years ago

[ ] Investigate the alternatives to have distributed embedding tables with native PyT
[ ] Check (if possible) how we can leverage HugeCTR engine for PyT / TF for distributed embeddings

gabrielspmoreira commented 3 years ago

The PyT Distributed RPC framework can be an option to have the embedding tables in a remote parameter server