search

tensorflow / recommenders-addons

Additional utils and helpers to extend TensorFlow when build recommendation systems, contributed and maintained by SIG Recommenders.
Apache License 2.0
587 stars 132 forks source link

TFRA on Dtensor #432

Open jq opened 3 months ago

jq commented 3 months ago
  1. SPMD training data in Dtensor
  2. Ring All2All for embedding (lookup in par with each p2p
  3. Embedding lookup in Dtensor
  4. Keras3, doesn't support Dtensor, only 2 does, https://github.com/keras-team/keras/issues/19519 https://keras.io/guides/distribution/
    https://www.tensorflow.org/tutorials/distribute/dtensor_keras_tutorial can't use fit
  5. TFX on XLA