How to distribute Train with large scale dataset?

google-research / robotics_transformer

Apache License 2.0

1.29k stars 148 forks source link

How to distribute Train with large scale dataset? #17

Open oym1994 opened 1 year ago

oym1994 commented 1 year ago

Hi, many thanks for this project and code.

I wander how to do distribute training with large scale dataset? Which framework do you use(like Megatron for pytorch)?Currently we havn't found such a good framework. It would be happy if you could recommend one.

Thanks