google / model_search

Apache License 2.0
3.26k stars 462 forks source link

Is it feasible to use MirroredStrategy for training? #51

Open CyFeng16 opened 3 years ago

CyFeng16 commented 3 years ago

Thank you for making this work open source, and let us glimpse some of Google's achievements on the NAS platform. , I have successfully run feature data, binary and multi-classes image network search after checking materials and issues.

The current problem: model_search is only trained on a single GPU card, and the computational efficiency is not satisfactory. Is there a way to modify model_search (via distributing configs?) for multi-GPU card synchronous/asynchronous training?