How to train the supernet?

[Hukongtao]

As written in the documentation，you can use the following command to train a OFA network:

horovodrun -np 32 -H <server1_ip>:8,<server2_ip>:8,<server3_ip>:8,<server4_ip>:8 \
    python train_ofa_net.py

But after reading the code, I feel that training a OFA network should take three steps：

python train_ofa_net.py --task kernel
python train_ofa_net.py --task depth
python train_ofa_net.py --task expand

I don't know if I understand it right

[callmewenhao]

i think so! 🤔