cgnorthcutt / benchmarking-keras-pytorch

🔥 Reproducibly benchmarking Keras and PyTorch models
https://l7.curtisnorthcutt.com/towards-reproducibility-benchmarking-keras-pytorch
Other
367 stars 43 forks source link

why resnet architectures perform better in PyTorch and inception architectures perform better in Keras? #1

Closed jiqiujia closed 5 years ago

cgnorthcutt commented 5 years ago

I cannot say exactly but one might suggest PyTorch's implementation is better because Kaiming He who invented Resnet joined Facebook AI Research which heavily influences PyTorch. It usually comes down to a mixture of preprocessing, number of epochs, loss function, and updates to learning rate.