google-research / deeplab2

DeepLab2 is a TensorFlow library for deep labeling, aiming to provide a unified and state-of-the-art TensorFlow codebase for dense pixel labeling tasks.
Apache License 2.0
998 stars 157 forks source link

How long it takes to train kMaXDeepLab on Cityscapes with batch size = 32? #164

Closed edwardyehuang closed 1 year ago

edwardyehuang commented 1 year ago

I found TPUv4 Pod runs very slow when using batch size = 32 on Cityscapes. Reading and augmenting 32 high-resolution images seems to reach the bottleneck of TPU. How long it takes to train kMaXDeepLab on Cityscapes with batch size = 32?

edwardyehuang commented 1 year ago

@yucornetto