Memory and Training Speed Computation

thuml / Autoformer

About Code release for "Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecasting" (NeurIPS 2021), https://arxiv.org/abs/2106.13008

MIT License

1.99k stars 429 forks source link

Memory and Training Speed Computation #91

Closed xiyuanzh closed 2 years ago

xiyuanzh commented 2 years ago

Hi, thanks for your great work! Would it be possible to share the script to calculate the memory usage and training speed presented in Figure 7? Thanks a lot!

wuhaixu2016 commented 2 years ago

For the GPU memory, you can just use nvidia-smi to check the GPU usage for each device. For the training speed, you can use the time package to calculate.