Perf benchmark script

[morgangiraud]

To track progress on performance I need to write some performance tests

TODO:

• [x] Check perf of run without FFT
• [x] Check perf of run_scan with FFT
• [x] Check perf of run_scan_mem_optimized without FFT
• [x] Check perf of run_scan_mem_optimized with FFT
• [x] Add channel_last property for perf test
• [x] Check perf of gradient pipeline

Links

• https://github.com/dionhaefner/pyhpc-benchmarks
• https://colab.research.google.com/github/pytorch/tutorials/blob/gh-pages/_downloads/435dbd2c0a0584cd964b8ce750a135ee/benchmark.ipynb#scrollTo=owk-QIVjjTY7