search

photosynthesis-team / piq

Measures and metrics for image2image tasks. PyTorch.
Apache License 2.0
1.32k stars 114 forks source link

Benchmark request #297

Closed pythonmobile closed 2 years ago

pythonmobile commented 2 years ago

PIQA claims that it is faster that piq. Has anyone done a benchmark against these two libraries using SSIM? Perhaps someone can shed some light on that:

Related: https://github.com/francois-rozet/piqa/issues/23

snk4tr commented 2 years ago

Hi @pythonmobile. We have not done an extensive comparison of such. However, you can have a look at the table that we made to compare several implementation options. What you can see here are relative execution times when all required checks are used (our implementation, column time -O) and no checks are used (the closest to the PIQA implementation, time no validation + no adjust column). Note that the difference is marginal and should not be critical for most practical applications. Feel free to reopen in case of additional questions.