search

Netflix / image_compression_comparison

Image Compression Comparison Framework
Other
268 stars 32 forks source link

Proposal for adding new metrics #2

Open ScopeBurst opened 4 years ago

ScopeBurst commented 4 years ago

Since there are still quite good and used metrics to measure image quality, it would be nice to add them: DSSIM https://github.com/kornelski/dssim SSIMULACRA https://github.com/cloudinary/ssimulacra butteraugli https://github.com/google/butteraugli (a newer and improved version is with Jpeg XL)

And why are better Jpeg encoders like MozJPEG not used for comparisons and low anchors?

adityamavlankar commented 4 years ago

We are "for" extending the framework to add more metrics and more codecs. We will gladly review pull requests. Our gating criteria are:

  1. For a new metric (not already in the framework), we should see evidence that it has good correlation with human scores; OR evidence that metric is popular and well-tested.
  2. For both new metric as well as new codec, we need "stability", meaning no crashes and hangs and other unpredictable behavior. For example, crashes will make the framework bumpy to use for everyone.

We would encourage adding above metrics, and JPEG-XL, mozJPEG, etc. too as more codecs.