disguise-one / hap-encoder-adobe-cc

Community-supported exporter of HAP codec family for Adobe CC applications
Other
169 stars 15 forks source link

Performance Tests #23

Open GregBakker opened 5 years ago

GregBakker commented 5 years ago

It's likely we'll be testing new compressors at some point; would be nice to run and test these with MS-SSIM and also timing vs some baseline without having to drive them through AME etc.

For any choice of parameters there'll be a tradeoff between

These terms are chosen such that bigger = better.

So longer-term TODO - add these benchmarks so that anyone may run them.

bangnoise commented 5 years ago

There have been reports that a number of users are avoiding moving to this exporter because they get better performance with the old QuickTime codec.

We need to

  1. Devise tests using adequate test material to test both transcodes from other formats in Media Encoder and exports from Premiere, measuring the total time to encode a reasonable duration of test material at different dimensions. The test material should be made available so others can reproduce the tests.
  2. Document test procedures.
  3. Tabulate results to each of the Hap variants on specific hardware
  4. Compare with the QuickTime codec on the same hardware
GregBakker commented 4 years ago

Have added googletest framework In foundation 0.1.0, which 1.2.0-rc1 uses. No performance tests as of yet.