Evaluation Codes. - Githubissues

thu-nics / ViDiT-Q

ViDiT-Q: Efficient and Accurate Quantization of Diffusion Transformers for Image and Video Generation

https://a-suozhang.xyz/viditq.github.io/

23 stars 3 forks source link

Evaluation Codes. #2

Open zjq0455 opened 1 month ago

zjq0455 commented 1 month ago

Thanks for your contributions again!

Could you please provide evaluation codes (Table 1 to Table 3) for followers to better reproduce your methods?

A-suozhang commented 1 month ago

Thank you for your interest in our work. Our evalaution is conducted across a variety of metrics (benchmarks), so the evaluation code is scattered in various repos, we haven't merged them together yet, it may take some extra time.

We mainly adopt the code from 2 evaluation codebases:

VBench for the evaluation suite
EvalCrafter for many metrics (e.g., VQA, CLIPSIM, and so on)