Berlin0610 / CFTE_DCC2022

This repository contains the source code for the paper Beyond Keypoint Coding: Temporal Evolution Inference with Compact Feature Representation for Talking Face Video Compression by Bolin Chen, Zhao Wang, Binzhe Li, Rongqun Lin, Shiqi Wang, and Yan Ye.
Apache License 2.0
5 stars 2 forks source link

the test video compreessed with vvc #1

Open spring-and-solstice opened 7 months ago

spring-and-solstice commented 7 months ago

Hi, I am very interested in your work and thank you for the code, but I ran into some issues while trying. I used the cfg you used to compress the first frame to compress 5th sequence and 15th sequence , but I got a lower bit rate and a higher psnr. I only changed the number of frames to be compressed, to 250. I don't know much about VTM. What could be the problem?

5th sequence LayerId 0 Total Frames | Bitrate Y-PSNR U-PSNR V-PSNR YUV-PSNR
250 a 5.3464 35.9079 35.5928 34.2567 35.1720

15th sequence LayerId 0 Total Frames | Bitrate Y-PSNR U-PSNR V-PSNR YUV-PSNR
250 a 4.0120 32.0220 31.8602 30.6205 31.4236 I look forward to hearing from you.

Berlin0610 commented 7 months ago

Hi, I am very interested in your work and thank you for the code, but I ran into some issues while trying. I used the cfg you used to compress the first frame to compress 5th sequence and 15th sequence , but I got a lower bit rate and a higher psnr. I only changed the number of frames to be compressed, to 250. I don't know much about VTM. What could be the problem?

5th sequence LayerId 0 Total Frames | Bitrate Y-PSNR U-PSNR V-PSNR YUV-PSNR 250 a 5.3464 35.9079 35.5928 34.2567 35.1720

15th sequence LayerId 0 Total Frames | Bitrate Y-PSNR U-PSNR V-PSNR YUV-PSNR 250 a 4.0120 32.0220 31.8602 30.6205 31.4236 I look forward to hearing from you.

Hi, thank you for your interest in our work. I guess that you compress the first frame with the coded color format YUV 420. In our experiment, we directly use the VTM 10.0 to compress the first frame with the coded color format RGB 444. The version of VTM 10.0 or higher can code the color format of RGB 444. But I have noticed that you directly use our cfg. May you send the cfg setting and VTM software to my email: bolinchen3-c@my.cityu.edu.hk. I can have a double check.

spring-and-solstice commented 7 months ago

I sent cfg setting and VTM software to you yesterday. Have you received it? What might be my problem? Thank you