MingSun-Tse / LightAvatar-TensorFlow

TensorFlow code for our ECCV'24 Workshop paper "LightAvatar: Efficient Head Avatar as Dynamic NeLF"
Apache License 2.0
23 stars 0 forks source link

The reported FPS for GaussianAvatars is much lower than the original paper #1

Closed ShenhanQian closed 3 weeks ago

ShenhanQian commented 1 month ago

Dear authors, I noticed that the reported FPS for GaussianAvatars in your appendix

image

is much lower than the original paper

image

Can you please provide more details on how you conducted this test?

MingSun-Tse commented 1 month ago

Hi @ShenhanQian , thanks for noticing the potential problem and reaching out. By my best recall, I just run the code released on github and got the numbers. I am attending eccv now. Will do my best to replicate the experiment and let you know. Meanwhile, it would be great if you could instruct me to get the results in your paper in case I missed anything. Thanks!

ShenhanQian commented 1 month ago

Hi @MingSun-Tse , thanks for your reply while attending the conference. I am wondering if you tested the FPS with our local viewer or the offline rendering script.

For the reported FPS in our paper, we used the offline rendering script. We had to avoid counting in time spent on IO by commenting out the part that reads GT images from the dataset and the part that writes rendering results and GT images into the output folder.

MingSun-Tse commented 1 month ago

Ok, i see! Can you prepare a script for benchmarking the speed and update it in your repo? I guess others would also be interested in the inference efficiency benchmarks. Tx!

ShenhanQian commented 1 month ago

@MingSun-Tse Thanks for your suggestion. We have updated the repo for FPS benchmark. Please refer to commands here.

We got 200+ FPS when rendering in 802x550 with an NVIDIA RTX A4000 as shown below: image

MingSun-Tse commented 1 month ago

Hi @ShenhanQian , thanks for your patience! I ran your speed benchmark script and confirmed the speed is around 200 FPS (on a 4090 24GB GPU). Thanks a lot for letting us know about the problem! I'll update the paper soon. Regards,

image
ShenhanQian commented 1 month ago

Thank you a lot for your spontaneous response. We are glad that the benchmark performance is consistent. Could you please leave a comment here after you have updated the paper?

Best regards, Shenhan

MingSun-Tse commented 3 weeks ago

Hi @ShenhanQian Thanks for your patience! I just got time to finish the benchmarks and update the paper. The updated results are below:

image

I am closing this issue now. Feel free to reopen it if you have further questions :-).

Regards,