nus-vv-streams / vvtk

A toolkit for volumetric video research
MIT License
9 stars 8 forks source link

Support adaptive playback in `vvplay` #52

Closed ngchisern closed 3 months ago

ngchisern commented 6 months ago

Description

This pull request achieves the following:

  1. Addresses the inaccuracies in the resolution selection algorithm. The inaccuracies happen because the AntiAlias (which is not doing antialiasing!) class will modify the point coordinates in the shader.
  2. Fixes the position's correctness equation in AntiAlias :(. Previously, the Thai dancer model did not appear at the centre at the first frame)
  3. Fixes the translation matrix from OpenGL’s coordinate system to WGPU’s (see this link)
  4. The main changes: Implement adaptive playback in vvplay

The new vvplay is backward compatible (i.e, the previous commands will still work as expected)

The commands for preprocessing and adaptive playback have been added to README.md

Type of change

How Has This Been Tested?

While there are some test cases written for the new functions, most of the changes are tested manually.

This is undesirable, but this pr may need to be merged into the master first as it also provides some interfaces for other ongoing work.

Future Work

  1. Write more automated testing
  2. Perform performance testing and quality assessment on the introduced adaptive playback