[Question] How does ResFields work with K-Plane and HexPlane

markomih / ResFields

[ICLR 2024 Spotlight ✨] ResFields: Residual Neural Fields for Spatiotemporal Signals

https://markomih.github.io/ResFields

MIT License

161 stars 11 forks source link

[Question] How does ResFields work with K-Plane and HexPlane #7

Closed phongnhhn92 closed 5 months ago

phongnhhn92 commented 5 months ago

Hi,

I have just read your paper. From a 3D point p(x,y,z) at time t, we can get the interpolated features of 6 planes and I am not sure how can you add time-dependent residual weight to the plane-based methods such as K-plane and HexPlane.

Thanks !

markomih commented 5 months ago

Hi @phongnhhn92, thank you for your interest in our work!

K-planes/HexPlanes have an MLP that takes as input the interpolated features to predict color and density -- we implement this MLP with the ResField architecture.

We further provide additional details regarding the HexPlane experiment in the appendix that might be relevant to your question.