mkkellogg / GaussianSplats3D

Three.js-based implementation of 3D Gaussian splatting
MIT License
1.45k stars 183 forks source link

Relighting #48

Open ax-anoop opened 12 months ago

ax-anoop commented 12 months ago

Any thoughts on how lighting sim could be done in the future strictly inside three js?

Ben-Mack commented 11 months ago

Looking at Luma UE plugin, point light without shadow is seemingly doable, but any other type of light with shadow casting, I haven't even seen it anywhere on the internet yet.

mkkellogg commented 11 months ago

I'm currently looking into how to do this exactly. At first glance it seems difficult because we don't have surface normals, but as @Ben-Mack mentioned Luma AI appears to have successfully implemented point lights in their GS scenes, so my first step should probably be to replicate that.

ax-anoop commented 11 months ago

Cool! @mkkellogg Could we chat? We're working on the same thing :) Maybe we can collaborate, please email me at anoop@axibo.com if you don't mind.

Bishadkoju commented 9 months ago

Hi, has there been any progress regarding this ? Thank you.

mkkellogg commented 9 months ago

No progress yet, I just haven't found the time to dedicate to it.