kwea123 / nerf_pl

NeRF (Neural Radiance Fields) and NeRF in the Wild using pytorch-lightning
https://www.youtube.com/playlist?list=PLDV2CyUo4q-K02pNEyDr7DYpTQuka3mbV
MIT License
2.74k stars 483 forks source link

How can i realize realistic mixed reality photos in Unity? #123

Closed mrlihellohorld closed 2 years ago

mrlihellohorld commented 2 years ago

Describe the bug A clear and concise description of what the bug is. MixedReality model in unity, I achieved the effect as shown below image Further, I want to replace the sphere with a human cartoon model, like your renderings, with lights, shadows. How do I do it, is it to replace the materials? image

Screenshots If applicable, add screenshots to help explain your problem.

mrlihellohorld commented 2 years ago

I imported a model, but there are no shadows. Can you help me with this, thanks

image

kwea123 commented 2 years ago

It is answered in the other thread. Please check there

shoutOutYangJie commented 2 years ago

It is answered in the other thread. Please check there

@kwea123 why don't you use "appearance embedding" for static MLP head?

xyz_encoding_final = self.xyz_encodingfinal(xyz) dir_encoding_input = torch.cat([xyz_encoding_final, input_dir_a], 1) dir_encoding = self.dir_encoding(dir_encoding_input) static_rgb = self.static_rgb(dir_encoding) # (B, 3) static = torch.cat([static_rgb, static_sigma], 1) # (B, 4)

shoutOutYangJie commented 2 years ago

@kwea123 do you have wechat? or your email? thanks .