search

sarafridov / K-Planes

Other
477 stars 47 forks source link

training on black background videos #17

Closed y-zheng18 closed 1 year ago

y-zheng18 commented 1 year ago

Hi, thanks for your great work! I'm trying to play with the repo, and I found that when I trained the model with RGBA images as follows, it worked fine. r_000

But when I replace the data with RGB files as follows, the novel view synthesis results are broken. r_000 I tried to set bg_ground color as 0 here, but then it turned out that the network can't convergence during training (everything is black). What might be the solution?

sarafridov commented 1 year ago

If I understand correctly, you are trying to train with input images that are RGB with black background, but no explicit alpha channel. Is it possible that the dataloader mistakenly thinks that your alpha channel is all zeros? Then it would fill in the background with 0 and train on images that are all black. That doesn't seem super likely but it's worth checking and easy to fix by just adding an alpha channel that's all ones (and keeping bg_color=0). I'm not sure what else would cause this.