microsoft / ailab

Experience, Learn and Code the latest breakthrough innovations with Microsoft AI
https://www.ailab.microsoft.com/experiments/
MIT License
7.69k stars 1.39k forks source link

VirtualStage unusable matte results #125

Open MiloMindbender opened 3 years ago

MiloMindbender commented 3 years ago

Hi, was finally able to get the Virtual Stage to run but I'm getting mattes that are completely unusable. The setup is I'm standing in front of a green screen, wearing a bluejean shirt and pants. It has successfully eliminated the entire background and seems to be keeping skintones alright, but there are big holes in my shirt and pants. Any idea what's going on?

See attached pictures. vlcsnap-2020-10-12-13h36m37s588 vlcsnap-2020-10-12-13h37m32s334

enquel commented 3 years ago

@MiloMindbender maybe the training data are not suitable for green screen but for a "casual" background? Do you observe the same with non-solid background?

BTW, have you encountered the issue mentioned here:

https://github.com/microsoft/ailab/issues/127#issue-725554407