Rectus / openxr-steamvr-passthrough

OpenXR API Layer for SteamVR camera passthrough
MIT License
110 stars 5 forks source link

Open Brush stroke marks are visible on my laptop screen, but not in the headset #7

Open lexvandersluijs opened 1 year ago

lexvandersluijs commented 1 year ago

Hi, Thanks for this great work! Do have a question: I'm having some trouble getting Open Brush to work with this add-on....

Some info:

So, so far so good. But when I try the Open Brush app, I see my own live environment but no 3D elements. I can actually paint something, but this then appears in the VR disiplay on my laptop monitor, not in 3D.

While trying things, I think at some point I saw an option called "Passthrough" in a 3D menu in Open Brush, but since then it has disappeared and I can't find it again...

The fact that I can see 3D elements on the laptop screen but not in the headset leads me to the hypothesis that perhaps the camera image is being draw over the 3D world, instead of behind it? The blend mode that I see in the info panel is Alpha Blend. Changing this to another value does not solve the issue.

Any idea what might be causing this? Maybe it's caused by a change in Open Brush?

Late addition: when I check the box 'Force passthrough' and set the mode to Additive, I do see my drawings appear in MR, but the camera image is a bit washed out (due to the additive blending with the VR background of course). Perhaps this is how the tool is supposed to work at the moment?

Rectus commented 1 year ago

As far as I know, Open Brush has not added proper support for this yet, and are still working on it. For it to work properly, they will need to submit alpha channels with the frames to mask out what needs to be drawn over the passthough.

At the moment, the additive override is the best way to use it. It works best with a dark background and bright brushes.

ptc-lexvandersluijs commented 1 year ago

Ah, thanks, that's good to know!

Perhaps it's a good idea to add some text about this to the readme? If you want I can try to create a first version for this, just let me know.

Rectus commented 1 year ago

I'll have to think about how to document it best.