microsoft / MixedReality-SceneUnderstanding-Samples

MIT License
53 stars 20 forks source link

Is it possible to load .obj file from storage localfolder? #19

Open SenthilvelGS opened 3 years ago

SenthilvelGS commented 3 years ago

The .obj file saved successfully after room scanning in WindowsStorage localfolder. I need to display saved obj file in runtime. But I could not access the hololens localfolder. So I tried another way, I uploaded the file to server. But my problem is I could not load obj file in app. Please give me a solution.

SzymonSPS commented 3 years ago

I'm not 100% sure if this will work, but UWP allows you to save to other more public folders, e.g. the pictures folder. You could modify the code to save there and then I assume your app can read it.

SenthilvelGS commented 3 years ago

OK. I successfully displayed the room scanned mesh in the hololens app. Now I am facing another issue, how to apply hololens camera live texture to spatial mesh. Any solution?

SzymonSPS commented 3 years ago

Nice! Texturing is a tricky thing, it's not something we have built in house. This is a deep and complex issue that is difficult to get right. There are open source implementations for some of this, but you will need to properly handle getting the RGB camera poses, filtering out frames with motion blur, etc...

It's a worthy undertaking and I hope you get good results. Multi-view stereo texturing is a search term that you can use to get started and I know some OSS projects exist that have started on this problem. Internally we do not have anything specific to share at this point but would love to know your scenarios to understand if this is worth investing in on our end.

adammartiska commented 2 years ago

I am trying to save my spatial mapped object, but when in any of scene I try to do voice command 'Save Data' I can't locate any object file when I access files from windows device portal. I am looking in the User Folders \ LocalAppData \ [nameofmyapp] \ AppData but it is empty. Does the data write only if I close the application? How do I event close the sample Understanding scene?

SzymonSPS commented 2 years ago

No, it should dump it right away.

You should see it in the folder similar to the one I post below, and you should see a bytes file and obj's. Are other voice commands working? We've seen cases where microphone permissions were disabled so it just wasn't getting the voice command.

image