StereoKit / StereoKit

An easy-to-use XR engine for building AR and VR applications with C# and OpenXR!
https://stereokit.net/Pages/Guides/Getting-Started.html
MIT License
944 stars 115 forks source link

H264 Video Playback #283

Open mosaviaDC opened 2 years ago

mosaviaDC commented 2 years ago

The problem is to play streaming h264 video coming over UDP, and send back data about the position of the head. For h264 playback, FFmpeginteropX works well in classic 2D UWP. The problem is to simultaneously send back data about the position of the head. Is it possible to somehow display the standard Media Player in stereo kit, or maybe there are other options for how to integrate FFmpegInteropX and StereoKit? Perhaps you can recommend something else to solve this problem?

With respect, Denis

maluoi commented 2 years ago

Hey, thanks for bringing this up! This sounds like a remote rendering sort of use case, is that right?

What platform are your running on? If this is HoloLens, would something like Holographic Remoting (#255) work for you instead, or are you mostly interested in video decode (#243)?

mosaviaDC commented 2 years ago

Sorry, for taking so long for answer Yes, I work with Hololens2 All I need is to play a live (raw h264 stream via UDP) video on a 3d object. I learned how to do this in collaboration with Unity. To do this, I use FFmpeginterop as a MediaSource, and then run MediaPlayer in frame server mode. It works really well, I will definitely try to do the same with stereokit. I hope the performance with stereo kit will be higher.

notpatern commented 1 month ago

Sorry, for taking so long for answer Yes, I work with Hololens2 All I need is to play a live (raw h264 stream via UDP) video on a 3d object. I learned how to do this in collaboration with Unity. To do this, I use FFmpeginterop as a MediaSource, and then run MediaPlayer in frame server mode. It works really well, I will definitely try to do the same with stereokit. I hope the performance with stereo kit will be higher.

Hi mosaviaDC!

Could you tell me how you plan on playing a video inside of Stereokit? I would very much appreciate if you could show me how you did that!