cboulay
commented
6 years ago Are you using Unity? If you have control over the VR app, then you should have your VR app stream out events over LSL. Include as many events as are necessary to completely reconstruct what happened in your app. You should do this whether or not you save the video of what's presented on the monitor.
As for saving the video of what's presented, that's possible, but it's not very efficient and it might miss things (audio, any other info if the user isn't looking at what they're supposed to). If you do go that route, the easiest thing to do would be to use Open Broadcaster Software to capture the computer monitor to a video file and then later do post hoc synchronization. You can even do this with a plugin specifically for openvr here. You'll need some in-video events that are also timestamped in the LSL stream to be able to synchronize them properly.
A more difficult solution is the one you are hinting at. I think the simplest way to get video frames onto a stream would be to write a plugin for OBS to stream video to LSL. This would be pretty useful in many contexts, actually. However, that being said, if you wanted full framerate full resolution VR video, that's 233 MB/s, minimum, and I don't think your network could handle that.
tstenner
Hello together, WE are currently setting up a VR-lab that we would like to use for psychotherapeutic purposes. To cut things short, during our VR-stimulation sessions we would like to also collect electrophysiological data. I am therefore wondering whether there is a possibility to somehow record the VR-stream (what is presented over the HTC vive) via LSL? Moreover, I am wondering whether collecting such streaming data would cause any recoding problems for LSL?
I would be very thankful for your help. Cheers Niclas