search

microsoft / HoloLens2ForCV

Sample code and documentation for using the Microsoft HoloLens 2 for Computer Vision research.
MIT License
480 stars 145 forks source link

Frame rates from StreamRecorder application #60

Open cgsaxner opened 3 years ago

cgsaxner commented 3 years ago

Hello, after looking more closely at the timestamps of frames recorded by the StreamRecorder application, I noticed that the frame rates from research mode sensors are highly fluctuating. While the PV camera very reliably delivers a frame every 33 ms or so, the time delta between research mode frames (looking at AHAT, LF and RF at the moment) are frequently much bigger (around 100 ms or even up to 500 or 1000 ms) and are constantly changing. This makes it very difficult to work with the data if one requires synchronized frames. My question is, is this due to the processing / architecture of the StreamRecorder (and could therefore be improved), or is this just how the frames arrive from the sensors? Thanks

dorinung commented 3 years ago

Camera frame delivery rates are sensitive to CPU/IO load and device temperatures. Frame delivery is not guaranteed to be at camera frame rates. Could you please try the SensorVisualization app to compare frame rates? The SensorVisualization app only renders frames so some extra code will be needed to calculate and save frame rates. For StreamRecorder you can also experiment with the number of streams recorded.