search

rerun-io / rerun

Visualize streams of multimodal data. Fast, easy to use, and simple to integrate. Built in Rust using egui.
https://rerun.io/
Apache License 2.0
6.41k stars 312 forks source link

Support ui-interaction with video #7353

Closed jprochazk closed 3 weeks ago

jprochazk commented 1 month ago

We have video frames available in regular GPU textures, so we should be able to do GPU picking for hover UIs

Wumpf commented 1 month ago

What's the task here exactly? We don't have gpu picking for images either at all, so what do we want to accomplish here? I.e. what's the ui outcome we're lacking and wanting to achieve here?

emilk commented 1 month ago

There is several steps here:

A) support clicking videos to select them B) showing a magnification of the video on hover C) actual color picking on hover (read exact RGB value)

Only C requires reading back the texture to CPU, and is also the least important