TUM-Dev / gocast

TUMs lecture streaming service.
https://live.rbg.tum.de/
MIT License
177 stars 41 forks source link

Automatischer Tafelwechsel (via Motion Tracking ?) #1220

Open MarkusMuhr opened 8 months ago

MarkusMuhr commented 8 months ago

Is your feature request related to a problem? Please describe. Not really a problem, but it would give a huge convenience boost. Currently in MW0001 when the Prof. switches from one side of the blackboard to the other, the camera has to adjusted manually to switch sides as well (the total view is too "far away" to read anything). However, often the manual switch is forgotten.

Describe the solution you'd like An automatic solution, that switches the camera setting from one blackboard side to the other, whenever the Prof. switches :) maybe by tracking his/her motion resp. the absence of motion for some time.

Describe alternatives you've considered Alternatively, could one install a button + a light in the lecture hall, such that stream viewer who recognize the wrong camera setting can click this button and the light falshes in the lecture hall, such that the Prof. is notified about the issue and can again switch manually.

Additional context

moba15 commented 7 months ago

@SebiWrn was für dich? Vielleicht auch erstmal nur mit einer Auswahl der verschiedenen Kameraansichten, damit man selber wechseln kann?

hmelder commented 7 months ago

@moba15 This is not a digital but physical zoom, switching views is not possible. I think that person tracking by itself is not that straightforward.

What if the lecturer walks a way from the blackboard? Should we follow him, or have a cutoff to maintain a view of the blackboard? How do we integrate this in the media controller? Not everyone wants camera tracking enabled. What algorithm/neural network and hardware do we use? The list goes on...

Mjaethers commented 7 months ago

Perhaps something like this could be part of an overall lecturer dashboard, such as what was suggested in #127, specifically this.