Streaming feature request list

[helenvarley]

These are the streaming features that we want to have in UpStage:

Must haves:

• [x] Jitsi integration (meeting and individual) stable and reliable for all players and audience; everyone (players and audience) seeing and hearing all streams at the same time
• [x] players and audience must be able to see and hear streams that have already been placed on the stage when they enter
• [x] ability for players to use OBS or similar software with the Jitsi streams
• [ ] ability to send an individual Jitsi stream or join an on-stage Jitsi meeting from a mobile phone - ideally without having to be on the stage on your phone as this is cumbersome - could it be done using the Jitsi mobile app or Larix broadcaster? this might also require another player to be able to put that stream onto the stage.
• [ ] volume control: currently the only way to adjust the volume of your stream is via the streaming device's sound settings, which is not very quick or intuitive. it would be good to have a volume and mute control clearly visible in the on-stage controls for your stream (the mute icon is confusing as it is a local mute, but players often assume they have muted their outgoing audio stream; a local mute feature is still necessary but needs to be more clearly signalled).

Nice to have:

• [ ] ability to change the shape of individual streams: currently it can be rectangular or oval; using OBS virtual camera enables it to be round.
• [ ] add a frame to the stream: this could be done with props, the same as the "add to avatar" feature, & would allow players to create their own frame for a stream, e.g. if they wanted it to appear to be in a window or on a screen or suchlike.
• [x] ability to stream a video e.g. from vimeo or youtube or your computer, via the individual jitsi stream (this might be achieved by being able to use OBS to send the stream)
• [ ] ability to show or hide the Jitsi toolbar (controls) for audience members when using the meeting tool.
• [ ] ability to have a Jitsi meeting that is only accessible to players.
• [ ] ability to invite specific audience members to join a player-only Jitsi meeting.
• [ ] when changing scenes, if a stream is in consecutive scenes then it should seamlessly continue across the scene change (understand that this may not be possible with the individual jitsi streams)

Use cases:

• four individual Jitsi streams are being sent from four different locations and there is an audience of 50 connected devices from around the world; everyone sees and hears all of the streams at the same time and in the same proportional sizes and positions on the stage.
• a performance involves two actors in different locations interacting in real time on the stage. they each use their individual jitsi stream, placed within the screenography of the stage. they need to be able to adjust their volume so that they are at similar levels.
• a player is using a mobile phone to send a stream while they are walking in the street; they need to be able to start, stop and manage the stream easily - more easily than is possible if they have to use the onstage tools on a small phone screen. Ideally they can use the Jitsi mobile app or Larix broadcaster to send their stream to UpStage, and another player can place that stream onto the stage.
• an audience member arrives late for a performance that involves streams; when they enter the stage, they see and hear the streams at the same place and time as everyone else who is already present on the stage, as if they had walked into a theatre and see what is going on.
• following a performance, the audience are invited to participate in a discussion using the Jitsi meeting tool. the players want to show or hide the Jitsi toolbar for audience participants, in order to manage when audience can ask their questions and to limit the chance of an audience member hanging up their Jitsi meeting (which leaves the audience member on stage but unable to see or hear the meeting unless they reload the stage).
• UpStage is being used for a panel discussion; the panel members are logged in as players, and open a Jitsi meeting that is only accessible to players, not audience members (who can interact as usual in the public chat).
• an audience member signals in the chat that they want to contribute something to the discussion; the player-moderator of the panel invites that specific audience member to join the Jitsi meeting. maybe this could be done through the drop-down menu showing nicknames of the audience?

[helenvarley]

i just updated this a bit as now with OBS virtual camera we have a lot more possibilities with the individual jitsi streams ... but the main problem is that they are not working properly ...

[helenvarley]

note: this has been superceded by #1331 and #1332 but i'm leaving it open at the moment for reference.