Voice/Video Conference Wishlist

uhoreg commented 7 years ago

Here are a bunch of things that I would like to see support for in conferencing, in order to support different uses.

[ ] ability to join a conference as a passive participant (not sending any voice or video -- is this already possible?)
[ ] require a certain power level to speak (e.g. for online presentations/lectures, where generally only the presenter speaks, but can also allow others to speak when needed, such as for asking questions)
[ ] require a certain power level to send in video
[ ] have an indicator for who is speaking (e.g. having a "foo is speaking" line in the status bar, similar to the typing indicator)
[ ] allow moderators to mute people (telling a user's client to mute itself -- this is mainly intended as a convenience function (e.g. person has stepped away from their device and a baby starts crying loudly) and can be overridden by the user)
[ ] persistent conferences (conferences that don't disappear when the last person leaves)
[ ] require a certain power level to start a conference
[ ] ability to upload a pdf/odp/ppt/etc. and use it as your "video" e.g. for presenting slides in online presentations (the same effect could be obtained by screen-sharing a viewer program, but by uploading a file and signalling to clients which slide to view, you would get both better quality and lower bandwidth usage)
[ ] option to auto-enter a voice/video conference (as a listener or as a participant) when clicking on a room (so you don't have to click the voice or video button to join)

Additional suggestions from the comments below:

[ ] ability to invite others by sending them a link without requiring a Matrix account (similar to meet.jit.si or appear.in)
[ ] allow controlling the volume of each speaker
[ ] push-to-talk
[ ] send-to-voice-detection
[ ] adaptive bandwidth management
[ ] ability to send multiple streams from a single client (e.g. screen sharing and webcam)

richvdh commented 7 years ago

See also vector-im/element-web#1869

MightyCreak commented 7 years ago

I would add screen-sharing. This is mainly why we are still using Skype at work (there might be other solutions, but that is not the question). Surprisingly, Slack doesn't have that yet either. Screen-sharing is extremely useful: for peer-reviewing, for explaining something that is easier to explain when seen, etc...

uhoreg commented 7 years ago

@MightyCreak screen-sharing already exists, although it is hidden (Shift-click on the video call button), and it requires special things to be done for the browser to allow it (setting a config option in Firefox (#1312) and either a command-line argument or a custom extension (#238) for Chrome). However, it should just work in the desktop version.

ghost commented 7 years ago

My wishlist: I'd like to be able to create a conference (messages and voice) that I could send to people, that wouldn't require creating an account. Or in other words, the same thing that Discord has, but free software and perhaps also E2E.

ara4n commented 7 years ago

These are all excellent wishes. Right now we're focused on making it work at all(!), and have just kicked off work on a new conferencing server which can hopefully evolve in this direction. It's based on our old pre-Matrix proprietary codebase, but we're assuming we'll FOSS it if it works out okay. @superdump has the conn here :)

PureTryOut commented 7 years ago

It would also be nice to be able to control volume per person (user setting). From what I heard right now all streams are mixed into 1 by the homeserver, so I guess that new conferencing server could help in this.

And of course simple things like push to talk and send-on-voice-detection (although I'm not sure if the latter is possible within a web-app).

schnuffle commented 7 years ago

One thing that IMHO is quite important is adaptive bandwidth management. What I mean with that is that the Voice/Video part should be able to adapt to bandwidth restrictions ( static or dynamic ) by scaling the codec bandwidth used to encode the data.

albuic commented 7 years ago

Ability to share screen and video at the same time

heyakyra commented 7 years ago

I'd really like to see https://github.com/jitsi/jitsi-meet/issues/688 and https://github.com/jitsi/jitsi-meet/issues/30 but AIUI they would have to be handled upstream

Should this and vector-im/element-web#1869 be merged into vector-im/element-meta#1482?

uhoreg commented 7 years ago

IMHO, this, vector-im/element-web#1869, and vector-im/element-meta#1482 have slightly different scopes. vector-im/element-meta#1482 seems to be more about 1:1 calls, vector-im/element-web#1869 seems to be mostly about improving quality, while this issue is more of a long-term wishlist.

heyakyra commented 7 years ago

@uhoreg ah, that makes sense. has the new Jitsi integration taken care of any of the items listed in these three issues?

uhoreg commented 7 years ago

I haven't tried the Jitsi integration, so I don't know, but looking over this list, it doesn't look like much has been fixed, aside from "ability to invite others by sending them a link without requiring a Matrix account (similar to meet.jit.si or appear.in)" (though I don't know how discoverable the link is, so it might be better to leave that open), and maybe "adaptive bandwidth management", if Jitsi does that. @superdump would probably know better, especially regarding whether any of the issues from vector-im/element-web#1869 are fixed.

BloodyIron commented 6 years ago

So how soon before we can get push to talk or other stuff hammered out? Last update was Sept of last year (2017).

BloodyIron commented 6 years ago

Not sure how I unassigned @superdump ?_?

ara4n commented 6 years ago

i think that's a bug in github. @superdump is sadly no longer part of the matrix core team, and GH presumably only just noticed and unassigned. right now we're not working on new features but prioritising getting the current ones polished and stable to a 1.0 release.

BloodyIron commented 6 years ago

@ara4n is there a target timeline for 1.0 release? PTT is pretty paramount for a lot of riot usage that I and others are looking to do.

heyakyra commented 6 years ago

This looks interesting (video transport architecture that outperforms WebRTC, Skype, FaceTime, Hangouts, etc), albeit probably something that would need to be done upstream: https://snr.stanford.edu/salsify/

I filed an issue against Jitsi-Meet to look into it: https://github.com/jitsi/jitsi-meet/issues/2819

MurzNN commented 6 years ago

Screen Sharing feature implemented more that year ago, but why it still hidden via Shift+click hack? Will be good to merge two buttons (Voice call, Video call) into one button, and create the popup menu with available modes: Audio call, Video call, Screen share.

PureTryOut commented 6 years ago

Well, I believe the default VoIP and video call systems are to be replaced by Jitsi, which already has screen sharing working as well. Wouldn't make sense imo to spend effort on the old system if it's going to be replaced (and already is on mobile) anyway.

BloodyIron commented 6 years ago

Wait, it's a hidden feature? WUT? Is the current screen sharing Jitsi or Freeswitch, or what?

MurzNN commented 6 years ago

Jitsi widget is too hard to find for regular users, so all use "Video call" button near to file upload. And using it there are no way to switch between camera & screen sharing, we can only initiate screen sharing call via shift+click, but nowhere is written about this in Riot interface. So hope that in near future this button in Riot will be binded to Jitsi widget.

syhe commented 6 years ago

Does moving to Jitsi mean that for private, isolated (not federated, not relying on any external infrastructure) homeservers you need to setup an integration server (or possibly use vector.im) to get screen sharing to work?

akontsevich commented 6 years ago

but why it still hidden via Shift+click hack?

Definitely: why?! Where to Shift-click to activate it? Ha, found: Shift-click on camera call.

weeman1337 commented 3 years ago

Moderators

At the moment the user starting the conference becomes the moderator.
→ It would be great if additionally room moderators and up (e.g. admins) become conference moderators.

Thatoo commented 2 years ago

As explain in here, Native Group Voice/Video Conferencing is coming and this is very exciting.

I would like to write some wishes I have for this native video conferencing system :

allow whiteboard for participant to collaborate such as https://wbo.ophir.dev/?lang=en
and post-ip board such as http://scrumblr.ca/
upload a file (pdf...) that would be a presentation support
being able to draw/write on this presentation support
giving the right to a participant to share his/her screen : https://github.com/vector-im/element-web/issues/16583
allow all participant to draw/write on the shared screen (to explain something)
allow screensharing of this whiteboard, shared screen
a minor option would be to allow record of the conference too

BloodyIron commented 2 years ago

Can we PLEASE get Push To Talk?

heyakyra commented 2 years ago

@BloodyIron that's been requested here: https://github.com/vector-im/matrix-video-chat/issues/202

BloodyIron commented 2 years ago

Actually it was originally requested, by me, over 4 years ago, here : https://github.com/vector-im/element-web/issues/5993

Also, vector-im/element-web#202 was closed.

I have also brought up the request in vector-im/element-web#218 since that may be the latest issue on the matter.

HarHarLinks commented 2 years ago

The fact that you need a camera to even get the option to share your screen is pretty annoying and an artificial limit that doesn't make much sense.

element-hq / element-meta

Voice/Video Conference Wishlist #1487