search

benzea / gnome-network-displays

Miracast implementation for GNOME
GNU General Public License v3.0
368 stars 39 forks source link

CRITICAL: gst_vaapi_display_has_opengl: #69

Closed HTWDD-SN closed 4 years ago

HTWDD-SN commented 5 years ago

I use Ubuntu 19.10 with Microsoft Display Adapter v2. Unfortunately the following error message I can't decode:

(gnome-network-displays:2734): WARNING : 08:20:37.916: Error calling DBus method during Screencast portal initialization: GDBus.Error:org.freedesktop.DBus.Error.UnknownMethod: No such interface “org.freedesktop.portal.ScreenCast” on object at path /org/freedesktop/portal/desktop

(gnome-network-displays:2734): WARNING : 08:20:37.916: Error initing screencast portal: GDBus.Error:org.freedesktop.DBus.Error.UnknownMethod: No such interface “org.freedesktop.portal.ScreenCast” on object at path /org/freedesktop/portal/desktop

(gnome-network-displays:2734): WARNING : 08:20:37.916: Screencasting portal is unavailable! It is required to select the monitor to stream!

(gnome-network-displays:2734): WARNING : 08:20:37.916: Falling back to X11! You need to fix your setup to avoid issues (XDG Portals and/or mutter screencasting support)!

(gnome-network-displays:2734): WARNING : 08:20:52.928: WfdClient: No resolution found, falling back to standard FullHD resolution. jvogt@inote72:~/Dokumente/gnome-network-displays/build/src$ sudo apt install gstreamer1.0-pipewire [sudo] Passwort für jvogt: jvogt@inote72:~/Dokumente/gnome-network-displays/build/src$ G_MESSAGES_DEBUG=all ./gnome-network-displays (gnome-network-displays:4082): GLib-GIO-DEBUG: 08:23:37.627: _g_io_module_get_default: Found default implementation gvfs (GDaemonVfs) for ‘gio-vfs’ (gnome-network-displays:4082): Gtk-DEBUG: 08:23:37.695: Connecting to session manager (gnome-network-displays:4082): DEBUG: 08:23:37.772: WFDP2PRegistry: Found a new device, creating provider (gnome-network-displays:4082): DEBUG: 08:23:37.772: WfdP2PProvider: Discover is now set to 1 (gnome-network-displays:4082): DEBUG: 08:23:37.773: NdScreencastPortal: Aquired Portal proxy (gnome-network-displays:4082): DEBUG: 08:23:37.773: task is: 0x55f9b39501a0

(gnome-network-displays:4082): WARNING : 08:23:37.775: Error calling DBus method during Screencast portal initialization: GDBus.Error:org.freedesktop.DBus.Error.UnknownMethod: No such interface “org.freedesktop.portal.ScreenCast” on object at path /org/freedesktop/portal/desktop

(gnome-network-displays:4082): WARNING : 08:23:37.776: Error initing screencast portal: GDBus.Error:org.freedesktop.DBus.Error.UnknownMethod: No such interface “org.freedesktop.portal.ScreenCast” on object at path /org/freedesktop/portal/desktop

(gnome-network-displays:4082): WARNING : 08:23:37.776: Screencasting portal is unavailable! It is required to select the monitor to stream!

(gnome-network-displays:4082): WARNING : 08:23:37.776: Falling back to X11! You need to fix your setup to avoid issues (XDG Portals and/or mutter screencasting support)! (gnome-network-displays:4082): DEBUG: 08:23:37.776: WFDP2PRegistry: Got NMClient (gnome-network-displays:4082): DEBUG: 08:23:37.779: NdPulseaudio: Querying sink info by name (gnome-network-displays:4082): DEBUG: 08:23:37.779: NdPulseaudio: Error querying sink info (gnome-network-displays:4082): DEBUG: 08:23:37.779: NdPulseaudio: Got a sink info for the expected name (gnome-network-displays:4082): DEBUG: 08:23:41.876: WFDP2PProvider: Found a new sink with peer 0x55f9b39cfa20 on device 0x55f9b39c8300 (gnome-network-displays:4082): DEBUG: 08:23:41.876: SinkList: Adding a sink (gnome-network-displays:4082): DEBUG: 08:23:47.841: Found x264enc for video encoding. (gnome-network-displays:4082): DEBUG: 08:23:47.841: Found vaapih264enc for video encoding. (gnome-network-displays:4082): DEBUG: 08:23:47.841: Found avenc_aac for audio encoding. (gnome-network-displays:4082): DEBUG: 08:23:47.843: Got state change notification from streaming sink to state ND_SINK_STATE_WAIT_P2P (gnome-network-displays:4082): DEBUG: 08:23:47.844: WfdP2PProvider: Discover is now set to 0 (gnome-network-displays:4082): DEBUG: 08:23:47.878: NdWfdP2PSink: Got P2P connection (gnome-network-displays:4082): DEBUG: 08:23:47.879: Found x264enc for video encoding. (gnome-network-displays:4082): DEBUG: 08:23:47.879: Found vaapih264enc for video encoding. (gnome-network-displays:4082): DEBUG: 08:23:47.879: Found avenc_aac for audio encoding. (gnome-network-displays:4082): DEBUG: 08:23:47.879: Got state change notification from streaming sink to state ND_SINK_STATE_WAIT_SOCKET (gnome-network-displays:4082): DEBUG: 08:23:53.217: NdWfdP2PSink: Got client connection (gnome-network-displays:4082): DEBUG: 08:23:53.218: Got state change notification from streaming sink to state ND_SINK_STATE_WAIT_STREAMING (gnome-network-displays:4082): DEBUG: 08:23:53.770: WfdClient: OPTIONS querying done (gnome-network-displays:4082): DEBUG: 08:23:53.770: WFD query params (gnome-network-displays:4082): DEBUG: 08:23:53.853: WfdClient: GET_PARAMS done (gnome-network-displays:4082): DEBUG: 08:23:53.853: Add audio codec to params: (gnome-network-displays:4082): DEBUG: 08:23:53.853: WfdAudioCodec: LPCM, 3, latency: 0 (gnome-network-displays:4082): DEBUG: 08:23:53.853: Add audio codec to params: (gnome-network-displays:4082): DEBUG: 08:23:53.853: WfdAudioCodec: AAC, 1, latency: 0 (gnome-network-displays:4082): DEBUG: 08:23:53.854: Add audio codec to params: (gnome-network-displays:4082): DEBUG: 08:23:53.854: WfdAudioCodec: AC3, 0, latency: 0 (gnome-network-displays:4082): DEBUG: 08:23:53.854: Add codec to params: (gnome-network-displays:4082): DEBUG: 08:23:53.854: WfdVideoCodec: (gnome-network-displays:4082): DEBUG: 08:23:53.854: * profile: 2 (gnome-network-displays:4082): DEBUG: 08:23:53.854: * level: 4 * (gnome-network-displays:4082): DEBUG: 08:23:53.854: native: 1920x1080 60p (gnome-network-displays:4082): DEBUG: 08:23:53.854: Supported resolutions: (gnome-network-displays:4082): DEBUG: 08:23:53.854: * 800x480 30p * (gnome-network-displays:4082): DEBUG: 08:23:53.854: 800x480 60p (gnome-network-displays:4082): DEBUG: 08:23:53.854: * 854x480 30p (gnome-network-displays:4082): DEBUG: 08:23:53.854: * 854x480 60p * (gnome-network-displays:4082): DEBUG: 08:23:53.854: 864x480 30p (gnome-network-displays:4082): DEBUG: 08:23:53.854: * 864x480 60p (gnome-network-displays:4082): DEBUG: 08:23:53.854: * 640x360 30p * (gnome-network-displays:4082): DEBUG: 08:23:53.854: 640x360 60p (gnome-network-displays:4082): DEBUG: 08:23:53.854: * 960x540 30p (gnome-network-displays:4082): DEBUG: 08:23:53.854: * 960x540 60p * (gnome-network-displays:4082): DEBUG: 08:23:53.854: 848x480 30p (gnome-network-displays:4082): DEBUG: 08:23:53.854: * 848x480 60p (gnome-network-displays:4082): DEBUG: 08:23:53.854: * 640x480 60p * (gnome-network-displays:4082): DEBUG: 08:23:53.854: 720x480 60p (gnome-network-displays:4082): DEBUG: 08:23:53.854: * 720x576 50p (gnome-network-displays:4082): DEBUG: 08:23:53.854: * 1280x720 30p * (gnome-network-displays:4082): DEBUG: 08:23:53.854: 1280x720 60p (gnome-network-displays:4082): DEBUG: 08:23:53.854: * 1920x1080 30p (gnome-network-displays:4082): DEBUG: 08:23:53.854: * 1290x720 25p * (gnome-network-displays:4082): DEBUG: 08:23:53.854: 1280x720 50p (gnome-network-displays:4082): DEBUG: 08:23:53.854: * 1920x1080 25p (gnome-network-displays:4082): DEBUG: 08:23:53.854: * 1280x720 24p * (gnome-network-displays:4082): DEBUG: 08:23:53.854: 1920x1080 25p (gnome-network-displays:4082): DEBUG: 08:23:53.854: * 800x600 30p (gnome-network-displays:4082): DEBUG: 08:23:53.854: * 800x600 60p * (gnome-network-displays:4082): DEBUG: 08:23:53.854: 1024x768 30p (gnome-network-displays:4082): DEBUG: 08:23:53.854: * 1024x768 60p (gnome-network-displays:4082): DEBUG: 08:23:53.854: * 1152x864 30p * (gnome-network-displays:4082): DEBUG: 08:23:53.855: 1152x864 60p (gnome-network-displays:4082): DEBUG: 08:23:53.855: * 1280x768 30p (gnome-network-displays:4082): DEBUG: 08:23:53.855: * 1280x768 60p * (gnome-network-displays:4082): DEBUG: 08:23:53.855: 1280x800 30p (gnome-network-displays:4082): DEBUG: 08:23:53.855: * 1280x800 60p (gnome-network-displays:4082): DEBUG: 08:23:53.855: * 1360x768 30p * (gnome-network-displays:4082): DEBUG: 08:23:53.855: 1360x768 60p (gnome-network-displays:4082): DEBUG: 08:23:53.855: * 1366x768 30p (gnome-network-displays:4082): DEBUG: 08:23:53.855: * 1366x768 60p * (gnome-network-displays:4082): DEBUG: 08:23:53.855: 1280x1024 30p (gnome-network-displays:4082): DEBUG: 08:23:53.855: * 1440x900 30p (gnome-network-displays:4082): DEBUG: 08:23:53.855: * 1440x900 60p * (gnome-network-displays:4082): DEBUG: 08:23:53.855: 1600x900 30p (gnome-network-displays:4082): DEBUG: 08:23:53.855: * 1600x900 60p (gnome-network-displays:4082): DEBUG: 08:23:53.855: * 1680x1024 30p * (gnome-network-displays:4082): DEBUG: 08:23:53.855: 1680x1050 30p (gnome-network-displays:4082): DEBUG: 08:23:53.855: Add codec to params: (gnome-network-displays:4082): DEBUG: 08:23:53.855: WfdVideoCodec: (gnome-network-displays:4082): DEBUG: 08:23:53.855: * profile: 1 (gnome-network-displays:4082): DEBUG: 08:23:53.855: * level: 4 * (gnome-network-displays:4082): DEBUG: 08:23:53.855: native: 1920x1080 60p (gnome-network-displays:4082): DEBUG: 08:23:53.855: Supported resolutions: (gnome-network-displays:4082): DEBUG: 08:23:53.855: * 800x480 30p * (gnome-network-displays:4082): DEBUG: 08:23:53.855: 800x480 60p (gnome-network-displays:4082): DEBUG: 08:23:53.855: * 854x480 30p (gnome-network-displays:4082): DEBUG: 08:23:53.855: * 854x480 60p * (gnome-network-displays:4082): DEBUG: 08:23:53.855: 864x480 30p (gnome-network-displays:4082): DEBUG: 08:23:53.855: * 864x480 60p (gnome-network-displays:4082): DEBUG: 08:23:53.855: * 640x360 30p * (gnome-network-displays:4082): DEBUG: 08:23:53.855: 640x360 60p (gnome-network-displays:4082): DEBUG: 08:23:53.855: * 960x540 30p (gnome-network-displays:4082): DEBUG: 08:23:53.855: * 960x540 60p * (gnome-network-displays:4082): DEBUG: 08:23:53.855: 848x480 30p (gnome-network-displays:4082): DEBUG: 08:23:53.855: * 848x480 60p (gnome-network-displays:4082): DEBUG: 08:23:53.855: * 640x480 60p * (gnome-network-displays:4082): DEBUG: 08:23:53.855: 720x480 60p (gnome-network-displays:4082): DEBUG: 08:23:53.855: * 720x576 50p (gnome-network-displays:4082): DEBUG: 08:23:53.856: * 1280x720 30p * (gnome-network-displays:4082): DEBUG: 08:23:53.856: 1280x720 60p (gnome-network-displays:4082): DEBUG: 08:23:53.856: * 1920x1080 30p (gnome-network-displays:4082): DEBUG: 08:23:53.856: * 1290x720 25p * (gnome-network-displays:4082): DEBUG: 08:23:53.856: 1280x720 50p (gnome-network-displays:4082): DEBUG: 08:23:53.856: * 1920x1080 25p (gnome-network-displays:4082): DEBUG: 08:23:53.856: * 1280x720 24p * (gnome-network-displays:4082): DEBUG: 08:23:53.856: 1920x1080 25p (gnome-network-displays:4082): DEBUG: 08:23:53.856: * 800x600 30p (gnome-network-displays:4082): DEBUG: 08:23:53.856: * 800x600 60p * (gnome-network-displays:4082): DEBUG: 08:23:53.856: 1024x768 30p (gnome-network-displays:4082): DEBUG: 08:23:53.856: * 1024x768 60p (gnome-network-displays:4082): DEBUG: 08:23:53.856: * 1152x864 30p * (gnome-network-displays:4082): DEBUG: 08:23:53.856: 1152x864 60p (gnome-network-displays:4082): DEBUG: 08:23:53.856: * 1280x768 30p (gnome-network-displays:4082): DEBUG: 08:23:53.856: * 1280x768 60p * (gnome-network-displays:4082): DEBUG: 08:23:53.856: 1280x800 30p (gnome-network-displays:4082): DEBUG: 08:23:53.856: * 1280x800 60p (gnome-network-displays:4082): DEBUG: 08:23:53.856: * 1360x768 30p * (gnome-network-displays:4082): DEBUG: 08:23:53.856: 1360x768 60p (gnome-network-displays:4082): DEBUG: 08:23:53.856: * 1366x768 30p (gnome-network-displays:4082): DEBUG: 08:23:53.856: * 1366x768 60p * (gnome-network-displays:4082): DEBUG: 08:23:53.856: 1280x1024 30p (gnome-network-displays:4082): DEBUG: 08:23:53.856: * 1440x900 30p (gnome-network-displays:4082): DEBUG: 08:23:53.856: * 1440x900 60p * (gnome-network-displays:4082): DEBUG: 08:23:53.856: 1600x900 30p (gnome-network-displays:4082): DEBUG: 08:23:53.856: * 1600x900 60p * (gnome-network-displays:4082): DEBUG: 08:23:53.856: 1680x1024 30p * (gnome-network-displays:4082): DEBUG: 08:23:53.856: 1680x1050 30p

(gnome-network-displays:4082): WARNING : 08:23:53.856: WfdClient: No resolution found, falling back to standard FullHD resolution. (gnome-network-displays:4082): DEBUG: 08:23:53.856: selected resolution 1920, 1080 @30 (gnome-network-displays:4082): DEBUG: 08:23:53.860: WfdClient: SET_PARAMS done (gnome-network-displays:4082): DEBUG: 08:23:53.865: WfdClient: Initialization done! (gnome-network-displays:4082): DEBUG: 08:23:53.867: use x11: 1 (gnome-network-displays:4082): DEBUG: 08:23:53.958: WfdMedia init: Got 1 streams (gnome-network-displays:4082): DEBUG: 08:23:54.083: An audiocodec has been selected: yes

(gnome-network-displays:4082): CRITICAL : 08:23:56.406: gst_vaapi_display_has_opengl: assertion 'display != NULL' failed (gnome-network-displays:4082): DEBUG: 08:23:58.530: NdWfdP2PSink: Got play request from client (gnome-network-displays:4082): DEBUG: 08:23:58.530: Got state change notification from streaming sink to state ND_SINK_STATE_STREAMING ** Pango:ERROR:../pango/pango-layout.c:3871:pango_layout_check_lines: assertion failed: (!layout->log_attrs) Bail out! Pango:ERROR:../pango/pango-layout.c:3871:pango_layout_check_lines: assertion failed: (!layout->log_attrs) Abgebrochen (Speicherabzug geschrieben)

benzea commented 4 years ago

This might be a gstreamer bug.

One thing you can try is running with NETWORK_DISPLAYS_H264_ENC=openh264enc gnome-network-displays. If you do that, a different video encoder will be used, which may work around the issue.

benzea commented 4 years ago

Also, could you try running:

gst-launch-1.0 videotestsrc ! videoconvert ! vaapih264enc ! fakesink

This will just hang there and encode a test video stream (and throw it away). If that has an issue, then we are dealing with a bug outside of gnome-network-displays.

IGNNE commented 4 years ago

Maybe related to this? https://github.com/benzea/gnome-network-displays/issues/71#issuecomment-560432092

HTWDD-SN commented 4 years ago

Thanx! The choice of openh264enc works. But after about 30s the streaming ends:

(gnome-network-displays:6955): WARNING : 12:16:25.609: Falling back to X11! You need to fix your setup to avoid issues (XDG Portals and/or mutter screencasting support)!

(gnome-network-displays:6955): WARNING : 12:16:38.874: WfdClient: No resolution found, falling back to standard FullHD resolution.

(gnome-network-displays:6955): CRITICAL : 12:16:41.151: gst_vaapi_display_has_opengl: assertion 'display != NULL' failed

(gnome-network-displays:6955): WARNING : 12:17:15.652: WfdClient: No resolution found, falling back to standard FullHD resolution.

(gnome-network-displays:6955): CRITICAL : 12:17:17.986: gst_vaapi_display_has_opengl: assertion 'display != NULL' failed Warning from pulseaudio-source: Der Ton kann nicht schnell genug aufgezeichnet werden Warning from pulseaudio-source: Der Ton kann nicht schnell genug aufgezeichnet werden

(gnome-network-displays:6955): GLib-GObject-CRITICAL **: 12:18:13.808: g_binding_unbind: assertion 'G_IS_BINDING (binding)' failed

benzea commented 4 years ago 
(gnome-network-displays:6955): GLib-GObject-CRITICAL **: 12:18:13.808: g_binding_unbind: assertion 'G_IS_BINDING (binding)' failed

I fixed that unrelated CRITICAL. Am I done now? ;-)

Seriously though, a number of people have repoted issues like that e.g. #20. Unfortunately, I have never seen such an issue myself, and I could not figure out what is going on so far.

I'll close this bug, assuming the CRITICAL you are seeing is actually in gstreamer or vaapi somewhere. It would probably a good idea if you still try the gst-launch command from above and check what happens.

HTWDD-SN commented 4 years ago

I tried gst-launch: (is this correct?)

gst-launch-1.0 videotestsrc ! videoconvert ! vaapih264enc ! fakesink Leitung wird auf PAUSIERT gesetzt ... Leitung läuft vor … Kontext von Element »vaapiencodeh264-0« erhalten: gst.vaapi.Display=context, gst.vaapi.Display=(GstVaapiDisplay)"(GstVaapiDisplayGLX)\ vaapidisplayglx0"; Leitung ist vorgelaufen … Leitung wird auf ABSPIELEN gesetzt ... New clock: GstSystemClock

IGNNE commented 4 years ago

Same here, so it's not a vaapi problem. I wonder why you still have vaapi problems with openh264? Maybe try with x264 as in the issue I mentioned?

HTWDD-SN commented 4 years ago

Maybe I got the problem, the keep alive is not working, see below: (openh264enc is not working in Ubuntu 19.10, it always uses x264)

NETWORK_DISPLAYS_H264_ENC=openh264enc G_MESSAGES_DEBUG=all ./gnome-network-displays (gnome-network-displays:5452): GLib-GIO-DEBUG: 15:44:45.535: _g_io_module_get_default: Found default implementation gvfs (GDaemonVfs) for ‘gio-vfs’ (gnome-network-displays:5452): Gtk-DEBUG: 15:44:45.715: Connecting to session manager (gnome-network-displays:5452): DEBUG: 15:44:45.839: WFDP2PRegistry: Found a new device, creating provider (gnome-network-displays:5452): DEBUG: 15:44:45.839: WfdP2PProvider: Discover is now set to 1 (gnome-network-displays:5452): DEBUG: 15:44:45.842: NdScreencastPortal: Aquired Portal proxy (gnome-network-displays:5452): DEBUG: 15:44:45.843: task is: 0x55c69c9cc9a0 ** (gnome-network-displays:5452): DEBUG: 15:44:45.844: WFDP2PRegistry: Got NMClient

(gnome-network-displays:5452): WARNING : 15:44:45.844: Error calling DBus method during Screencast portal initialization: GDBus.Error:org.freedesktop.DBus.Error.UnknownMethod: No such interface “org.freedesktop.portal.ScreenCast” on object at path /org/freedesktop/portal/desktop

(gnome-network-displays:5452): WARNING : 15:44:45.844: Error initing screencast portal: GDBus.Error:org.freedesktop.DBus.Error.UnknownMethod: No such interface “org.freedesktop.portal.ScreenCast” on object at path /org/freedesktop/portal/desktop

(gnome-network-displays:5452): WARNING : 15:44:45.844: Screencasting portal is unavailable! It is required to select the monitor to stream!

(gnome-network-displays:5452): WARNING : 15:44:45.844: Falling back to X11! You need to fix your setup to avoid issues (XDG Portals and/or mutter screencasting support)! (gnome-network-displays:5452): DEBUG: 15:44:45.850: NdPulseaudio: Querying sink info by name (gnome-network-displays:5452): DEBUG: 15:44:45.851: NdPulseaudio: Error querying sink info (gnome-network-displays:5452): DEBUG: 15:44:45.851: NdPulseaudio: Got a sink info for the expected name (gnome-network-displays:5452): DEBUG: 15:44:49.857: WFDP2PProvider: Found a new sink with peer 0x55c69c6fed00 on device 0x55c69c6a7180 (gnome-network-displays:5452): DEBUG: 15:44:49.857: SinkList: Adding a sink (gnome-network-displays:5452): DEBUG: 15:44:51.759: Found x264enc for video encoding. (gnome-network-displays:5452): DEBUG: 15:44:51.759: Found vaapih264enc for video encoding. (gnome-network-displays:5452): DEBUG: 15:44:51.759: Found avenc_aac for audio encoding. (gnome-network-displays:5452): DEBUG: 15:44:51.760: Got state change notification from streaming sink to state ND_SINK_STATE_WAIT_P2P (gnome-network-displays:5452): DEBUG: 15:44:51.761: WfdP2PProvider: Discover is now set to 0 (gnome-network-displays:5452): DEBUG: 15:44:51.853: NdWfdP2PSink: Got P2P connection (gnome-network-displays:5452): DEBUG: 15:44:51.854: Found x264enc for video encoding. (gnome-network-displays:5452): DEBUG: 15:44:51.854: Found vaapih264enc for video encoding. (gnome-network-displays:5452): DEBUG: 15:44:51.854: Found avenc_aac for audio encoding. (gnome-network-displays:5452): DEBUG: 15:44:51.855: Got state change notification from streaming sink to state ND_SINK_STATE_WAIT_SOCKET (gnome-network-displays:5452): DEBUG: 15:44:58.000: NdWfdP2PSink: Got client connection (gnome-network-displays:5452): DEBUG: 15:44:58.000: Got state change notification from streaming sink to state ND_SINK_STATE_WAIT_STREAMING (gnome-network-displays:5452): DEBUG: 15:44:58.598: WfdClient: OPTIONS querying done (gnome-network-displays:5452): DEBUG: 15:44:58.598: WFD query params (gnome-network-displays:5452): DEBUG: 15:44:58.656: WfdClient: GET_PARAMS done (gnome-network-displays:5452): DEBUG: 15:44:58.656: Add audio codec to params: (gnome-network-displays:5452): DEBUG: 15:44:58.656: WfdAudioCodec: LPCM, 3, latency: 0 (gnome-network-displays:5452): DEBUG: 15:44:58.656: Add audio codec to params: (gnome-network-displays:5452): DEBUG: 15:44:58.656: WfdAudioCodec: AAC, 1, latency: 0 (gnome-network-displays:5452): DEBUG: 15:44:58.656: Add audio codec to params: (gnome-network-displays:5452): DEBUG: 15:44:58.656: WfdAudioCodec: AC3, 0, latency: 0 (gnome-network-displays:5452): DEBUG: 15:44:58.656: Add codec to params: (gnome-network-displays:5452): DEBUG: 15:44:58.656: WfdVideoCodec: (gnome-network-displays:5452): DEBUG: 15:44:58.656: * profile: 2 * (gnome-network-displays:5452): DEBUG: 15:44:58.656: level: 4 (gnome-network-displays:5452): DEBUG: 15:44:58.656: native: 1920x1080 60p (gnome-network-displays:5452): DEBUG: 15:44:58.656: Supported resolutions: (gnome-network-displays:5452): DEBUG: 15:44:58.656: 800x480 30p (gnome-network-displays:5452): DEBUG: 15:44:58.656: * 800x480 60p * (gnome-network-displays:5452): DEBUG: 15:44:58.656: 854x480 30p (gnome-network-displays:5452): DEBUG: 15:44:58.656: * 854x480 60p (gnome-network-displays:5452): DEBUG: 15:44:58.656: * 864x480 30p * (gnome-network-displays:5452): DEBUG: 15:44:58.656: 864x480 60p (gnome-network-displays:5452): DEBUG: 15:44:58.656: * 640x360 30p (gnome-network-displays:5452): DEBUG: 15:44:58.657: * 640x360 60p * (gnome-network-displays:5452): DEBUG: 15:44:58.657: 960x540 30p (gnome-network-displays:5452): DEBUG: 15:44:58.657: * 960x540 60p (gnome-network-displays:5452): DEBUG: 15:44:58.657: * 848x480 30p * (gnome-network-displays:5452): DEBUG: 15:44:58.657: 848x480 60p (gnome-network-displays:5452): DEBUG: 15:44:58.657: * 640x480 60p (gnome-network-displays:5452): DEBUG: 15:44:58.657: * 720x480 60p * (gnome-network-displays:5452): DEBUG: 15:44:58.657: 720x576 50p (gnome-network-displays:5452): DEBUG: 15:44:58.657: * 1280x720 30p (gnome-network-displays:5452): DEBUG: 15:44:58.657: * 1280x720 60p * (gnome-network-displays:5452): DEBUG: 15:44:58.657: 1920x1080 30p (gnome-network-displays:5452): DEBUG: 15:44:58.657: * 1290x720 25p (gnome-network-displays:5452): DEBUG: 15:44:58.657: * 1280x720 50p * (gnome-network-displays:5452): DEBUG: 15:44:58.657: 1920x1080 25p (gnome-network-displays:5452): DEBUG: 15:44:58.657: * 1280x720 24p (gnome-network-displays:5452): DEBUG: 15:44:58.657: * 1920x1080 25p * (gnome-network-displays:5452): DEBUG: 15:44:58.657: 800x600 30p (gnome-network-displays:5452): DEBUG: 15:44:58.657: * 800x600 60p (gnome-network-displays:5452): DEBUG: 15:44:58.657: * 1024x768 30p * (gnome-network-displays:5452): DEBUG: 15:44:58.657: 1024x768 60p (gnome-network-displays:5452): DEBUG: 15:44:58.657: * 1152x864 30p (gnome-network-displays:5452): DEBUG: 15:44:58.657: * 1152x864 60p * (gnome-network-displays:5452): DEBUG: 15:44:58.657: 1280x768 30p (gnome-network-displays:5452): DEBUG: 15:44:58.657: * 1280x768 60p (gnome-network-displays:5452): DEBUG: 15:44:58.657: * 1280x800 30p * (gnome-network-displays:5452): DEBUG: 15:44:58.657: 1280x800 60p (gnome-network-displays:5452): DEBUG: 15:44:58.657: * 1360x768 30p (gnome-network-displays:5452): DEBUG: 15:44:58.657: * 1360x768 60p * (gnome-network-displays:5452): DEBUG: 15:44:58.657: 1366x768 30p (gnome-network-displays:5452): DEBUG: 15:44:58.657: * 1366x768 60p (gnome-network-displays:5452): DEBUG: 15:44:58.657: * 1280x1024 30p * (gnome-network-displays:5452): DEBUG: 15:44:58.657: 1440x900 30p (gnome-network-displays:5452): DEBUG: 15:44:58.657: * 1440x900 60p (gnome-network-displays:5452): DEBUG: 15:44:58.657: * 1600x900 30p * (gnome-network-displays:5452): DEBUG: 15:44:58.657: 1600x900 60p (gnome-network-displays:5452): DEBUG: 15:44:58.657: * 1680x1024 30p (gnome-network-displays:5452): DEBUG: 15:44:58.657: * 1680x1050 30p (gnome-network-displays:5452): DEBUG: 15:44:58.657: Add codec to params: (gnome-network-displays:5452): DEBUG: 15:44:58.658: WfdVideoCodec: * (gnome-network-displays:5452): DEBUG: 15:44:58.658: profile: 1 (gnome-network-displays:5452): DEBUG: 15:44:58.658: * level: 4 (gnome-network-displays:5452): DEBUG: 15:44:58.658: native: 1920x1080 60p (gnome-network-displays:5452): DEBUG: 15:44:58.658: Supported resolutions: (gnome-network-displays:5452): DEBUG: 15:44:58.658: 800x480 30p (gnome-network-displays:5452): DEBUG: 15:44:58.658: * 800x480 60p (gnome-network-displays:5452): DEBUG: 15:44:58.658: * 854x480 30p * (gnome-network-displays:5452): DEBUG: 15:44:58.658: 854x480 60p (gnome-network-displays:5452): DEBUG: 15:44:58.658: * 864x480 30p (gnome-network-displays:5452): DEBUG: 15:44:58.658: * 864x480 60p * (gnome-network-displays:5452): DEBUG: 15:44:58.658: 640x360 30p (gnome-network-displays:5452): DEBUG: 15:44:58.658: * 640x360 60p (gnome-network-displays:5452): DEBUG: 15:44:58.658: * 960x540 30p * (gnome-network-displays:5452): DEBUG: 15:44:58.658: 960x540 60p (gnome-network-displays:5452): DEBUG: 15:44:58.658: * 848x480 30p (gnome-network-displays:5452): DEBUG: 15:44:58.658: * 848x480 60p * (gnome-network-displays:5452): DEBUG: 15:44:58.658: 640x480 60p (gnome-network-displays:5452): DEBUG: 15:44:58.658: * 720x480 60p (gnome-network-displays:5452): DEBUG: 15:44:58.658: * 720x576 50p * (gnome-network-displays:5452): DEBUG: 15:44:58.658: 1280x720 30p (gnome-network-displays:5452): DEBUG: 15:44:58.658: * 1280x720 60p (gnome-network-displays:5452): DEBUG: 15:44:58.658: * 1920x1080 30p * (gnome-network-displays:5452): DEBUG: 15:44:58.658: 1290x720 25p (gnome-network-displays:5452): DEBUG: 15:44:58.658: * 1280x720 50p (gnome-network-displays:5452): DEBUG: 15:44:58.658: * 1920x1080 25p * (gnome-network-displays:5452): DEBUG: 15:44:58.658: 1280x720 24p (gnome-network-displays:5452): DEBUG: 15:44:58.658: * 1920x1080 25p (gnome-network-displays:5452): DEBUG: 15:44:58.658: * 800x600 30p * (gnome-network-displays:5452): DEBUG: 15:44:58.658: 800x600 60p (gnome-network-displays:5452): DEBUG: 15:44:58.658: * 1024x768 30p (gnome-network-displays:5452): DEBUG: 15:44:58.658: * 1024x768 60p * (gnome-network-displays:5452): DEBUG: 15:44:58.658: 1152x864 30p (gnome-network-displays:5452): DEBUG: 15:44:58.658: * 1152x864 60p (gnome-network-displays:5452): DEBUG: 15:44:58.658: * 1280x768 30p * (gnome-network-displays:5452): DEBUG: 15:44:58.658: 1280x768 60p (gnome-network-displays:5452): DEBUG: 15:44:58.658: * 1280x800 30p (gnome-network-displays:5452): DEBUG: 15:44:58.659: * 1280x800 60p * (gnome-network-displays:5452): DEBUG: 15:44:58.659: 1360x768 30p (gnome-network-displays:5452): DEBUG: 15:44:58.659: * 1360x768 60p (gnome-network-displays:5452): DEBUG: 15:44:58.659: * 1366x768 30p * (gnome-network-displays:5452): DEBUG: 15:44:58.659: 1366x768 60p (gnome-network-displays:5452): DEBUG: 15:44:58.659: * 1280x1024 30p (gnome-network-displays:5452): DEBUG: 15:44:58.659: * 1440x900 30p * (gnome-network-displays:5452): DEBUG: 15:44:58.659: 1440x900 60p (gnome-network-displays:5452): DEBUG: 15:44:58.659: * 1600x900 30p (gnome-network-displays:5452): DEBUG: 15:44:58.659: * 1600x900 60p * (gnome-network-displays:5452): DEBUG: 15:44:58.659: 1680x1024 30p (gnome-network-displays:5452): DEBUG: 15:44:58.659: * 1680x1050 30p

(gnome-network-displays:5452): WARNING : 15:44:58.659: WfdClient: No resolution found, falling back to standard FullHD resolution. (gnome-network-displays:5452): DEBUG: 15:44:58.659: selected resolution 1920, 1080 @30 (gnome-network-displays:5452): DEBUG: 15:44:58.662: WfdClient: SET_PARAMS done (gnome-network-displays:5452): DEBUG: 15:44:58.665: WfdClient: Initialization done! (gnome-network-displays:5452): DEBUG: 15:44:58.666: use x11: 1 (gnome-network-displays:5452): DEBUG: 15:44:58.848: WfdMedia init: Got 1 streams (gnome-network-displays:5452): DEBUG: 15:44:59.015: An audiocodec has been selected: yes

(gnome-network-displays:5452): CRITICAL : 15:45:01.080: gst_vaapi_display_has_opengl: assertion 'display != NULL' failed (gnome-network-displays:5452): DEBUG: 15:45:03.235: NdWfdP2PSink: Got play request from client (gnome-network-displays:5452): DEBUG: 15:45:03.235: Got state change notification from streaming sink to state ND_SINK_STATE_STREAMING (gnome-network-displays:5452): DEBUG: 15:45:04.640: Cannot force key frame as the pipeline doesn't support it! (gnome-network-displays:5452): DEBUG: 15:45:05.445: Cannot force key frame as the pipeline doesn't support it! (gnome-network-displays:5452): DEBUG: 15:45:05.697: QOS: proportion: 3,192, processed: 38, dropped: 7 (gnome-network-displays:5452): DEBUG: 15:45:05.699: QOS: proportion: 3,192, processed: 38, dropped: 8 (gnome-network-displays:5452): DEBUG: 15:45:05.744: QOS: proportion: 2,549, processed: 40, dropped: 9 (gnome-network-displays:5452): DEBUG: 15:45:06.683: Cannot force key frame as the pipeline doesn't support it! (gnome-network-displays:5452): DEBUG: 15:45:07.011: QOS: proportion: 1,829, processed: 59, dropped: 19 (gnome-network-displays:5452): DEBUG: 15:45:07.079: QOS: proportion: 2,807, processed: 80, dropped: 12 (gnome-network-displays:5452): DEBUG: 15:45:07.135: QOS: proportion: 3,478, processed: 82, dropped: 14 (gnome-network-displays:5452): DEBUG: 15:45:07.179: QOS: proportion: 2,879, processed: 62, dropped: 22 (gnome-network-displays:5452): DEBUG: 15:45:07.181: QOS: proportion: 2,879, processed: 84, dropped: 15 (gnome-network-displays:5452): DEBUG: 15:45:07.228: QOS: proportion: 2,964, processed: 86, dropped: 16 (gnome-network-displays:5452): DEBUG: 15:45:07.470: QOS: proportion: 2,474, processed: 69, dropped: 29 (gnome-network-displays:5452): DEBUG: 15:45:07.473: QOS: proportion: 2,474, processed: 98, dropped: 18 (gnome-network-displays:5452): DEBUG: 15:45:07.521: QOS: proportion: 2,080, processed: 70, dropped: 30 (gnome-network-displays:5452): DEBUG: 15:45:07.577: QOS: proportion: 2,068, processed: 71, dropped: 31 (gnome-network-displays:5452): DEBUG: 15:45:07.632: QOS: proportion: 1,808, processed: 72, dropped: 32 (gnome-network-displays:5452): DEBUG: 15:45:07.917: Cannot force key frame as the pipeline doesn't support it! (gnome-network-displays:5452): DEBUG: 15:45:08.489: QOS: proportion: 1,817, processed: 94, dropped: 33 (gnome-network-displays:5452): DEBUG: 15:45:08.677: QOS: proportion: 2,253, processed: 98, dropped: 37 (gnome-network-displays:5452): DEBUG: 15:45:08.719: QOS: proportion: 2,353, processed: 99, dropped: 38 (gnome-network-displays:5452): DEBUG: 15:45:08.721: QOS: proportion: 2,353, processed: 137, dropped: 19 (gnome-network-displays:5452): DEBUG: 15:45:08.922: Cannot force key frame as the pipeline doesn't support it! (gnome-network-displays:5452): DEBUG: 15:45:10.105: QOS: proportion: 1,721, processed: 143, dropped: 39 (gnome-network-displays:5452): DEBUG: 15:45:10.159: QOS: proportion: 1,766, processed: 144, dropped: 40 (gnome-network-displays:5452): DEBUG: 15:45:10.211: QOS: proportion: 1,768, processed: 145, dropped: 41 (gnome-network-displays:5452): DEBUG: 15:45:10.270: QOS: proportion: 1,862, processed: 146, dropped: 42 (gnome-network-displays:5452): DEBUG: 15:45:10.322: QOS: proportion: 2,061, processed: 147, dropped: 43 (gnome-network-displays:5452): DEBUG: 15:45:10.360: QOS: proportion: 1,668, processed: 148, dropped: 44 (gnome-network-displays:5452): DEBUG: 15:45:24.659: WfdClient: Doing keep-alive (gnome-network-displays:5452): DEBUG: 15:45:45.729: WfdMedia: Finalize (gnome-network-displays:5452): DEBUG: 15:46:03.218: Got state change notification from streaming sink to state ND_SINK_STATE_DISCONNECTED (gnome-network-displays:5452): DEBUG: 15:46:03.219: WfdP2PProvider: Discover is now set to 1 (gnome-network-displays:5452): DEBUG: 15:46:03.219: WfdClient: Finalize (gnome-network-displays:5452): DEBUG: 15:46:03.219: WfdServer: Finalize (gnome-network-displays:5452): DEBUG: 15:46:03.219: WfdMediaFactory: Finalize ** (gnome-network-displays:5452): DEBUG: 15:46:18.851: MetaSink: No usable sink is left, object has become invalid.

benzea commented 4 years ago

Well yeah, that is what it smells like. But the "Doing keep-alife" means we are sending something:

GET_PARAMETER rtsp://localhost/wfd1.0/streamid=0 RTSP/1.0
CSeq: 6
Server: GStreamer RTSP server
Session: lyYAy_7Q.+iFcxeP
Date: Thu, 19 Dec 2019 15:00:16 GMT

RTSP/1.0 200 OK
CSeq: 6
Session: lyYAy_7Q.+iFcxeP

Is what I am getting here (you can see the GET_PARAMETER and the OK response).

And the WFD specifications says:

A GET_PARAMETER without body can be used for keep-alive function. See sections 6.5.1 and 6.4.16.

And what we send matches exactly the example in the specification …

benzea commented 4 years ago

That said, maybe something weird is going on. To be honest, my device is asking for IDR frames (full refresh) so often, that I am unlikely to ever run into a 30s period with no other messages. Or those devices don't like the keep-alive as sent by us.

HTWDD-SN commented 4 years ago

I checked the standard. I wonder about one thing:

WDF 6.5.1 says the timeout value should be published.

  1. A WFD Source indicates the timeout value via the “Session:” line in the RTSP M6 Response message.

In RFC 2326 12.37 says the timeout value is optional.

How is it possible for me the check the RTSP communication to the Microsoft Wireless Display Adapter?

benzea commented 4 years ago

Well, you can use wireshark. Then while the connection is being established the p2p device will appear. If you capture that, there will be an RTSP connection (before the RTP media stream starts), this is the one that is interesting. So if you follow it, you will see the keep alive packets being exchanged.

benzea commented 4 years ago

@HTWDD-SN, I pushed a fix, see #20. i.e. 6afa893. If you are able to test the patch and verify that it works, that would be really useful!

HTWDD-SN commented 4 years ago

Super, it works now perfect. The new keep alive method solved the problem. By the way my connection to my access point is still working. i did not know that two different connections are possible with one network card.

CPU load is about 40% on one core. I suspect the reason is the MP4 coding.

Good luck.

benzea commented 4 years ago

By the way my connection to my access point is still working.

Yep, that is what WiFi Direct (or WiFi P2P) is for. And the reason to do all the work to get proper NetworkManager integration.

CPU load is about 40% on one core. I suspect the reason is the MP4 coding.

Yeah, that will be the video encoder (H264) and maybe other inefficiencies e.g. with pushing the video frames around.