High GPU Usage in both EGL and OpenGL Modes

Hi, I'm using looking-glass for a while now and trying to optimize everything so I can make livestreams using it as well.

I'm having some issues regarding GPU usage here, which happens both EGL and OpenGL modes.

As you can see, looking glass is using more than half of the GPU capacity, and this is a GTX 1060 which should be enough to handle the rendering of the buffer.

As currently, I'm using OpenGL mode because EGL doesnt work with DMABUF (it gives a nvidia error) and the GPU usage goes locked to 100% and I get fps drop to about 34 fps.

The thing is that this only happens when the screen is updated often (that's why I have a youtube video for testing it). I thought it was some upscaling issue (since my host resolution is 4k, and guest os 1080p) so I disabled upscaling and started looking glass with resize to host option. Below are the logs for both EGL and OpenGL modes.

Is that usage expected? It seens high for a buffer render. Also a funny thing: the OBS plugin doesnt change GPU usage, and OBS total GPU usage is always < 30% (the total GPU usage in the 1060 keeps below 70%). I would give a try in wayland, if wayland worked here :(

My current setup is:

Host

Ubuntu 22.04
NVidia 510.73.05 (GTX 1060 6GB)
Ryzen 5900x (6 cores only, other 6 reserved to VM. Allocated by L3 position)
96GB RAM

Guest

Windows 10
NVidia 510 (RTX 3070)
24GB RAM ( Hugepages reserved )
6 cores

Both using latest stable release of looking-glass (on linux I compiled it using the latest tag release)

┌─[lucas@voyager] - [~] - [dom mai 22, 19:47]
└─[$] <> looking-glass-client -m 43 app:renderer=opengl win:dontUpscale=yes win:autoResize=yes -f /dev/kvmfr0  
[I]   4188277177              main.c:1304 | main                           | Looking Glass (UNKNOWN)
[I]   4188277188              main.c:1305 | main                           | Locking Method: Atomic
[I]   4188277382           cpuinfo.c:36   | lgDebugCPU                     | CPU Model: AMD Ryzen 9 5900X 12-Core Processor
[I]   4188277384           cpuinfo.c:37   | lgDebugCPU                     | CPU: 12 cores, 24 threads
[I]   4188289498              main.c:866  | lg_run                         | Using font: /usr/share/fonts/truetype/dejavu/DejaVuSansMono.ttf
[I]   4188289520           ivshmem.c:128  | ivshmemOpenDev                 | KVMFR Device     : /dev/kvmfr0
[I]   4188301584              main.c:958  | lg_run                         | Trying forced renderer
[I]   4188301594              main.c:833  | tryRenderer                    | Using Renderer: OpenGL
[I]   4188308169               x11.c:227  | x11CheckEWMHSupport            | EWMH-complient window manager detected: GNOME Shell
[I]   4188308256               x11.c:454  | x11Init                        | X11 XInput 2.0 in use
[I]   4188493536            opengl.c:401  | opengl_renderStartup           | Vendor  : NVIDIA Corporation
[I]   4188493553            opengl.c:402  | opengl_renderStartup           | Renderer: NVIDIA GeForce GTX 1060 6GB/PCIe/SSE2
[I]   4188493557            opengl.c:403  | opengl_renderStartup           | Version : 4.6.0 NVIDIA 510.73.05
[I]   4188727736              main.c:1176 | lg_run                         | Host ready, reported version: B5.0.1
[I]   4188727747              main.c:1177 | lg_run                         | Starting session
[I]   4188727848              main.c:497  | main_frameThread               | Using DMA buffer support
[I]   4188843840              main.c:637  | main_frameThread               | Format: FRAME_TYPE_BGRA 1920x1080 stride:1920 pitch:7680 rotation:0

For EGL mode:

┌─[lucas@voyager] - [~] - [dom mai 22, 19:55]
└─[$] <> looking-glass-client -m 43 app:renderer=egl win:dontUpscale=yes win:autoResize=yes -f /dev/kvmfr0  
[I]   4679546763              main.c:1304 | main                           | Looking Glass (UNKNOWN)
[I]   4679546781              main.c:1305 | main                           | Locking Method: Atomic
[I]   4679546971           cpuinfo.c:36   | lgDebugCPU                     | CPU Model: AMD Ryzen 9 5900X 12-Core Processor
[I]   4679546974           cpuinfo.c:37   | lgDebugCPU                     | CPU: 12 cores, 24 threads
[I]   4679559332              main.c:866  | lg_run                         | Using font: /usr/share/fonts/truetype/dejavu/DejaVuSansMono.ttf
[I]   4679559354           ivshmem.c:128  | ivshmemOpenDev                 | KVMFR Device     : /dev/kvmfr0
[I]   4679579632              main.c:958  | lg_run                         | Trying forced renderer
[I]   4679579701               egl.c:261  | egl_initialize                 | Double buffering is off
[I]   4679579704              main.c:833  | tryRenderer                    | Using Renderer: EGL
[I]   4679580159               x11.c:227  | x11CheckEWMHSupport            | EWMH-complient window manager detected: GNOME Shell
[I]   4679580248               x11.c:454  | x11Init                        | X11 XInput 2.0 in use
[I]   4679600742               x11.c:1374 | x11GetEGLDisplay               | Using eglGetPlatformDisplayEXT
[I]   4679632183               egl.c:696  | egl_renderStartup              | Multisampling enabled, max samples: 4
[I]   4679654661               egl.c:773  | egl_renderStartup              | Single buffer mode
[I]   4679767862               egl.c:789  | egl_renderStartup              | EGL     : 1.5
[I]   4679767871               egl.c:790  | egl_renderStartup              | Vendor  : NVIDIA Corporation
[I]   4679767872               egl.c:791  | egl_renderStartup              | Renderer: NVIDIA GeForce GTX 1060 6GB/PCIe/SSE2
[I]   4679767873               egl.c:792  | egl_renderStartup              | Version : OpenGL ES 3.2 NVIDIA 510.73.05
[I]   4679767881               egl.c:793  | egl_renderStartup              | EGL APIs: OpenGL_ES OpenGL
[I]   4679767884               egl.c:794  | egl_renderStartup              | EGL Exts: EGL_EXT_buffer_age EGL_EXT_client_sync EGL_EXT_create_context_robustness EGL_EXT_image_dma_buf_import EGL_EXT_image_dma_buf_import_modifiers EGL_MESA_image_dma_buf_export EGL_EXT_output_base EGL_EXT_stream_acquire_mode EGL_EXT_sync_reuse EGL_IMG_context_priority EGL_KHR_config_attribs EGL_KHR_create_context_no_error EGL_KHR_context_flush_control EGL_KHR_create_context EGL_KHR_fence_sync EGL_KHR_get_all_proc_addresses EGL_KHR_partial_update EGL_KHR_swap_buffers_with_damage EGL_KHR_no_config_context EGL_KHR_gl_colorspace EGL_KHR_gl_renderbuffer_image EGL_KHR_gl_texture_2D_image EGL_KHR_gl_texture_3D_image EGL_KHR_gl_texture_cubemap_image EGL_KHR_image EGL_KHR_image_base EGL_KHR_image_pixmap EGL_KHR_reusable_sync EGL_KHR_stream EGL_KHR_stream_attrib EGL_KHR_stream_consumer_gltexture EGL_KHR_stream_cross_process_fd EGL_KHR_stream_fifo EGL_KHR_stream_producer_eglsurface EGL_KHR_surfaceless_context EGL_KHR_wait_sync EGL_NV_nvrm_fence_sync EGL_NV_post_sub_buffer EGL_NV_quadruple_buffer EGL_NV_stream_consumer_eglimage EGL_NV_stream_cross_display EGL_NV_stream_cross_object EGL_NV_stream_cross_process EGL_NV_stream_cross_system EGL_NV_stream_dma EGL_NV_stream_flush EGL_NV_stream_metadata EGL_NV_stream_remote EGL_NV_stream_reset EGL_NV_stream_socket EGL_NV_stream_socket_inet EGL_NV_stream_socket_unix EGL_NV_stream_sync EGL_NV_stream_fifo_next EGL_NV_stream_fifo_synchronous EGL_NV_stream_consumer_gltexture_yuv EGL_NV_stream_attrib EGL_NV_stream_origin EGL_NV_system_time EGL_NV_output_drm_flip_event EGL_NV_triple_buffer EGL_NV_robustness_video_memory_purge EGL_WL_bind_wayland_display EGL_WL_wayland_eglstream
[I]   4679767888               egl.c:795  | egl_renderStartup              | GL Exts : GL_EXT_base_instance GL_EXT_blend_func_extended GL_EXT_blend_minmax GL_EXT_buffer_storage GL_EXT_clear_texture GL_EXT_clip_control GL_EXT_clip_cull_distance GL_EXT_color_buffer_float GL_EXT_color_buffer_half_float GL_EXT_conservative_depth GL_EXT_copy_image GL_EXT_depth_clamp GL_EXT_debug_label GL_EXT_discard_framebuffer GL_EXT_disjoint_timer_query GL_EXT_draw_buffers_indexed GL_EXT_draw_elements_base_vertex GL_EXT_EGL_image_array GL_EXT_EGL_image_storage GL_EXT_EGL_image_external_wrap_modes GL_EXT_float_blend GL_EXT_frag_depth GL_EXT_geometry_point_size GL_EXT_geometry_shader GL_EXT_gpu_shader5 GL_EXT_map_buffer_range GL_EXT_multi_draw_indirect GL_EXT_multisample_compatibility GL_EXT_multisampled_render_to_texture GL_EXT_multisampled_render_to_texture2 GL_EXT_multiview_texture_multisample GL_EXT_multiview_timer_query GL_EXT_occlusion_query_boolean GL_EXT_polygon_offset_clamp GL_EXT_post_depth_coverage GL_EXT_primitive_bounding_box GL_EXT_raster_multisample GL_EXT_render_snorm GL_EXT_robustness GL_EXT_separate_shader_objects GL_EXT_shader_group_vote GL_EXT_shader_implicit_conversions GL_EXT_shader_integer_mix GL_EXT_shader_io_blocks GL_EXT_shader_non_constant_global_initializers GL_EXT_shader_texture_lod GL_EXT_shadow_samplers GL_EXT_sparse_texture GL_EXT_sparse_texture2 GL_EXT_sRGB GL_EXT_sRGB_write_control GL_EXT_tessellation_point_size GL_EXT_tessellation_shader GL_EXT_texture_border_clamp GL_EXT_texture_buffer GL_EXT_texture_compression_bptc GL_EXT_texture_compression_dxt1 GL_EXT_texture_compression_rgtc GL_EXT_texture_compression_s3tc GL_EXT_texture_cube_map_array GL_EXT_texture_filter_anisotropic GL_EXT_texture_filter_minmax GL_EXT_texture_format_BGRA8888 GL_EXT_texture_mirror_clamp_to_edge GL_EXT_texture_norm16 GL_EXT_texture_query_lod GL_EXT_texture_rg GL_EXT_texture_shadow_lod GL_EXT_texture_sRGB_R8 GL_EXT_texture_sRGB_decode GL_EXT_texture_storage GL_EXT_texture_view GL_EXT_draw_transform_feedback GL_EXT_unpack_subimage GL_EXT_window_rectangles GL_KHR_context_flush_control GL_KHR_debug GL_EXT_memory_object GL_EXT_memory_object_fd GL_NV_memory_object_sparse GL_KHR_parallel_shader_compile GL_KHR_no_error GL_KHR_robust_buffer_access_behavior GL_KHR_robustness GL_EXT_semaphore GL_EXT_semaphore_fd GL_NV_timeline_semaphore GL_KHR_shader_subgroup GL_KHR_texture_compression_astc_ldr GL_KHR_texture_compression_astc_sliced_3d GL_KHR_texture_compression_astc_hdr GL_NV_bgr GL_NV_bindless_texture GL_NV_blend_equation_advanced GL_NV_blend_equation_advanced_coherent GL_NVX_blend_equation_advanced_multi_draw_buffers GL_NV_blend_minmax_factor GL_NV_clip_space_w_scaling GL_NV_conditional_render GL_NV_conservative_raster GL_NV_conservative_raster_pre_snap_triangles GL_NV_copy_buffer GL_NV_copy_image GL_NV_draw_buffers GL_NV_draw_instanced GL_NV_draw_texture GL_NV_draw_vulkan_image GL_NV_EGL_stream_consumer_external GL_NV_explicit_attrib_location GL_NV_fbo_color_attachments GL_NV_fill_rectangle GL_NV_fragment_coverage_to_color GL_NV_fragment_shader_interlock GL_NV_framebuffer_blit GL_NV_framebuffer_mixed_samples GL_NV_framebuffer_multisample GL_NV_generate_mipmap_sRGB GL_NV_geometry_shader_passthrough GL_NV_instanced_arrays GL_NV_internalformat_sample_query GL_NV_gpu_shader5 GL_NV_image_formats GL_NV_memory_attachment GL_NV_occlusion_query_samples GL_NV_non_square_matrices GL_NV_pack_subimage GL_NV_packed_float GL_NV_packed_float_linear GL_NV_path_rendering GL_NV_path_rendering_shared_edge GL_NV_pixel_buffer_object GL_NV_polygon_mode GL_NV_read_buffer GL_NV_read_depth GL_NV_read_depth_stencil GL_NV_read_stencil GL_NV_sample_locations GL_NV_sample_mask_override_coverage GL_NV_shader_atomic_fp16_vector GL_NV_shader_noperspective_interpolation GL_NV_shader_subgroup_partitioned GL_NV_shadow_samplers_array GL_NV_shadow_samplers_cube GL_NV_sRGB_formats GL_NV_stereo_view_rendering GL_NV_texture_array GL_NV_texture_barrier GL_NV_texture_border_clamp GL_NV_texture_compression_latc GL_NV_texture_compression_s3tc GL_NV_texture_compression_s3tc_update GL_NV_timer_query GL_NV_viewport_array GL_NV_viewport_array2 GL_NV_viewport_swizzle GL_KHR_blend_equation_advanced GL_KHR_blend_equation_advanced_coherent GL_OES_compressed_ETC1_RGB8_texture GL_EXT_compressed_ETC1_RGB8_sub_texture GL_OES_depth24 GL_OES_depth32 GL_OES_depth_texture GL_OES_depth_texture_cube_map GL_OES_copy_image GL_OES_draw_buffers_indexed GL_OES_draw_elements_base_vertex GL_OES_texture_border_clamp GL_OES_tessellation_point_size GL_OES_tessellation_shader GL_OES_texture_buffer GL_OES_geometry_point_size GL_OES_geometry_shader GL_OES_gpu_shader5 GL_OES_shader_io_blocks GL_OES_texture_view GL_OES_primitive_bounding_box GL_OES_EGL_image GL_OES_EGL_image_external GL_OES_EGL_image_external_essl3 GL_OES_EGL_sync GL_OES_element_index_uint GL_OES_fbo_render_mipmap GL_OES_get_program_binary GL_OES_mapbuffer GL_OES_packed_depth_stencil GL_OES_rgb8_rgba8 GL_OES_sample_shading GL_OES_sample_variables GL_OES_shader_image_atomic GL_OES_shader_multisample_interpolation GL_OES_standard_derivatives GL_OES_surfaceless_context GL_OES_texture_cube_map_array GL_OES_texture_npot GL_OES_texture_float GL_OES_texture_float_linear GL_OES_texture_half_float GL_OES_texture_half_float_linear GL_OES_texture_stencil8 GL_OES_texture_storage_multisample_2d_array GL_OES_vertex_array_object GL_OES_vertex_half_float GL_OES_viewport_array GL_OVR_multiview GL_OVR_multiview2 GL_OVR_multiview_multisampled_render_to_texture GL_ANDROID_extension_pack_es31a 
[I]   4679767919               egl.c:858  | egl_renderStartup              | Debug messages disabled, enable with egl:debug=true
[I]   4679789728           eglutil.c:35   | swapWithDamageInit             | Using EGL_KHR_swap_buffers_with_damage
[I]   4679989863              main.c:1176 | lg_run                         | Host ready, reported version: B5.0.1
[I]   4679989874              main.c:1177 | lg_run                         | Starting session
[I]   4679989974              main.c:497  | main_frameThread               | Using DMA buffer support
[I]   4680105949              main.c:637  | main_frameThread               | Format: FRAME_TYPE_BGRA 1920x1080 stride:1920 pitch:7680 rotation:0
[E]   4680183064    texture_dmabuf.c:144  | egl_texDMABUFUpdate            | Failed to create EGLImage for DMA transfer (EGL_BAD_ALLOC)
[W]   4680183072           desktop.c:318  | egl_desktopUpdate              | DMA update failed, disabling DMABUF imports
[W]   4680183077           desktop.c:323  | egl_desktopUpdate              | NVIDIA's DMABUF support is incomplete, please direct your complaints to NVIDIA
[W]   4680183081           desktop.c:324  | egl_desktopUpdate              | This is not a bug in Looking Glass

gnif / LookingGlass

High GPU Usage in both EGL and OpenGL Modes #993

Host

Guest