mumble-voip / mumble

Mumble is an open-source, low-latency, high quality voice chat software.
https://www.mumble.info
Other
6.13k stars 1.1k forks source link

Add DeepFilterNet noise suppression #6299

Open aksdb opened 6 months ago

aksdb commented 6 months ago

Context

Improve voice quality further in noisy environments.

Description

In addition to RNNoise, add the (also) open source DeepFilterNet noise suppression filter to the Mumble client, which does seem to yield very good results in audio quality.

Mumble component

Client

OS-specific?

No

Additional information

No response

DarkDefender commented 6 months ago

Just to summarize the discussion in #6292:

Moving forward, Mumble is planning to have the audio (output, input, and plugins) be handled by: https://github.com/mumble-voip/libcrossaudio

So far the only API that DeepFilterNet exposes seems to be LADSPA as you can already use it as a plugin with pipewire. If LADSPA is easily usable cross platform, then we could implement this API in libcrossaudio and that way get a audio plugin system "for free".

Of course mumble would ship with some default plugins so that users don't have to download the DeepFilterNet plugin themselves.

roshan-orlando commented 5 months ago

Hi, I am new to contributing and would love to give this a shot if that is okay?

Krzmbrzl commented 5 months ago

This will likely be a complex thing to implement that'll require a good understanding of the current code base. I wouldn't recommend it for someone with no prior experience in Mumble.