espressif / esp-adf

Espressif Audio Development Framework
Other
1.52k stars 669 forks source link

Audio path control for recorded audio data OR TTS support (AUD-4748) #1039

Closed EdwardRyu closed 11 months ago

EdwardRyu commented 1 year ago

Base Environment Audio development kit: ESP32-LyraT Audio kit version : v4.3 Module or chip used: ESP32-WROVER-E IDF version: v4.4.4 ADF version: v2.5 ES8311 is being in use instead of ES8388.

Required Feature We requires the feature that plays recorded audio data and then passes it into both VoIP path and speaker path. For example, 1) we have recorded speech mp3 or wav files to play during VoIP call. 2) user selects the menu for playing such audio data during the call. 3) played sound should go into VoIP audio path for the peer to hear it.

Do you support this kind of feature? Or if not, could you give me a guide how to add the played audio into VoIP path? Or does TTS cover this scenario?

The issue is that AEC algorithm seems to mute mp3 sound during VoIP call.

Thanks, Edward

jason-mao commented 1 year ago

@EdwardRyu I think we support this feature. After VOIP is connected. You can change the audio sending data at https://github.com/espressif/esp-adf/blob/49f80aafefc31642ea98db78bf024e18688b8de9/examples/protocols/voip/main/sip_service.c#L87 by you wanted audio path.