livekit / agents

Build real-time multimodal AI applications 🤖🎙️📹
https://docs.livekit.io/agents
Apache License 2.0
957 stars 182 forks source link

remix_and_resample effect optimization #294

Open wyz-honey opened 3 months ago

wyz-honey commented 3 months ago

                if isinstance(data, rtc.AudioFrame):
                    # TODO(theomonnom): The remix_and_resample method is low quality
                    # and should be replaced with a continuous resampling
                    frame = data.remix_and_resample(
                        self._sample_rate, self._num_channels
                    )

When will this TODO be optimized? After testing, the accuracy of this solution is much different from that of using pyaudio to read data from the microphone.

davidzhao commented 3 months ago

yeah we are working on it

wyz-honey commented 3 months ago

Great job, looking forward to it, thank you