live voice chat in flutter

[issam1975]

Hi, i am trying to implement a voice chat on a mumble server using flutter and dumble package, i have tried many many things and end up with this code that of course does not work ;) this is why i am here to get assistance and advices on how to setup everything correctly .

the sender user for that i am using mic_stream package to record voice based on some code from the dumble demo :

_client = await MumbleClient.connect(
        options: connectionoptions,
        onBadCertificate: (X509Certificate certificate) {
          //Accept every certificate
          return true;
        });

    audioOutput = _client.audio.sendAudio(codec: AudioCodec.opus);
    // _client.self.add(new SelfCallback(client.self.session));
    var lib = await opus_flutter.load();
    initOpus(lib);
    encoder = StreamOpusEncoder.bytes(
        frameTime: frameTime,
        floatInput: false,
        sampleRate: inputSampleRate,
        channels: channels,
        application: Application.voip);

Future<bool> StartRecording() async {
    mic_stream.MicStream.shouldRequestPermission(true);

    Stream<List<int>> microphoneStream = (await mic_stream.MicStream.microphone(
            audioSource: mic_stream.AudioSource.DEFAULT,
            sampleRate: 48000,
            channelConfig: mic_stream.ChannelConfig.CHANNEL_IN_MONO,
            audioFormat: AUDIO_FORMAT))!
        .cast<List<int>>();

    microphoneStream
        .asyncMap((List<int> bytes) async {
          return bytes;
        })
        .transform(encoder)
        .map((Uint8List audioBytes) => AudioFrame.outgoing(frame: audioBytes))
        .pipe(audioOutput);
    setState(() {
      _isRecording = true;
    });

    listener = microphoneStream!.listen(
      (data) {
        //this block is executed when data event is recieved by listener
        print(data);
      },
     );
    return true;
  }

with that i can see the data flow in the console

the reciever user

_client.audio.add(StreamAudioListener());

class StreamAudioListener with AudioListener {
 final AudioPlayer _audioPlayer = AudioPlayer();

  @override
  Future<void> onAudioReceived(Stream<AudioFrame> voiceData, AudioCodec codec,
      User? speaker, TalkMode talkMode) async {

    if (codec == AudioCodec.opus) {

      StreamOpusDecoder decoder = StreamOpusDecoder.bytes(
          floatOutput: false, sampleRate: outputSampleRate, channels: channels);
      var audiostream = voiceData
          .map<Uint8List>((AudioFrame frame) =>
              frame.frame) //we are only interested in the bytes
          .cast<Uint8List?>()
          .transform(decoder)
          .cast<Uint8List>();

      audiostream.listen(
        (data) async {
          // print(data);
          try {
            await _audioPlayer.setAudioSource(
              CustomStreamAudioSource(data),
            );
            // await _audioPlayer.play();
          } catch (e) {
            print("exception"); // print error details
            print(e); // print error details
            print(data); // print error details
          }
        },
        onError: (err) {
          //this block is executed when error event is recieved by listener
          print('Error: ${err}');
        },
        cancelOnError:
            false, //this decides if subscription is cancelled on error or not
        onDone: () {
          //this block is executed when done event is recieved by listener
          print('StreamDone!');
        },
      );  

    } else {
      print('But we don\'t know how do decode $codec');
    }
  }
}

please note that on the audiostream.listen i am using just_audio package to play the audio bytes from the stream .

the problem is that i can't hear any sound and periodically get an onerror callback however i can see the stream bytes flow on the listen event so the data is recieved from the sender peer.

i can see both users connected on the mumble client application but no sound is transfered between them .

any help , idea, suggestion is welcome .

thanks .

ps : i know about webrtc ;)

[devflutter7]

were you able to fix this?