search

mondain / red5

Automatically exported from code.google.com/p/red5
3 stars 8 forks source link

Choppy audio problem live streaming #67

Closed GoogleCodeExporter closed 9 years ago

GoogleCodeExporter commented 9 years ago 
What steps will reproduce the problem?
1.publish a live stream with fmle video vp6 and audio mp3 using latest trunk of 
red5
2.connect to the stream with a flash player
3.hear the choppy audio

What is the expected output? 
- a good adio was expected like 0.9 versione
What do you see instead?
- Video OK but choppy audio, some metallin noise with mp3 codec and some 
interruption of audio stream with nellymoser

What version of the product are you using?
- red51.0 latest trunk version 
On what operating system?
- Win xp and vista, linux os

Please provide any additional information below.

Original issue reported on code.google.com by giusa...@gmail.com on 17 Apr 2011 at 5:29

GoogleCodeExporter commented 9 years ago 
same issue when i publish live stream to my linux machine.
client:windows7 64bit + fmle 3.2 use H.264(650kbps) + mp3(128kbps)
server:SL6.0 64bit + red5(r4218)

noise appeared quite often.about 0.33 - 1 times per sec.

Original comment by Taunt.Im...@gmail.com on 19 Apr 2011 at 4:33

GoogleCodeExporter commented 9 years ago 
I'm also experiencing this issue on 1.0 trunk.   I have live streams I can demo 
to show the issue.

Original comment by n...@servercorps.com on 20 May 2011 at 7:05

GoogleCodeExporter commented 9 years ago

Original comment by mondain on 13 Jul 2011 at 1:18

GoogleCodeExporter commented 9 years ago 
This is really a blocker, as Red5 is 100% unusable with no workarounds. With 
Mp3 audio you get the tinny, metallic audio artifacts, and with nelly moser you 
get audio dropouts

Original comment by n...@servercorps.com on 13 Jul 2011 at 2:06

GoogleCodeExporter commented 9 years ago 
We will look into it, but be aware that many other users have streamed with 
Red5 and do not experience this issue. So to say it is a blocker or that the 
server is "unusable" is not accurate.

Original comment by mondain on 13 Jul 2011 at 3:32

GoogleCodeExporter commented 9 years ago 
Unfortunately we also have the same Issue with H.264 (350 kbps) + mp3 (48 kbps) 
in combination with FME and Red5 1.0/0.9.2 This symptom does not happen with 
WOWZA. There anything plays smooth.

We gave RED5 lots of memory and tried to play with the Java parameters. But the 
symptom of interrupted audio is always the same.

We can not use RED5 so far due to this effect.

Original comment by Christen...@googlemail.com on 21 Jul 2011 at 12:58

GoogleCodeExporter commented 9 years ago 
Having a similar problem. If I stream using mp3 for audio it has artefacts. 
Running 1.0rc1 on Ubuntu 10.04. Now using nellymoser which is does not seem to 
be adding them.

Anything I can do from my side to test and help diagnose the problem?

Tim

Original comment by tim.h...@gmail.com on 22 Jul 2011 at 6:53

GoogleCodeExporter commented 9 years ago 
I have also now done a recompile of trunk. Also tested am definitely running 
sun's java. I've tested changing the amount buffered. If you want I can stream 
something to server and give you were its live to show the problem.

Original comment by tim.h...@gmail.com on 23 Jul 2011 at 10:16

GoogleCodeExporter commented 9 years ago 
Even with the latest trunk versions issue 67 is still pressing us.
We can not use FMLE with MP3 codec.

Is there anything we can help with to debug the problem? From a discussion in 
the forum I got the impression, that a root cause has already been performed 
and the issue is going to be fixed, soon. But for a couple of weeks there was 
no noticable progress.

Please let me know if I can help
Michael

Original comment by Christen...@googlemail.com on 30 Aug 2011 at 12:48

GoogleCodeExporter commented 9 years ago 
Hi, i have same problem with sound .. anyone known how fix it? 
i have FME 3.2 and red5 1.0 .. please tell how to fix it :D

Original comment by hrabal.d...@gmail.com on 26 Oct 2011 at 2:59

GoogleCodeExporter commented 9 years ago 
Hi - I am experiencing exactly the same issue - artifact noise every 5 seconds 
or so, when using the latest red5 on linux.

Let me know if I can help.

Original comment by nick.she...@gmail.com on 31 Oct 2011 at 6:32

GoogleCodeExporter commented 9 years ago 
Same issue here. Tried all possible combinations of red5 and fmle releases. 
None of them worked. All other possible ways to stream live for free have 
horrible audio quality. Nelly Moser and Speex are simply not made for anything 
except voice transpission. Maybe it works with the fmle aac codec which comes 
180$ and is for windows only.

Original comment by dominik....@googlemail.com on 7 Dec 2011 at 5:24

GoogleCodeExporter commented 9 years ago 
AAC codec is working fine.

Unfortunately the MP3-bug has not been fixed yet. This is really a pain, 
because RED5 is unusable in combination with FMLE.

Original comment by Christen...@googlemail.com on 9 Dec 2011 at 12:45

GoogleCodeExporter commented 9 years ago 
I prefer to donate 180$ to Red5 team instead of buying the AAC.

This is a very bloking problem!

Original comment by giusa...@gmail.com on 9 Dec 2011 at 2:02

GoogleCodeExporter commented 9 years ago 
Any team member have an update on this?  I will re-assert that this is in fact 
a blocker issue. Nelly Moser is NOT a suitable workaround.

Original comment by n...@servercorps.com on 9 Dec 2011 at 2:29

GoogleCodeExporter commented 9 years ago 
I have experienced the same problems using fmle on a win7 machine. The video 
(h264) is great, but the audio (mp3) has artifacts in it every few seconds. I 
tested it at various audio and video bitrates, and it always has this same 
problem. Very very annoying!

Original comment by richard.bronkhorst@gmail.com on 19 Dec 2011 at 1:33

GoogleCodeExporter commented 9 years ago 
I am facing same issue with streaming MP3.
is there any fix for same?

I have deployed RED5 on CENTOS. except mp3 voice issues everything is working 
fine.

Need urgent help.

Original comment by kus...@kushan.co.in on 19 Mar 2012 at 7:02

GoogleCodeExporter commented 9 years ago 
Well kus I have the exact same problem. 
I have some mp3 files with a 56k bitrate, 48k sample rate, mpga 1/2/3 audio 
layer and the sound is just noise.
I tested small 5s files with 44K sample rate and 48k bitrate and they work 
fine. I don't know how to debug this tbh ...

Original comment by igosuki on 1 Apr 2012 at 6:30

GoogleCodeExporter commented 9 years ago 
Any update on this?  It's still unusable for me with the tinny audio artifacts

Original comment by n...@servercorps.com on 18 Apr 2012 at 11:28

GoogleCodeExporter commented 9 years ago 
This is still very much a bug.

The following gst-launch will generate a test video pattern
and a fixed audio source.  Showing and playing them on the sending
machine.  As given it is using the faac audio
encoder.  lamemp3enc and ffenc_nellymoser also give the same
error as described in this bug report.  There are also various
possible bitrates, and changing them does not work-around the problem.

This is on a stock ubuntu 12.04 machine
with red5-server rc1 from the repos and gstreamer stock as well.

The audio artifacts are serious, and show up on recorded media as well,
but depending on the levels and type of sound are not always as noticable.
The test sound given here shows off the problem well.

The sound problems show up on flash player in firefox, the embedded
flash player in Chromium as well as the VLC media player.

I've run various tests to make sure that the encoded stream can be
locally decoded before being sent to red5, and all of them indicate
that the problem is at the red5 stage, not before.

As others have reported earlier, red5 appears not usable as shipped.

gst-launch videotestsrc ! tee name=video_tee ! \
   queue ! videoscale ! ffmpegcolorspace ! xvimagesink \
   audiotestsrc ! tee name=audio_tee ! queue ! \
   audioconvert ! audioresample ! alsasink \
   audio_tee. ! queue ! audioconvert ! audiorate ! \
   audioresample ! faac bitrate=96000 ! \
   audio/mpeg,mpegversion=4,stream-format=raw ! \
   flvmux streamable=true name=flvmux \
   video_tee. ! queue ! videoscale ! ffmpegcolorspace ! \
   x264enc pass=pass1 threads=0 bitrate=900 tune=zerolatency ! flvmux. \
   flvmux. ! queue ! rtmpsink sync=false location=rtmp://myserver.com/live/test

Original comment by phil.sto...@gmail.com on 25 Apr 2012 at 6:22

GoogleCodeExporter commented 9 years ago 
Let me follow up...

Here is a gst-launch which plays "big buck bunny" through a red5 
server.  Because of the nature of the sound track, 
the audio artifacts are much harder to hear until late in
the video when they become pronounced.  

Curiously, there is no noticable visual artifacts.
Again, all the various audio encoders generate the same errors.
I can decode the flv stream locally and play back without error.

gst-launch filesrc location=/media/video/big_buck_bunny_720p_h264.m4v \
! decodebin name=demux ! queue ! videorate ! videoscale method=0 \
! video/x-raw-yuv,width=852,height=480,framerate=\(fraction\)24/1 ! 
ffmpegcolorspace \
! x264enc pass=pass1 threads=0 bitrate=900 tune=zerolatency ! flvmux name=mux ! 
\
rtmpsink location='rtmp://myserver.com/live/bunny' \
demux. ! queue ! progressreport ! audioconvert ! audiorate ! audioresample \
! faac bitrate=96000 ! audio/mpeg,mpegversion=4,stream-format=raw ! mux.

Original comment by phil.sto...@gmail.com on 25 Apr 2012 at 6:28

GoogleCodeExporter commented 9 years ago

Original comment by mondain on 29 Apr 2012 at 3:14

GoogleCodeExporter commented 9 years ago 
Apparently the problem still persists in 1.0RC1 and RC2, as experienced on  a 
Debian/Linux platform. 
No suggestions on how to fix this have been found anywhere on the net. 
And no replies from the developers.
Is the project dead?

Original comment by antti.ka...@innoventum.fi on 7 Sep 2012 at 6:51

GoogleCodeExporter commented 9 years ago 
I'm very sorru about this.
That's a great platform for live streaming but with this issue is not
usable.

Original comment by giusa...@gmail.com on 7 Sep 2012 at 7:24

GoogleCodeExporter commented 9 years ago 
We are currently at a loss as to the cause of the issue being experienced. 
Thanks to phil.stone for actually providing a workable test.

Original comment by mondain on 7 Sep 2012 at 1:30

GoogleCodeExporter commented 9 years ago 
I don't know if this helps, but there are no artifacts when using stereo mp3 
encoding with no video (using FMLE). Also, there are no artifacts when 
capturing video and mono-audio directly in actionscript. I also noticed that 
when playing a click track, the stream speeds up and slows down instead of 
staying on time. This seems to correlate with the audio artifacts. 

My guess would be that when audio and video de-syncs, then re-syncs, there is 
packet loss in the audio. This seemed to have cropped up after fixing some sync 
issues a couple versions ago. Just my two cents.

[Tested every combination of versions 8 through 1.0 RC3 on Windows and Linux 
servers, locally and on Amazon EC3, using OpenJDK and Sun JDK, streaming with 
FMLE using VP6, H.264, with Mp3 encoding.]

Original comment by jstra...@gmail.com on 8 Sep 2012 at 8:40

GoogleCodeExporter commented 9 years ago 
It might be also useful for us trying to actually use Red5 to know if someone 
has been able to actually successfully stream video and audio with either 
H.264+Mp3 OR VP6 + Nellymoser combination: So far we've tested this on multiple 
platforms and experienced the same problems on all of them with every version 
of Red5 experimented (from 0.8 to 1.0RC2 at least, since this problem has been 
around for years, might also apply to older versions).

So, if anyone has successfully circumvented this problem, or if you the 
developers are not experiencing (or in fact even have problems reproducing) 
this issue, could you post some information about the systems you've used? (OS, 
Java, Red5 versions at least).

Original comment by antti.ka...@innoventum.fi on 18 Sep 2012 at 6:51

GoogleCodeExporter commented 9 years ago 
I opened the issue.
I did't get the problem with 0.9 version, but in that version we don't have
H264 so I'm actually using another server for live streaming, but i will
prefer to use Red5....

Original comment by giusa...@gmail.com on 18 Sep 2012 at 7:08

GoogleCodeExporter commented 9 years ago 
We're just streaming a VP6+Nellymoser live as I write this on 0.9.0, and the 
audio is choppy, so the problem definitely exists in 0.9, too. 
(On Linux, java version "1.6.0_26")

Original comment by antti.ka...@innoventum.fi on 18 Sep 2012 at 7:17

GoogleCodeExporter commented 9 years ago 
[deleted comment]
GoogleCodeExporter commented 9 years ago 
We're testing RED5 from 0.9.1 to 1.0RC2 on Windows Server 2008 R2, Debian and 
CentOS, with FMLE and more than one sources with H264+Mp3 and the same problem 
exist in all tests.

Original comment by plat4...@gmail.com on 23 Oct 2012 at 6:35

GoogleCodeExporter commented 9 years ago 
Same problem here, choppy sound on live stream, video is smooth.

-Red5 RC2
-Linux 64Bit - fedora
-java 1.7.0_09-icedtea

Original comment by startje...@gmail.com on 15 Nov 2012 at 6:56

GoogleCodeExporter commented 9 years ago 
[deleted comment]
GoogleCodeExporter commented 9 years ago 
I have a solution for this issue in my case when publishing webcam: 
Mic.setSilenceLevel(0);

And all the problems are gone!

Original comment by startje...@gmail.com on 15 Nov 2012 at 8:58

GoogleCodeExporter commented 9 years ago 
Any workaround in the Red5 code?
If we use FMLE we cannot put Mic.setSilenceLevel(0);

Thanks

Original comment by giusa...@gmail.com on 15 Nov 2012 at 9:50

GoogleCodeExporter commented 9 years ago 
Could you please tell me how great i am before i put energy in this :P

Original comment by webbiew...@gmail.com on 15 Nov 2012 at 2:35

GoogleCodeExporter commented 9 years ago 
You're not great enough if you do not solve it!  :D ahahahahah

Original comment by giusa...@gmail.com on 15 Nov 2012 at 2:58

GoogleCodeExporter commented 9 years ago 
Are you talking about Actionscript? Actionscript works fine when encoding mono 
directly from a website. It's stereo encoding from a desktop program that is 
causing the problem.

Original comment by jstra...@gmail.com on 15 Nov 2012 at 10:21

GoogleCodeExporter commented 9 years ago 
This issue stems from the Red5 RTMPProtocolDecoder incorrectly throwing away 
Audio packets with zero timestamps.

Apparently this was added to address an issue in audio streams created by Flash 
Player, but when publishing from files with mp3 tracks it corrupts the output 
stream.

I've attached a (very) small patch, hopefully someone else can test it out and 
confirm I'm correct.

Original comment by chadnickbok@gmail.com on 15 Nov 2012 at 10:59

Attachments:

GoogleCodeExporter commented 9 years ago 
I have some noise while I use the live demo to have a live show.
My AS code sets the codec as speex with quality 8, uses Mic.setSilenceLevel(0, 
10000000), and sets the rate as 16Hz, sets noiseSupperssionLevel as 0, sets 
framesPerPacket as 1.
client: win7 64bit + adobe flash AS 3 use H.264 + microphone(using a Mixer to 
play the music while the user can talk)
server: centOS 6.0 64bit + red5(r4446)
And I have some more question, what properties can I set in the server end to 
improve my audio quality?
If anyone could help me can send me an email :-)

Original comment by Goat.for...@gmail.com on 21 Nov 2012 at 4:13

GoogleCodeExporter commented 9 years ago 
Mike, please apply the small patch I added, and see if this solves your choppy 
audio problems.

Also, please use the mailing list for general questions about audio quality.

Original comment by nchadw...@brightcove.com on 27 Nov 2012 at 9:45

GoogleCodeExporter commented 9 years ago 
This issue was closed by revision r4450.

Original comment by mondain on 2 Dec 2012 at 11:59

GoogleCodeExporter commented 9 years ago 
Hi i'am new on Red5 and I have the same issue. How I apply this patch to a 
Windows XP Red5 instalation? (Red 5 0.9.0, jre 6) Thanks!

Original comment by jposse...@gmail.com on 9 Apr 2013 at 8:22