ant-media / Ant-Media-Server

Ant Media Server is a live streaming engine software that provides adaptive, ultra low latency streaming by using WebRTC technology with ~0.5 seconds latency. Ant Media Server is auto-scalable and it can run on-premise or on-cloud.
https://antmedia.io
Other
4.25k stars 623 forks source link

Consider frequent smaller updates #3647

Open choxnox opened 3 years ago

choxnox commented 3 years ago

It would be good if you would consider releasing smaller but more frequent updates. Right now it takes months to roll out bugfixes and/or new features and each time we upgraded we faced some new bugs.

For example, we recently upgraded to 2.4.0.2 which finally resolved an issue which would made the broadcast stuck if any of the RTMP restreaming URLs were invalid or expired. However, 2.4.0.2 also introduced an new breaking issue #3608 so we had to downgrade to 2.3.3.1 and we have to deal with the RTMP restreaming bug again and explain to our customers why their expired RTMP endpoints will make their broadcasts not being able to go live with HLS/DASH. Now it appears #3608 has just been fixed but according to the history of releases, we might see this fix in production in November, December or even the next year. Since low-latency DASH is one of key features of Ant media and seeing the reported issue as breaking, it's kind of unacceptable to wait for months for the fix to reach production.

If you had smaller but more frequent updates, we might be able to downgrade to a version which has RTMP restreaming bug fixed while we wait for the DASH bugfix to be released.

mekya commented 3 years ago

Hi @choxnox ,

We release snapshots sometimes daily and sometimes weekly at https://antmedia.io/latest-snapshot/

It seems that auto change log generation has some problem in the latest snapshot. I can fix that.

So latest snapshot delivery helps you?

choxnox commented 3 years ago

Hi @mekya,

I think the problem is that these snapshots are not production ready (as in they're not properly tested). At least they're not when it comes to other services so I'm not sure about Ant media because even the regular updates almost always introduce new bugs and that's not something we can deploy to production.

mekya commented 3 years ago

hi @choxnox ,

I see. Then I think we need to improve automated testing infrastructure to make the snapshots production ready. Otherwise, releasing frequest updates will take so much time.

I've some ideas about improving testing infrastructure beyond current one.

Do you have any idea about a kind of checklist(tests) to make sure the snapshot is production ready? I can check which one is missing on our side.

Thank you so much for pushing us for that.