search

alopatindev / sync-audio-tracks

Audio tracks synchronization command-line tool for video editors that don't support it
Apache License 2.0
61 stars 9 forks source link

[SUGGESTION] AudioAlign (Aurio) algorithms #3

Open MarcoRavich opened 3 years ago

MarcoRavich commented 3 years ago

Hi there, your project is very interesting so I stongly suggest you to "keep an eye" on Aurio/AudioAlign by Mario Guggenberger:

https://github.com/protyposis/AudioAlign

EDIT: Just found another interesting resource -> https://github.com/recastrodiaz/align-audio-recordings-julia

Hope that inspires !

MarcoRavich commented 9 months ago

Bump.

Since 1.5.1 version of AudioAlign was recently released (together with Aurio 4.1.0), we've doxed many similar open projects - like yours - in our HyMPS project, under the AUDIO \ Treatments page \ Alignment/Sync subsection, to (try) push collaboration between them.

Last but not least, let us know how - in your opinion - we could improve categorization/sorting of collected projects in order to push their evolution by favouring collaborations between developers (and not only).

Hope that helps/inspires !

alopatindev commented 9 months ago

Thanks for interest in this project, for mentioning it across other audio synchronization tools, for researching similar tools and for the stimulating this/similar open source tools evolution by pushing devs to collaborate! :heart:

This project is basically just a refactoring/cleanup of the project implemented by @mmccoo. I'm not currently actively working on this project, so for anyone interested — please feel free to fork, improve and/or create PR.

On this occasion, I'll share my thoughts on this tool, please refer/quote them anywhere if you find them useful.

Originally I was interested only in simplest scenario: short audio tracks synchronization for the same sound recorded using couple of mics. My use case was vlog recording tool that, besides other stuff, combines audios taken from phone mic + normal high-quality mic. I'm happy with achieved quality of synchronization here.

Synchronization of movie sound (in original language) and dubbed (in other language) sound is also possible, but very limited.

However covering more complex scenarios is still interesting problem. Specifically it'd be nice to support

Such improvements would make it possible to combine

If anyone will ever achieve this, this would also imply possibility of the following combination:

MarcoRavich commented 9 months ago

Thanks for your "stimulating" reply, Alexander !

Actually there are only 3 quite-active open projects about a/v syncing:

We believe that you have to post your interesting ideas/needs in their repos (as we already done in this issue or @Johndirr - the Subsync author - done for visualizazions here, for example).

Since we're trying to favourite knowledge exchanges between devs, we hope for a "collaborative evolution" of open source projects as free (as in freedom) alternative to commercial products.

Thanks again.

alopatindev commented 9 months ago

It looks like not all of these active projects are currently in active search of improvements.

BBC's (@stephenjolly) audio-offset-finder.

This tool explicitly states "A simple tool and library for finding the offset of an audio file within another file" in the readme.

I will be posting my ideas on improvements anyway, where I see it appropriate, thanks!

I will most likely be spreading the ideas on my YouTube channel(s) as well, hopefully this will create more interest for FLOSS developers.

stephenjolly commented 9 months ago

Yes, if people were interested in building on our project in a way that moved it away from being simple and general purpose, we'd encourage them to do it as a fork (or indeed as a separate project in its own right) rather than add features to the basic tool. It's great to see these ideas being discussed though.

protyposis commented 9 months ago

It looks like not all of these active projects are currently in active search of improvements.

To avoid misunderstandings, Aurio/AudioAlign are open to improvements. What I was meaning to say in that linked post is that I'm not going to implement a list of algorithms just because a random person on the internet posts them :)

MarcoRavich commented 9 months ago

It looks like not all of these active projects are currently in active search of improvements.

You're right (as you can see in this issue, for example), anyway we don't think that's so important in the open source scene: as @stephenjolly and @protyposis clearly claimed here, you can always fork their works... BUT we believe that they can surely provide you the "knowledge" on how their code works in order to develop your needs.

Bytheway having developers (and, why not, users) willing to at least discuss about it is a success already.

Last but not least, it could be also interesting to involve people from specialized communities (example).

Hope that helps.

MarcoRavich commented 9 months ago

BREAKING

@alopatindev may @fsinapsi's FFmatch could fit - a part of - your needs ?

Hope thet helps !

MarcoRavich commented 8 months ago

Bump.

There are many interesting improvements both in recent Aurio and AudioAlign releases, check them out:

Some end users' (like us) tests have detected malfunctions, omissions and possible improvements to fix/add, but it would be even more interesting to have some "alignment experts" - like you - feedbacks/opinions too:

Thanks in advance !

edsonsantoro commented 5 months ago

Thanks @forart for these ions, mentions. Found good apps because of it.

MarcoRavich commented 5 months ago

Thanks @forart for these ions, mentions. Found good apps because of it.

Well, our "issues" are aimed precisely at stimulating the exchange of useful informations/knowledges not only between developers, but among (potential) users too.

MarcoRavich commented 3 months ago

Bump.

Full collection of related open "resources" is now located here: https://github.com/FORARTfe/HyMPS/blob/main/Audio/Treatments.md#alignmentsynch-

Hope that helps.