Other ffmprovisr-suitable tools?

[ablwr]

Growing out of #309 and stemming also from this tweet --

What tools are a good fit for ffmprovisr-style sites, potentially to live immediately adjacent to ffmprovisr in this repo? What is complicated enough to need regular scripting reference?

• Exiftool (Exiftoolkit)?
• ImageMagick (ImageMagickTricks [thanks @kfrn for that one])?
• Bash?
• Pandoc?
• sox?
• exiv2 ref?

[ablwr]

They all at minimum need punny and hard-to-remember-or-search names just like their parent. ;)

[privatezero]

I have been tempted to add a few sox commands into ffmprovisr for a couple of the things sox handles better than ffmpeg - but not sure if there are enough to warrant an adjacent site...

[privatezero]

oh, hahaha I just noticed you had sox on the list already! Sox is good!

[ablwr]

@EG-tech noted it AND you!

[kieranjol]

Mkvpropedit! Editing colour metadata and adding chapters..

On 8 Mar 2018 5:58 pm, "Ashley" notifications@github.com wrote:

@EG-tech https://github.com/eg-tech noted it AND you!

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/amiaopensource/ffmprovisr/issues/310#issuecomment-371569893, or mute the thread https://github.com/notifications/unsubscribe-auth/ABEyvvt7MnpEuON9YuzXfuLjxO4sz6Ydks5tcXFCgaJpZM4Si73I .

[kieranjol]

Also the openssl pipe here is invaluable for calculating the weird hashes in a digital cinema package

Edit: link https://en.wikipedia.org/wiki/Digital_Cinema_Package#Packing_list_file_or_PKL_package_key_list

[kieranjol]

Also https://twitter.com/dericed/status/758275619767582720?s=19 the xxd call in here as a means of analysing binary outputs and determining any potential padding..

[retokromer]

The use of Rubberband and Tesseract (with and/or without FFmpeg) could also be of interest.

[EG-tech]

• ImageMagickMagic
• KnockYourSoxOff
• ExifThroughTheGifShop

[kieranjol]

Sorry for the flood,I think all of mine would be in more of a "misc" site,rather than any of those tools being standalone. I think having those kinds of commands in an ffmprovisr style site would be so helpful tho.

On 8 Mar 2018 6:01 pm, "Kieran O Leary" kieran.o.leary@gmail.com wrote:

Mkvpropedit! Editing colour metadata and adding chapters..

On 8 Mar 2018 5:58 pm, "Ashley" notifications@github.com wrote:

@EG-tech https://github.com/eg-tech noted it AND you!

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/amiaopensource/ffmprovisr/issues/310#issuecomment-371569893, or mute the thread https://github.com/notifications/unsubscribe-auth/ABEyvvt7MnpEuON9YuzXfuLjxO4sz6Ydks5tcXFCgaJpZM4Si73I .

[ablwr]

Yeah that's what I'm thinking about... it would be good to have a misc though, for things related to the same premise but a different tool is better. Trying to think about which ones are complex enough -- ffmpeg really is a BEAST! ImageMagick for sure is weighty.

[retokromer]

Bash is a (little) beast, I presume.

[ablwr]

The biggest beast of all!!!!

[bturkus]

I have nothing to add to this conversation, but I just wanted to say: I love you all. And that I spent all of yesterday screwing around with bash and imagemagick, so you know where my head's at.

On Thu, Mar 8, 2018 at 1:15 PM, Ashley notifications@github.com wrote:

The biggest beast of all!!!!

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/amiaopensource/ffmprovisr/issues/310#issuecomment-371574928, or mute the thread https://github.com/notifications/unsubscribe-auth/AIkiXk8Wr1UOADYWLAQY9WhySgIhAuo1ks5tcXVMgaJpZM4Si73I .

--

Benjamin Turkus | The New York Public Library Assistant Manager for Audio and Moving Image Preservation

Barbara Goldsmith Preservation Division 40 Lincoln Center Plaza, New York, NY 10023 T. 212.870.1609 <(212)870-1609> | benjaminturkus@nypl.org http://www.nypl.org/preservation https://twitter.com/NYPLPreserve

Lifelong Learning | Advancing Knowledge | Strengthening Our Communities

[todrobbins]

maybe a youtube-dl guide for (community) archivists?

[ablwr]

We are wired in, @bturkus.

[ablwr]

Ya @todrobbins do you use youtube-dl?

I guess also it comes down to soliciting for commands people use. ffmprovisr got a jump-start from 1 my totally non-useful commands and 2 being during a hackathon and 3 leeching off of a previous AMIA hackathon's ffmpeg-for-archivists guide which had sample commands in it

[privatezero]

I support all of this! Especially the :heart: , @EG-tech's proposed names, and another +1 for youtube-dl! I use that hella!

[kieranjol]

Aye +1 youtube-dl

On 8 Mar 2018 6:56 pm, "Andrew Weaver" notifications@github.com wrote:

I support all of this! Especially the ❤️ , @EG-tech https://github.com/eg-tech's proposed names, and another +1 for youtube-dl! I use that hella!

— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/amiaopensource/ffmprovisr/issues/310#issuecomment-371586975, or mute the thread https://github.com/notifications/unsubscribe-auth/ABEyvqbq715xnCIXcBhsKtGZVpVz7RYtks5tcX7DgaJpZM4Si73I .

[ablwr]

My secret dream is a hackathon that moves with time zones, like Sunday 10am-5pm but N.Z. gets a head start, and @privatezero is left cleaning up all of the junk commits that have been made, unless we find an a/v archivist with github skills in Hawaii/Alaska. ;)

[kfrn]

but N.Z. gets a head start

I'm happy to write some bugs for y'all to sort out 😎

[ablwr]

wow this just arrived in my inbox https://github.com/learnbyexample/Command-line-text-processing/blob/master/ruby_one_liners.md 😍

[privatezero]

I'm ok with being a closer as long as y'all are prepared for some <!--Free Cascadia--> comments being slipped in after everyone else has wrapped ;-P

[retokromer]

The Roman Empire is falling: I was convinced that <!--Free Cascadia--> is a secret instruction for the compiler!

[kfrn]

Don't forget what we learned from Philip K Dick ....

THE EMPIRE NEVER ENDED

[kieranjol]

+1 empires never ended

On 8 Mar 2018 9:30 pm, "Katherine Frances Nagels" notifications@github.com wrote:

Don't forget what we learned from Philip K Dick ....

THE EMPIRE NEVER ENDED

— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/amiaopensource/ffmprovisr/issues/310#issuecomment-371630859, or mute the thread https://github.com/notifications/unsubscribe-auth/ABEyvtfqfx7ui34H6eIvdUfEhJ5vbmeuks5tcaLlgaJpZM4Si73I .

[todrobbins]

A potential starting point for a youtube-dl guide: https://github.com/bibanon/tubeup

YouTube → Internet Archive

[ablwr]

I'd like to work on this.

Since we aren't sure how big some of these could potentially get (and I'm unsure if any of them could reach the size of ffmpeg, at least for this crowd), how about a compromise like this?

(Adding tools to the bottom of ffmprovisr, and in the ToC of course)

If they grow and the size becomes a problem (like @ross-spencer brought up in #309) we can decide to split at that time, and this way we don't block progress.

But what do y'all think?

Also I need to round up some actual useful examples...

[privatezero]

I think that makes a lot of sense! I can start thinking of some sox things! (Maybe one of the most useful things sox does better than ffmpeg is splitting tracks on silence, and there is a good example right in the sox manual)

[todrobbins]

ToC title could be Similar tools: tips & tricks 🎩🐰

[kieranjol]

Makes sense to me!

On Tue, 27 Mar 2018, 05:01 Tod Robbins, notifications@github.com wrote:

ToC title could be Similar tools: tips & tricks 🎩🐰

— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/amiaopensource/ffmprovisr/issues/310#issuecomment-376389857, or mute the thread https://github.com/notifications/unsubscribe-auth/ABEyvp-hDlPFOp2N8pHcECDOVPBxL0nFks5tibmpgaJpZM4Si73I .

[richardpl]

@privatezero sox is no longer developed for good, what command you speak about?

[ablwr]

I did the thing I know best, which is tweet about it https://twitter.com/ablwr/status/978617812079009792

[ablwr]

I think wget might be able to justify having its own section too.

rsync isn't as complex, but maybe? I also know I can never ever remember the right way to do it.

[kieranjol]

Rsync preserving dates,permissions,with progress updates and stats is a very useful command.

On Tue, 27 Mar 2018, 14:05 Ashley, notifications@github.com wrote:

I think wget might be able to justify having its own section too.

rsync isn't as complex, but maybe? I also know I can never ever remember the right way to do it.

— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/amiaopensource/ffmprovisr/issues/310#issuecomment-376517157, or mute the thread https://github.com/notifications/unsubscribe-auth/ABEyvryoelFD5tnTh2QHHq8fiZZdxLIuks5tijj8gaJpZM4Si73I .

[richardpl]

try curl as alternative to wget

[ablwr]

Maybe wget, rsync, and curl are close enough to group together in one section about collection and transferring data.

[ablwr]

@retokromer Do you happen to have examples of where and when you use tesseract or rubberband? I'm familiar with tesseract, I think it's super useful and robust enough to have a section. Just need some examples to start! 🎉

[todrobbins]

PS: I'm throwing OpenCV into the fray. Come at me!

[JonnyTech]

@todrobbins I am not sure about including OpenCV - all of the other tools can be run from a command line but afaik OpenCV is a software component that requires writing code and then compiling and running it, which imho is out of the scope for most non-programmers.

[privatezero]

@richardpl yes, I think we are all aware that sox is not under active development, and when it either ceases to work or is superseded by other tools then we won't have to consider it. Until then, it remains an effective tool for limited use cases, the aforementioned ability to effectively split files on silence via a single simple command being one of them.

In my experience sox has also supported more reliable capture of audio devices than ffmpeg does. In testing the ffmpeg avfoundation device across a couple different computers it was the common variable in an unacceptable amount of interstitial errors.

[richardpl]

@privatezero And exact command is?

[retokromer]

@ablwr Yes, I can make a PR after the SEAPAVAA and FIAF conferences. We do use tesseract very often, mainly to extract intertitles of silent films (BTW: it works quite well also with the Fraktur of German silents!) or more rarely for subtitle extraction, and rubberband for sound manipulations.

[privatezero]

@richardpl For file splitting? A basic example for splitting a digitized reel at points of silence is sox input.flac output.ogg silence 1 0.50 0.1% 1 2.0 0.1% : newfile : restart

As regarding the avfoundation device, it has been too long to remember, and I am no longer using macOS, but it would have been some variant on ffmpeg -f avfoundation -i 'none:0' -f wav -c:a pcm_s24le -ar 96000..., possibly with some piping involved for the outputs.

[ablwr]

DAMN LOOK AT THIS http://www.fmwconcepts.com/imagemagick/index.php

[richardpl]

ImageMagick have many CVEs, and many of that what is listed there should be doable with FFmpeg, and faster. FFmpeg operates on images too, so if you find something doable in ImageMagick and not doable in FFmpeg please report to FFmpeg bug report tracker.

[retokromer]

Usually, I prefer curl as well. It’s just 20 year old, and still young!

[todrobbins]

@JonnyTech you're right, OpenCV is out of scope. But an GLAM guide utilizing OpenCV would be great. Carry on!

[JonnyTech]

@todrobbins, forgive my ignorance but I am unfamiliar with the term "GLAM guide".

[kieranjol]

GLAM= galleries, libraries,archives,museums.