IIIF / cookbook-recipes

For working on the recipes
https://iiif.io/api/cookbook/index.html
37 stars 32 forks source link

timeMode=loop and caption annotations #504

Open azaroth42 opened 5 months ago

azaroth42 commented 5 months ago

If there's a video or audio playing with timeMode=loop, and the canvas is longer than the timed media, and there are annotations associated with timed parts of the media (such as captions, but could be anything) ... how can the clock reset for the looping media be aligned with the other annotations?

Is this a case where you'd annotate a Canvas with the audio and the other annotations, and then annotate the canvas into the larger one with loop? I believe that would work but would like a second opinion. If not, then is there an existing solution, or do we need more specification machinery?

azaroth42 commented 5 months ago

Another scenario which I think we deal with (by calling it an error):

Video lasts for 120 seconds, annotated with timeMode=trim to a 60 second canvas. There are captions for the full video. No problem so far -- the captions for the second minute just won't render as they're out side the timeline of the canvas.

But if you put the annotations into a search API, then they could be discovered, even though the canvas would never render them. Don't Do That Then?

azaroth42 commented 3 months ago

This seems like a recipe, not an issue. Propose transfer to cookbook repo.

glenrobson commented 2 months ago

Cookbook group agree it would be good to look at creating some timeMode recipes.