IIIF / iiif-av

The International Image Interoperability Framework (IIIF) Audio/Visual (A/V) Technical Specification Group aims to extend to A/V the benefits of interoperability and the growing ecosystem of clients and servers that IIIF provides for images. This repository contains user stories and mockups for interoperable A/V content – contributions are welcome.
http://iiif.io/community/groups/av/
Apache License 2.0
13 stars 3 forks source link

Thumbnails of audio/video #16

Open jronallo opened 8 years ago

jronallo commented 8 years ago

Description

Thumbnails of audio/video -- image that represents the video, then sub-thumbnails for time based ranges. For video, and for ranges / different shots.

Variation(s)

Use existing mechanisms for association of thumbnails with Manifest, Sequence, Canvas, Range etc. Question of how to deal with more structured sets of thumbnails for key-frames etc - use annotation list of images, might need paging for many images (e.g. every 5s for a few hours).

Additional Background

Source: BL workshop notes Interest: 100%

jronallo commented 8 years ago

This has two pieces. We need a way to extract a still image out of a video in a similar way that we are able to extract a tile from a large image. This is the AV-API. I had thought that a URL like the following would work: /identifier/temporal-slice/region/size/rotation/quality.format

This could work for still images, but what would a URL structure look like for an animated GIF? Or is that not really the still image part of the AV-API, but also part of requesting a video--whatever that video request URL might look like--but just with the format ".gif" instead of ".mp4" and then the server, if it supports that, returns whatever animated GIF it can?

The other part is the Presentation API where a still image or animated GIF could be associated with various parts of a manifest as described in the proposed solution.

Is there a case where what you want back as a summary of a section of a video is not a still image or animated GIF, but actually a video compressed in the temporal dimension? So frames could be dropped in order to do this. I know a video would be a better experience, higher quality, and with greater compression than an animated GIF. How would the AV-API support returning this kind of video summary? How would the Presentation API support using a video as a "thumbnail"?

workergnome commented 7 years ago

Again, commenting here—if we define temporal slices as a start moment and a duration, this becomes a lot easier. Then it's just id/moment:5-duration:0/full/full/none/default.jpg