search

IIIF / iiif-stories

Community repository for documenting stories and use cases related to uses of the International Image Interoperability Framework.
21 stars 0 forks source link

I want to allow a user to enable audio description for a video #145

Open elynema opened 5 months ago

elynema commented 5 months ago

Description

In order to provide a more inclusive experience for visually impaired or blind users, a video canvas may be supplemented by an audio track that describes important visual information, such as physical actions, facial expressions, costumes, settings, scene changes, or on-screen text. The IIIF viewer must be able to identify a track with audio description and allow the user to enable playback of this secondary audio track in lieu of a primary audio track that contains only the original audio.

Currently, audio description is generally enabled at the device level - on a TV or cable box, on a phone or tablet.

Variation(s)

The PBS example player sited below suggests that a similar solution might be relevant for when there are options for a video that is dubbed in one more languages that are not the original language of the video (which is a separate use case from translated subtitles).

Proposed Solutions

(any ideas about how your use case might be supported)

Additional Background

Example instructions for how to turn on audio descriptions to be used with the PBS/PBS Kids sites and apps: https://help.pbs.org/support/solutions/articles/12000084565-how-do-i-enable-audio-description-on-pbs-videos-

For websites, this is generally a configuration that is turned on in the video player: https://help.pbs.org/support/solutions/articles/12000084565-how-do-i-enable-audio-description-on-pbs-videos-#PBSKIDS.org-Website

This screenshot shows how audio description is enabled on the PBS video player. Note that this is a separate option from caption configuration (which is intended to support users who are hard of hearing).

image

You can listen to the audio description for this video here: https://www.pbs.org/video/how-to-have-an-american-baby-1qqspq/

Background on captions, transcripts, and audio description: https://www.tpgi.com/captions-and-transcripts-and-audio-descriptions-oh-my/

elynema commented 4 months ago

Audio description can be provided in a variety of format:

https://www.w3.org/WAI/media/av/description/ https://www.3playmedia.com/blog/add-audio-description-videos/

elynema commented 4 months ago

Audio description can be provided as an alternate track within the video container. Can that be handled by the underlying player without being referenced in IIIF? Is this something we could test with existing IIIF viewers? Not all media players support secondary audio track selection.

Perhaps may just need to provide a recommendation for how to provide these in the video container itself?