:high_brightness: To make media on the web more accessible we believe that every piece of spoken-word audio and video should come with an Interactive Transcript.:high_brightness:
Hyperaudio Lite - is an Interactive Transcript Viewer
You can use Hyperaudio Lite to provide Interactive Transcripts, this readme details why and how.
As demonstrated here https://hyperaudio.github.io/hyperaudio-lite/ plus equivalent multiplayer version
Active word version https://hyperaudio.github.io/hyperaudio-lite/active.html
Alternatively styled version https://lab.hyperaud.io/mozfest2021/interviews/lance_weiler/
YouTube Integration https://hyperaudio.github.io/hyperaudio-lite/youtube.html
SoundCloud Integration https://hyperaudio.github.io/hyperaudio-lite/soundcloud.html
Vimeo Integration https://hyperaudio.github.io/hyperaudio-lite/vimeo.html
VideoJS Integration https://hyperaudio.github.io/hyperaudio-lite/videojs.html
VidStack Integration https://hyperaudio.github.io/hyperaudio-lite/vidstack.html
Spotify Integration https://hyperaudio.github.io/hyperaudio-lite/spotify.html
Vitorio's version https://github.com/vitorio/hyperaudio-lite
Interactive transcripts are transcripts with special powers. Hyperaudio's Interactive Transcripts are called Hypertranscripts and are infused with the following hyper-powers:
Click on the text to navigate directly to the part of the audio where that word was said.
Find words and phrases inside your transcript and make your media search-engine friendly.
Selecting part of a transcript creates a URL with timing data which when shared will take people directly to the corresponding piece of audio where the highlighted words are spoken.
Hypertranscripts contain the following data:
data-m milliseconds)data-d milliseconds)That's it!
Here's an example:
<p>
<span data-m="52890" data-d="0" class="speaker">Alexandra: </span>
<span data-m="52890" data-d="90">I </span>
<span data-m="52980" data-d="240">think </span>
<span data-m="53220" data-d="720">unfortunately </span>
<span data-m="53970" data-d="60">at </span>
<span data-m="54030" data-d="60">the </span>
<span data-m="54090" data-d="270">minute, </span>
<span data-m="54390" data-d="180">we </span>
<span data-m="54570" data-d="180">make </span>
<span data-m="54750" data-d="270">people </span>
<span data-m="55020" data-d="300">aware </span>
<span data-m="55320" data-d="90">of </span>
<span data-m="55410" data-d="150">their </span>
<span data-m="55560" data-d="480">personal </span>
<span data-m="56040" data-d="330">data </span>
<span data-m="56370" data-d="210">when </span>
<span data-m="56580" data-d="480">terrible </span>
<span data-m="57060" data-d="300">things </span>
<span data-m="57360" data-d="510">happen. </span>
</p>Hyperaudio Lite is "tag agnostic" so for example, you could use other tags instead of <span> to wrap words.
You could also make headings link to chapter points using attributes, like this:
<h5 data-m="214800">
What kind of help is available for people to manage their own data?
</h5>We can see that a Hypertranscript is really just HTML, this helps keep it:
The best way is to use the Hyperaudio Lite Editor.
Another way is to use the Hyperaudio Converter
This currently takes 4 possible inputs:
*JavaScript Object Notation - a common data format
Essentially the Hyperaudio Lite library is made from 4 JavaScript files:
hyperaudio-lite.js - the core that deals with the linking of media to wordshyperaudio-lite wrapper - adds search, selection and playback rate functionalityand the associated CSS files:
hyperaudio-lite-player.cssWe also link to Velocity 1.5 for autoscroll.
Add to your HTML file in the following way:
<head>
<link rel="stylesheet" href="https://github.com/hyperaudio/hyperaudio-lite/blob/main/css/hyperaudio-lite-player.css">
<script src="https://cdnjs.cloudflare.com/ajax/libs/velocity/1.5.0/velocity.js"></script>
</head>and at the end of the <body>:
<script src="https://github.com/hyperaudio/hyperaudio-lite/raw/main/js/hyperaudio-lite.js"></script>
<script src="https://github.com/hyperaudio/hyperaudio-lite/raw/main/js/hyperaudio-lite-wrapper.js"></script>
</body>Finally instantiate the Transcript Player:
let minimizedMode = false;
let autoScroll = true;
let doubleClick = false;
let webMonetization = false;
let playOnClick = true;
new HyperaudioLite("hypertranscript", "hyperplayer", minimizedMode, autoScroll, doubleClick, webMonetization, playOnClick);If you want to use the native audio/video capabilities of your browser, you would define your player something like this:
<video id="hyperplayer" controls></video>or in the case of audio:
<audio id="hyperplayer" controls></audio>Optionally, you can include your source media file in the player definition:
<video id="hyperplayer" controls src="https://example.com/somevideo.mp4"></video>Note – hyperplayer is the id that you will use to instantiate (see above).
If you want to use other players such as YouTube or Soundcloud, use the embeds in the following sections instead.
You will also need to define your interactive transcript – something like this:
<div id="hypertranscript" class="hyperaudio-transcript">
<article>
<section data-media-src="https://example.com/somevideo.mp4">
<p>
<span data-m="4470" data-d="0" class="speaker">Doc: </span>
<span data-m="4470" data-d="270">We </span>
<span data-m="4740" data-d="240">have </span>
<span data-m="5010" data-d="300">two </span>
<span data-m="5310" data-d="600">selves </span>
<span data-m="6030" data-d="150">in </span>
<span data-m="6180" data-d="120">the </span>
<span data-m="6300" data-d="300">world </span>
<span data-m="6600" data-d="90">at </span>
<span data-m="6690" data-d="150">any </span>
<span data-m="6840" data-d="300">given </span>
<span data-m="7140" data-d="310">time </span>
<span data-m="7540" data-d="180">now. </span>
</p>
</section>
</article>
</div>Note – it is up to you where you define your media source. In our examples we include it in the transcript itself using the data-media-src attribute.
View the source code of https://hyperaudio.github.io/hyperaudio-lite/ for a complete example.
See a version with multiple players in a single page https://hyperaudio.github.io/hyperaudio-lite/multiplayer.html
In addition to supporting the web-native HTML <audio> and <video> elements we also support a YouTube iframe embed.
Example of YouTube iframe embed:
<iframe
id="hyperplayer"
data-player-type="youtube"
width="400"
height="300"
frameborder="no"
allow="autoplay"
src="https://www.youtube.com/embed/xLcsdc823dg?enablejsapi=1"
>
</iframe>We also support a SoundCloud iframe embed.
Example of Soundcloud API and iframe embed:
<script src="https://w.soundcloud.com/player/api.js"></script>
<iframe
id="hyperplayer"
data-player-type="soundcloud"
width="100%"
height="166"
scrolling="no"
frameborder="no"
allow="autoplay"
src="https://w.soundcloud.com/player/?url=https%3A//api.soundcloud.com/tracks/730479133&color=%23ff5500&auto_play=false&hide_related=false&show_comments=true&show_user=true&show_reposts=false&show_teaser=true"
></iframe>You can get the snippet of code by visiting the page of the SoundCloud file you're interested in, clicking on Share and then Embed.
We also now support Vimeo and VideoJS players. See the Vimeo example and VideoJS example for how to emebed. Please let us know if their are other types of players you wish us to support by creating an issue.
For those using native video, we also provide a way to add autogenerated captions.
First, ensure that your video player has a text track defined:
<video id="hyperplayer" controls>
<track id="hyperplayer-vtt" label="English" kind="subtitles" srclang="en" src="https://github.com/hyperaudio/hyperaudio-lite/raw/main/">
</video>Next, make sure you include the caption.js file:
<script src="https://github.com/hyperaudio/hyperaudio-lite/raw/main/js/caption.js"></script>and finally add this snippet of JavaScript after instantiating the HyperaudioLite object:
let cap1 = caption();
cap1.init("hypertranscript", "hyperplayer", '37' , '21'); // transcript Id, player Id, max chars, min chars for caption lineWeb Monetization is a JavaScript browser API that allows the creation of a payment stream from the user agent to the website and a proposed W3C standard.
You can use this with Hyperaudio Lite to apportion streaming funds (from viewers with Web Monetization compatible wallets and browser extensions) to different sources depending on the transcript or part of the transcript you are currently listening to.
To activate set the Web Monetization parameter when instantiating a new HyperaudioLite object to true, for example:
let minimizedMode = false;
let autoScroll = true;
let doubleClick = false;
let webMonetization = true;
let playOnClick = true;
new HyperaudioLite("hypertranscript", "hyperplayer", minimizedMode, autoScroll, doubleClick, webMonetization, playOnClick);If you then set the data-wm attributes in your transcript streaming will be switched to that payment pointer when encountered.
<article data-wm="$ilp.uphold.com/123article">
<section data-wm="$ilp.uphold.com/123section">
<h5 data-m="0">How do we make people more aware of their personal data?</h5>
<p data-wm="$ilp.uphold.com/123Doc">
<span data-m="4470" data-d="0" class="speaker">Doc: </span>
<span data-m="4470" data-d="270">We </span>
<span data-m="4740" data-d="240">have </span>
<span data-m="5010" data-d="300">two </span>
<span data-m="5310" data-d="600">selves </span>
...Note – if a data-wm attribute is not present in an element Hyperaudio Lite will check the parent (and parent's parent etc) until it finds one.
Currently we use Jest for testing.
Install Jest using yarn:
yarn add --dev jest
then
yarn add -D jest-environment-jsdom
Or npm:
npm install --save-dev jest
then
npm install -D jest-environment-jsdom
To run the tests:
yarn test or npm run test
Note: If you have issues runing the tests, try a more recent version of node. (node v18.0.0 should work).
Find out more about the Hyperaudio Project at hyper.audio or contact mark@hyperaud.io