olavea / gatsby-theme-picture-book

Create a Do-It-Yourself picture book together with a child you know.
https://petra-rabbit.netlify.com
7 stars 2 forks source link

[Discussion] Audio playback logic #12

Open raae opened 5 years ago

raae commented 5 years ago

Should turning of pages jump to the correct location in the book?

I kind of like that one can flip a little around while listening. But how can one get audio/images back in sync?

Or is this not a problem?

Maybe do some user testing on kids :D

raae commented 5 years ago

Any ideas @testower?

testower commented 5 years ago

So assuming that turning pages should cause the audio to jump to a specific location, would it not also make sense for the pages to turn automatically when the audio reaches certain locations?

In any case you would want some mechanism to keep track of which audio segments belong to which images / pages. A couple of ideas:

'00': '00:00:00',
'01': '00:01:32',
'02': '00:02:15',
...

So when you flip a page, the audio player simply skips to the location in the audio defined in the data structure. Similarly, when the audio player reaches a certain location, the application will need to detect that and flip the page automatically.

I have no idea if this is what kids would expect though :D