search

microsoft / cognitive-services-speech-sdk-js

Microsoft Azure Cognitive Services Speech SDK for JavaScript
Other
267 stars 101 forks source link

[Bug]: bookmark and punctuation timestamp misaligned #829

Open branaway opened 5 months ago

branaway commented 5 months ago

What happened?

<speak version='1.0' xmlns="http://www.w3.org/2001/10/synthesis" xmlns:mstts="https://www.w3.org/2001/mstts" xml:lang='en-US'>
        <voice name='en-US-BrianNeural'>
john: <bookmark mark="@newline"/> hello
        </voice>
      </speak>

two problems:

  1. The ':' before the bookmark carried a timestamp that was later than the bookmark.
  2. with the @ I received empty string as the bookmark; without it, I received garbled junk characters.

The whole bookmark thing is weird!

Version

1.36.0 (Latest)

What browser/platform are you seeing the problem on?

No response

Relevant log output

No response

branaway commented 5 months ago

and also tried emojis, well...

ForrestGumb commented 5 months ago

Issue #1: send bookmark event before word boundary event for ":". This is a TTS service issue. When bookmark is beside a punctuation, TTS service can't guarantee the order of bookmark event and word boundary event of punctuation. There's no clear plan to fix this issue.

Issue #2 is the same as https://github.com/microsoft/cognitive-services-speech-sdk-js/issues/828. We'll fix it.