Expand the functionality for TTS in Jovo 4.
This includes:
[x] TtsPlugin - base plugin for other TTS plugins to inherit from
[ ] PollyTts plugin (WIP) - a TTS provider for Amazon Polly
[x] BaseTtsCache plugin - items found in the cache don't call Polly to generate
[x] S3TtsCache plugin - a cache for S3 website that serves up audio files
[ ] Add methods on JovoResponse to iterate all spoken items in platform-specific response
[ ] Add $tts object to Jovo during response.tts and add audio to Web/Core responses - see proposal
[ ] FFmpegCombine plugin for cases when there are multiple web urls for a given item
To see the main components and the WIP implementation see jovo4-sample-polly-tts
NOTE: For some reason, the response.tts middleware doesn't fire from Jovo Debugger. There is an open issue about this.
I'm willing to work with anyone on the Jovo team to complete the design and do most of the implementation. Need some help working with JovoResponse and putting all the files in the correct places.
I think all these changes can be made without any breaking changes.
Current Behavior
No TTS functionality for v4. This very much needed especially when it comes to Web/Core responses if you want to customize the voice output.
I'm submitting a...
Expected Behavior
Expand the functionality for TTS in Jovo 4. This includes:
TtsPlugin
- base plugin for other TTS plugins to inherit fromPollyTts
plugin (WIP) - a TTS provider for Amazon PollyBaseTtsCache
plugin - items found in the cache don't call Polly to generateS3TtsCache
plugin - a cache for S3 website that serves up audio filesJovoResponse
to iterate all spoken items in platform-specific response$tts
object toJovo
duringresponse.tts
and add audio to Web/Core responses - see proposalFFmpegCombine
plugin for cases when there are multiple web urls for a given itemTo see the main components and the WIP implementation see jovo4-sample-polly-tts NOTE: For some reason, the
response.tts
middleware doesn't fire from Jovo Debugger. There is an open issue about this.I'm willing to work with anyone on the Jovo team to complete the design and do most of the implementation. Need some help working with
JovoResponse
and putting all the files in the correct places.I think all these changes can be made without any breaking changes.
Current Behavior
No TTS functionality for v4. This very much needed especially when it comes to Web/Core responses if you want to customize the voice output.
Error Log
No error
Your Environment
@jovotech/cli: 4.1.6
Jovo packages of the current project :
@jovotech/cli-command-build: 4.1.6 @jovotech/cli-command-deploy: 4.1.6 @jovotech/cli-command-get: 4.1.6 @jovotech/cli-command-new: 4.1.6 @jovotech/cli-command-run: 4.1.7 @jovotech/cli-core: 4.1.7 @jovotech/common: 4.2.9 @jovotech/db-filedb: 4.2.15 @jovotech/filebuilder: 0.0.1 @jovotech/framework: 4.2.15 @jovotech/model: 4.0.0 @jovotech/model-nlpjs: 4.0.0 @jovotech/nlu-nlpjs: 4.2.15 @jovotech/output: 4.2.11 @jovotech/platform-core: 4.2.15 @jovotech/platform-web: 4.2.15 @jovotech/plugin-debugger: 4.2.16 @jovotech/server-express: 4.2.15 Environment: System: OS: Windows 10 10.0.22000 Binaries: Node: 14.19.0 - C:\Program Files\nodejs\node.EXE npm: 8.10.0 - C:\Program Files\nodejs\npm.CMD