vocodedev / vocode-core

🤖 Build voice-based LLM agents. Modular + open source.
https://vocode.dev
MIT License
2.77k stars 462 forks source link

Add support for ssml in agent responses #23

Closed ambrose83646 closed 4 months ago

ambrose83646 commented 1 year ago

right now only the initial message is supported, it would be great to support ssml styles that persist across responses....hope this makes sense

ajar98 commented 1 year ago

adding a bit more information here. two options:

  1. give GPT more expressive power:

    • GPT will need to respond in SSML or in a format 1:1 to SSML
    • our Azure (or other synthesizers that accept SSML) need to have a parameter that turns off creating the default SSML wrapper
  2. support all Azure styles/voice configs in the top level AzureSynthesizerConfig: https://learn.microsoft.com/en-us/azure/cognitive-services/speech-service/speech-synthesis-markup-voice#speaking-styles-and-roles

github-actions[bot] commented 5 months ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

github-actions[bot] commented 4 months ago

This issue has been automatically closed due to inactivity. Thank you for your contributions.