daily-demos / daily-bots-web-demo

Daily Bots Web Demo showcasing how to build real-time voice AI agents 
156 stars 50 forks source link

How to make Daily support Chinese? 如何让daily支持中文 #2

Open ailab2017 opened 2 months ago

ailab2017 commented 2 months ago

看官网 cartesia 是支持sonic-multilingual,也就是支持多语言的,但是在项目中,并没有看到对应的教程,支持对中文的适配。如果需要在daily的demo中 让bots支持中文,应该如何修改呢对应的配置呢?是修改route.ts的配置,还是修改rtvi.config.ts的配置,可否给出明确的说明

According to the official website, cartesia supports sonic-multilingual, which means it supports multiple languages. However, I did not find any corresponding tutorial in the project for adapting to Chinese. If we need to make the bots in the daily demo support Chinese, how should we modify the configuration? Should we modify the configuration in route.ts or in rtvi.config.ts? Could you provide clear instructions?

以下是我修改rtvs.config的示例,其中我配置可能存在错误,能否给出正确的配置方法 modify rtvs.config.ts rtvi config ts 1 rtvi config ts 2 是修改rtvs还是修改config modify app/config.ts daily_bot_config

markbackman commented 2 months ago

Hi @ailab2017, we're in the process of adding support for different languages now; Chinese (Mandarin) is planned for support. This is already built and in testing internally. We should have this released as early as today but no later than Tuesday, Sep 3.

markbackman commented 2 months ago

An update on this: we have added support for multiple languages (English, French, Spanish, and German), but at the moment, that doesn't include Chinese. We want to support a wide array of languages, including Chinese. This is a priority for us and we'll let you know when it's available.

ailab2017 commented 2 months ago

更新:我们增加了对多种语言(英语、法语、西班牙语和德语)的支持,但目前不包括中文。我们希望支持多种语言,包括中文。这是我们的首要任务,我们会在可用时通知您。 image

https://cartesia.ai/sonic 看官网的demo,其是支持中文的。

我们现在在适配这个项目,因为gpt4o一定是支持中文的,所以dayliy基于Cartesia的 sonic-multilingual能够支持中文,那就太好了,非常期待你们能支持中文,等待这个好消息。期待你的回复。 We are now adapting to this project, because GPT-4o must support Chinese, so it would be great that Cartesia-based sonic-multilingual could support Chinese. We look forward to your support for Chinese and your reply.

markbackman commented 2 months ago

Cartesia is great(!), and they do support Chinese. But, their Chinese implementation is missing a feature that their other languages, like English, German, French, and Spanish, have. We've communicated with Cartesia, and they'll be adding full support for Chinese by mid Q4 (hopefully sooner! 🤞).

To help support more languages right away, we're looking to add support for ElevenLabs which will give you options, including Chinese. This is something we'll build this week and ship soon after—hopefully next week.