stakira / OpenUtau

Open singing synthesis platform / Open source UTAU successor
http://www.openutau.com
MIT License
1.9k stars 272 forks source link

Make openutau equal to synthesizer V #1201

Open mishav78 opened 3 days ago

mishav78 commented 3 days ago

Acknowledgement

🐛 Describe the bug

How can I do that?

Explains how to reproduce the bug

What high quality voicebanks, and where do I purchase them, and what settings do I need?

OS & Version

Windows 10

Logs

none

oxygen-dioxide commented 3 days ago

If you need more realistic voice, use diffsinger voicebanks. You can get diffsinger voicebanks for free from https://docs.google.com/spreadsheets/d/1fQX-NlFIvfmZJ-S19L86jGPOH_EIJEIygtJqLTUJPfU/edit?usp=sharing You can also search for "diffsinger release" on youtube

mishav78 commented 3 days ago

will it match synthesizer V or be worse? Do I have to use any particular settings?

oxygen-dioxide commented 3 days ago

I don't know much about synthV. You can watch videos on youtube to see how diffsinger voicebanks will sound.

mishav78 commented 3 days ago

In openutau do I need to supply the lyrics and pitches and notes or I can supply just the vocal stem of the song, for example I want it to sing living on a prayer by Bon Jovi the way Bon Jovi sings it, what do I do?

oxygen-dioxide commented 3 days ago

OpenUtau is an SVS (Singing voice synthesis) application. In OpenUtau, you have to input lyrics and musical notes. Currently there is a transcription function inside OpenUtau that analysizes musical notes from singing audio, and you still have to input lyrics. See https://github.com/stakira/OpenUtau/wiki/Getting-Started#transcribe-audio-to-notes If you only have singing audio, you might be interested in SVC (singing voice conversion), such as RVC

mishav78 commented 3 days ago

does it try to match the words you put in to the Words in the vocal stem it analyzes with the transcription function?

oxygen-dioxide commented 3 days ago

does it try to match the words you put in to the Words in the vocal stem it analyzes with the transcription function?

No, it doesn't understand the lyrics. It only gives you musical notes. You have to manually input the lyrics and ensure that they match with the notes.