Sleepwalking
commented
11 years ago To fill up the whole phonetic system of a particular language (like Chinese), CDT 3 does multi-level mapping on CVDBs. It's possible to use only "a.cvdb" to reconstruct all vowels in a language! (though the synthesis quality might be horrible) This is achieved by FECSOLA and the mapping structure of CDT 3:
The same way can be also applied on consonant-vowel diphones, for example, "da". The consonant part "d" will be skipped in modification and only the vowel part "a" will be transformed into other pronunciations.
Like its predecessor CDT 2.4, CDT 3 also has a syllable table, used by CGTOR 3:
...
Entry &uo
Type CAV
TRatio 1
TList
T &[ u
T p2 o
T p1 p2
End
End
Entry zun
Type CAVV
TRatio 0.5
TList
T z[ u
T p2 e
T p2 n
T p1 p2
T p1 p2
End
End
...
There is no restriction on the phonetic symbol you use for a sound db in RE3, which means you can use custom phonetic symbol system! It's also possible to achieve multi-language synthesis support because RE3 use syllables as input, not whole words from a specific language.
In Chinese we use one syllable for each word, which could be directly fitted in CDT 3: "这" - zhe “是” - shi “一” - yi “个” - ge “测” - ce “试” - shi The above words means "this is a test". To synthesis english, the above sentence is supposed to be written as: thi / s / eh / s / ah / teh / s / t Corresponding pronunciation symbol used by HatsuneMiku(CHN) 1.6.1: z3 / s# / e- i / s# / a e- / t3 / s# / t3 I've never tried those staffs, I guess it would be almost pure "Chinglish", better if we use IPA...
m13253
As I wrote in README.md before, the next version will be totally rewritten again, like the evolution from Rocaloid1 to Rocaloid1.6.
Currently the version of RSC, CVS, and CDT format has already reached 2.x, which means they are in different version with the synthesizer. Also considering the significant change in synthesis algorithm(TDPSM -> FECSOLA), I've decided to name the next generation as "Rocaloid Engine 3" instead of 2, along with CVE 3.
Here I have to restate the definition and relations of "Rocaloid Engine":
RSC will not be included in Rocaloid Engine anymore, because RSC is strongly related to the note editor, and dealing with editor settings and musical notations is not the business of Rocaloid Engine. RSC will be replaced by RVS(Rocaloid Vocal Script), which describes the general (but not in detail) information of notes and lyrics (but not phonemes). CVS Generator will be responsible for transforming RVS into CVS. The transformation from RSC (or .vsqx, .vsq, .ust, .nn, etc.) to RVS should be simple (does not require professional phonetics knowledge).
Altogether, the major components and formats in RE3(Rocaloid Engine 3) will be:
Additionally, CVS 3 and RVS 3 will be stored in binary instead of text. This is because formant data will be included in CVS and RVS, which will greatly increase the file size, and slow down the IO performance. (approximately a CVS 3 text file which contains a song will be 10MB)