lyrics alignment: demo Jingju

[georgid]

Let us create a demo with one Jingju aria in same format as in https://github.com/MTG/dunya/issues/350: one list for each syllable, a word is a list of syllables, a sentence is a list of words. alignedLyricsSyllables is a list of sentences.

audio here: https://github.com/elitrout/JingjuSingingAnnotation/blob/master/lyrics2audio/praat_rules/3folds/fold1/xixiangji_biyuntian.wav

{'alignedLyricsSyllables': [[[[38.11016058542974, 38.54016058542974, u'bi', -1]], [[38.55016058542974, 40.72016058542974, u'yun', -1]], [[40.73016058542974, 46.35016058542974, u'tian', -1]], [[47.34016058542974, 49.79016058542974, u'huang', -1]], [[49.80016058542974, 52.73016058542974, u'hua', -1]], [[52.74016058542974, 57.45016058542974, u'di', -1]], [[58.44016058542974, 59.520160585429736, u'xi', -1]], [[59.53016058542974, 62.03016058542974, u'feng', -1]], [[62.04016058542974, 72.46016058542975, u'jin', -1]]], [[[75.15525630405251, 75.32525630405252, u'bei', -1]], [[75.33525630405252, 75.57525630405252, u'yan', -1]], [[75.58525630405252, 77.11525630405252, u'nan', -1]], [[77.12525630405251, 79.18525630405252, u'xiang', -1]], [[79.19525630405252, 79.22525630405252, u'wen', -1]], [[79.23525630405251, 84.16525630405252, u'xiao', -1]], [[84.40525630405251, 84.82525630405252, u'lai', -1]], [[84.8352563040525, 87.24525630405252, u'shui', -1]], [[87.25525630405251, 87.28525630405251, u'ran', -1]], [[87.29525630405251, 88.05525630405252, u'de', -1]], [[88.06525630405251, 90.02525630405252, u'shuang', -1]], [[90.04525630405251, 90.0852563040525, u'lin', -1]], [[90.09525630405251, 94.39525630405251, u'jiang', -1]]], [[[94.45954816358753, 97.78954816358753, u'zong', -1]], [[97.79954816358753, 104.50954816358752, u'shi', -1]], [[104.51954816358753, 107.06954816358753, u'li', -1]], [[107.07954816358753, 110.59954816358753, u'ren', -1]], [[110.60954816358753, 110.63954816358753, u'lei', -1]], [[110.64954816358753, 113.89954816358753, u'qian', -1]], [[113.90954816358753, 119.79954816358753, u'hang', -1]]], [[[131.181146735753, 131.441146735753, u'cheng', -1]], [[131.451146735753, 131.661146735753, u'jiu', -1]], [[131.671146735753, 136.401146735753, u'chi', -1]], [[137.391146735753, 137.501146735753, u'fen', -1]], [[138.491146735753, 141.201146735753, u'bie', -1]], [[141.211146735753, 142.661146735753, u'zao', -1]], [[142.671146735753, 145.891146735753, u'jiao', -1]], [[145.901146735753, 146.51114673575302, u'ren', -1]], [[146.521146735753, 148.521146735753, u'chou', -1]], [[148.531146735753, 155.211146735753, u'chang', -1]]], [[[156.0457278509428, 156.4357278509428, u'xi', -1]], [[156.4457278509428, 156.5057278509428, u'bu', -1]], [[156.5157278509428, 158.3357278509428, u'zhu', -1]], [[158.3657278509428, 159.2657278509428, u'jun', -1]], [[159.2757278509428, 159.2957278509428, u'ma', -1]], [[159.3057278509428, 160.2357278509428, u'er', -1]], [[160.24572785094279, 161.6457278509428, u'kong', -1]], [[161.6557278509428, 165.8457278509428, u'you', -1]], [[165.8557278509428, 165.8757278509428, u'zhe', -1]], [[165.8857278509428, 169.9457278509428, u'liu', -1]], [[169.9557278509428, 170.2857278509428, u'si', -1]], [[170.2957278509428, 173.1557278509428, u'chang', -1]]], [[[173.86912167534567, 175.01912167534567, u'qi', -1]], [[175.02912167534566, 176.28912167534565, u'xing', -1]], [[176.29912167534567, 190.01912167534567, u'che', -1]], [[190.02912167534566, 192.29912167534567, u'kuai', -1]], [[193.28912167534565, 195.30912167534566, u'yu', -1]], [[195.31912167534566, 204.04912167534567, u'wo', -1]], [[204.05912167534566, 205.02912167534566, u'ba', -1]], [[205.03912167534565, 205.05912167534566, u'ma', -1]], [[205.06912167534566, 205.15912167534566, u'er', -1]], [[205.16912167534568, 206.20912167534567, u'gan', -1]], [[206.21912167534566, 220.78912167534565, u'shang', -1]]], [[[221.44950882413016, 221.81950882413017, u'na', -1]], [[221.82950882413016, 224.49950882413017, u'shu', -1]], [[224.50950882413017, 228.95950882413015, u'lin', -1]], [[228.96950882413017, 229.29950882413016, u'ye', -1]], [[229.30950882413018, 231.16950882413016, u'yu', -1]], [[231.17950882413015, 234.93950882413017, u'wo', -1]], [[234.94950882413016, 235.30950882413018, u'gua', -1]], [[235.31950882413017, 236.12950882413017, u'zhu', -1]], [[236.13950882413016, 238.41950882413016, u'liao', -1]], [[238.43950882413017, 239.42950882413015, u'xie', -1]], [[239.43950882413017, 242.20950882413015, u'yang', -1]]], [[[242.27156374622206, 244.85156374622207, u'hao', -1]], [[245.00156374622205, 250.17156374622206, u'jiao', -1]], [[250.53156374622205, 258.35156374622204, u'wo', -1]], [[259.34156374622205, 259.36156374622203, u'yu', -1]], [[260.35156374622204, 260.38156374622207, u'zhang', -1]], [[261.36156374622203, 265.21156374622205, u'lang', -1]], [[265.22156374622205, 265.35156374622204, u'ba', -1]], [[265.36156374622203, 265.89156374622206, u'zhi', -1]], [[265.90156374622205, 266.0015637462221, u'xin', -1]], [[266.01156374622207, 268.20156374622206, u'hua', -1]], [[268.21156374622205, 277.9415637462221, u'jiang', -1]]], [[[291.21923839044024, 291.21923839044024, u'yuan', -1]], [[291.21923839044024, 291.21923839044024, u'wang', -1]], [[291.21923839044024, 291.33923839044024, u'na', -1]], [[291.34923839044023, 292.30923839044027, u'shi', -1]], [[292.31923839044026, 293.78923839044023, u'li', -1]], [[293.7992383904402, 300.21923839044024, u'ting', -1]], [[301.1792383904403, 301.20923839044025, u'tong', -1]], [[302.15923839044024, 304.6192383904403, u'duan', -1]], [[304.62923839044026, 304.9892383904403, u'ren', -1]], [[304.99923839044027, 309.45923839044025, u'chang', -1]]]], 'sectionlinks': {'section_annotations': [{'melodicStructure': 'line_1', 'time': [38.07766058542974, 72.48938323235353]}, {'melodicStructure': 'line_2', 'time': [75.12275630405252, 94.42704816358753]}, {'melodicStructure': 'line_3', 'time': [94.42704816358753, 119.82273929048364]}, {'melodicStructure': 'line_4', 'time': [131.148646735753, 155.23816484922423]}, {'melodicStructure': 'line_5', 'time': [156.0132278509428, 173.18013174478554]}, {'melodicStructure': 'line_6', 'time': [173.83662167534567, 220.81383825769655]}, {'melodicStructure': 'line_7', 'time': [221.41700882413016, 242.23906374622206]}, {'melodicStructure': 'line_8', 'time': [242.23906374622206, 277.97261234374525]}, {'melodicStructure': 'line_9', 'time': [291.20673839044025, 314.048164054722]}]}}

[georgid]

polyphonic version of audio available here: /mnt/compmusic/incoming/Beijing_opera/audio/黄梅 京剧名段唱腔精华集/黄梅 京剧名段唱腔精华集 - CD1

[georgid]

MBID 22d00424-5e9c-4ecb-abda-84c05109e8e8

[andrebola]

@georgid I made a very basic player to show the alignment: http://dunya.compmusic.upf.edu/makam/basic-lyric-align/f1a41e47-584b-44d4-b963-cbaa311d5d27#

[georgid]

@andrebola great! Lyrics display is correct. One remark: the navigation bar (below) ends at 3:16 but the song playback continues until 5:29. In fact I would like to play as an example the last line (line_10) from this song, so I need definitely to be able to play directly from the last line, which cannot be done now, since the navigation for the last entries is not seen. If you dont have time, as a workaround, we might cut the first half of the aria, so that the end is visible.

[andrebola]

Ok, I fixed that.