TeleMelody: Lyric-to-Melody Generation with a Template-Based Two-Stage Method

[tatsuropfgt]

TeleMelody: Lyric-to-Melody Generation with a Template-Based Two-Stage Method [EMNLP22]

Abstract

• two-stage system, lyrics-to-template and template-to-melody
• generated melody can be controlled by adjusting the template

Method

Template

Architecture

• Alignment Regularization [EMNLP19]

[tatsuropfgt]

results

• PD: similarity of pitch distribution with gt
• DD: similarity of duration distribution with gt
• MD: melody distance

• TA: the accuracy of tonality
• CA: the accuracy of chord
• RA: the accuracy of rhythm pattern
• AA: the accuracy of cadence