Closed tangjjbetsy closed 3 months ago
Did you find out what the problem was later?
Yes, the problem was caused by my tokenisation and segmentation of the midi files. A time-relavant feature bar was used to represent the position of each note, making the model learn to stop as the bar value increases.
Hi, I've adapted the model for music midi synthesising but encountered some issues in inferencing. The training prefix mode is 1. Given the input as
The synthesised audio will always have 3s missing at the beginning. If I input longer audio_prompt, then the same missing at the beginning but shorter generation lengths.
For example, If I input 3s audio prompt with the midi, the AR decoder will output:
The resulted audio starts from the 3s of the midi instead of the beginning. If I input longer audio prompt, the
975
remains the same, the225
might change to500
or600
, while the synthesised audio still starts from the 3s of the midi but ends earlier.I am wondering whether such kind of issue is caused by the prompts I prepared, or maybe there are some issues with the inferencing codes?