Closed bartekleon closed 12 months ago
hey @bartekleon, i encountered this as well.
gen_sequence_len
in my case was always 4 tokens more then needed for generation, i think its the padding tokens being counted.
it gets trimmed away in this line:
This is because of the delayed pattern, see our paper for detailed. In my opinion this is not really worth fixing, and would require complex interactions between the model and the API code. In the demo we now just cap that number.
The current token (amount of generated tokens) and total amount of tokens do not match up. (I got 1003/1000 tokens for 20s audio)
1000 makes sense as it's duration (20) * frame_rate (50)
Somewhere in audiocraft.models.lm
generate
function is some issue in counting