search

morevnaproject-org / papagayo-ng

Papagayo is a lip-syncing program designed to help you line up phonemes (mouth shapes) with the actual recorded sound of actors speaking. Papagayo makes it easy to lip sync animated characters by making the process very simple - just type in the words being spoken (or copy/paste them from the animation's script), then drag the words on top of the sound's waveform until they line up with the proper sounds.
233 stars 51 forks source link

Time chunks truncated? #118

Closed Bazmundi closed 2 years ago

Bazmundi commented 2 years ago

Expected behaviour: a pgo file time chunks add up to the length of the audio in seconds and synfig uses that to paint a timeline of that length

Actual behaviour: A WAV file of 14 seconds imported into Synfig 1.4.2 replays only for about 5 seconds?!

I assume the "times" below represent the time divided by the fps? If so the numbers make sense that they are right, as they seem to reflect most of 14 secs? The fps was set to 24.

lipsync version 1
uneffected.wav
24
336
1
    Voice 1
    check one two|check one two|peter piper picked a parcel of pickled peppers|she sells sea shells by the sea sure
    4
        check one two
        15
        47
        3
            check 15 26 3
                15 etc
                19 E
                23 etc
            one 27 35 3
                27 WQ
                30 AI
                33 etc
            two 36 47 2
                36 etc
                42 U
        check one two
        58
        87
        3
            check 58 68 3
                58 etc
                62 E
                65 etc
            one 69 76 3
                69 WQ
                72 AI
                74 etc
            two 77 87 2
                77 etc
                83 U
        peter piper picked a parcel of pickled peppers
        103
        184
        8
            peter 103 112 4
                103 MBP
                106 E
                108 etc
                111 E
            piper 113 122 4
                113 MBP
                116 AI
                118 MBP
                121 E
            picked 124 132 4
                124 MBP
                126 AI
                129 etc
                131 etc
            a 134 135 1
                134 AI
            parcel 146 150 6
                146 MBP
                147 AI
                148 etc
                149 etc
                150 AI
                150 L
            of 153 160 2
                153 AI
                157 FV
            pickled 161 170 6
                161 MBP
                163 AI
                164 etc
                166 AI
                168 L
                169 etc
            peppers 172 184 5
                172 MBP
                175 E
                177 MBP
                180 E
                182 etc
        she sells sea shells by the sea sure
        205
        293
        8
            she 205 212 2
                205 etc
                209 E
            sells 213 229 4
                213 etc
                217 E
                222 L
                226 etc
            sea 230 238 2
                230 etc
                235 E
            shells 239 254 4
                239 etc
                243 E
                247 L
                251 etc
            by 256 263 2
                256 MBP
                260 AI
            the 264 271 2
                264 etc
                268 AI
            sea 273 279 2
                273 etc
                277 E
            sure 281 293 3
                281 etc
                285 U
                290 etc

I also see the same problem with the same audio file under Pappagayo 2.0b1 if that helps?

Understand it may be Synfig etc., but starting with the start of the tool chain makes sense.

The audio WAV file was made with Audacity. Project rate: 44100 Hz Encoding: 16bit PCM

Some problem then for the pappagayo plugin?

Note, I was lulled into a false sense of security as I successfully made a lipsync as a trial, but the audio was only 4.5 seconds long.

Is there then a limit on audio used for lip sync? It isn't apparent from the information I can glean from searches.

Bazmundi commented 2 years ago

DOH! My first cine style editor, so I bumbled through with a little help and found I had to set number of frames to play/rendor/preview in Synfig.