Sony IBIS support not working with mismatched frame rate?

gyroflow / gyroflow-plugins

Gyroflow OpenFX, Adobe and frei0r plugins

GNU General Public License v3.0

23 stars 1 forks source link

Sony IBIS support not working with mismatched frame rate? #15

Closed codingcodecs closed 1 month ago

codingcodecs commented 1 month ago

In June of this year, Sony metadata (including IBIS support) was added to Gyroflow.

I did some testing using both the standalone Gyroflow and the latest nightly Gyroflow OFX plugin (with Davinci Resolve).

From my testing, it seems like:

Sony IBIS support is working in the OFX plugin, except when the timeline framerate is mismatched with the footage. In my case, I was using a 50fps clip on a 25fps timeline. The footage (shot with IBIS stabilisation on), does stabilize, however, jitters (that do not show up when using the standalone Gyroflow app), appear (which to me seems to be caused by IBIS or other metadata not being understood by the plugin).

AdrianEddy commented 1 month ago

Did you try the latest dev build of the plugin from here? It was updated yesterday https://gyroflow.xyz/devbuild

codingcodecs commented 1 month ago

Did you try the latest dev build of the plugin from here? It was updated yesterday https://gyroflow.xyz/devbuild

I did indeed! It does work, but is significantly more jerky than using the nightly standalone app build.

codingcodecs commented 1 month ago

Actually, now I found this issue: https://github.com/gyroflow/gyroflow-ofx/issues/54

I think it doesn't have to do with Sony IBIS, but it is just a general bug with mismatched timelines and framerates?

Does this mean you can not use 50fps clips on a 25fps timeline at all without opening in Gyroflow? Opening in Gyroflow also opens the last stable version of Gyroflow, which, unlike the nightly, does not support Sony metadata (such as IBIS) yet, making the workflow very complicated to stabilise 50fps footage on a 25fps timeline.

AdrianEddy commented 1 month ago

What if you add the plugin in Fusion?

codingcodecs commented 1 month ago

What if you add the plugin in Fusion?

Then it does work! Thanks for that!

However, would it be somehow possible to also implement this in the edit page? Using gyroflow in the edit page is way more useful in my option. Or is this a bug in Resolve?

AdrianEddy commented 1 month ago

It's tricky because the OpenFX interface is terribly limited, and Fusion handles time differently than edit or color pages. But in any case, I updated the plugin yesterday to handle the fps mismatch better in the edit page. Are you sure you're have the latest build of the plugin? It should have the Info group at the bottom where it shows project, lens and preset

codingcodecs commented 1 month ago

It's tricky because the OpenFX interface is terribly limited, and Fusion handles time differently than edit or color pages. But in any case, I updated the plugin yesterday to handle the fps mismatch better in the edit page. Are you sure you're have the latest build of the plugin? It should have the Info group at the bottom where it shows project, lens and preset

I see, I am definitely using the latest version (with the info group at the bottom). The status also says "Timeline fps mismatch".

One thing I notice now, which could be a coincidence, but who knows: the first second of the test clip (which is almost 4 seconds long), looks smooth. The jitters seems to start exactly at the 26th frame, the beginning of the 2nd second.

Using gyroflow in the fusion page leads to a fully smooth video.

AdrianEddy commented 1 month ago

Can you send me your file, or a similar sample file which does that thing?

codingcodecs commented 1 month ago

Can you send me your file, or a similar sample file which does that thing?

So, I decided to make another test video, because I would prefer not to publish the initial test video (with a lot of mess in my house haha), to send it to you. The new test video worked perfectly in the edit page as well. Then I made two more, which also worked perfectly.

The initial test video still starts jittering after 1 second, only in the edit page. If I can send you this video privately so it is not published to the internet, for you to investigate what happened (probably some sort of bug), I would be happy to do so. What's the best way to send it to you?

AdrianEddy commented 1 month ago

You can send the WeTransfer link to adrian.eddy@gmail.com

AdrianEddy commented 1 month ago

Should be fixed now