Psyop / Cryptomatte

Cryptomatte Nuke plugin, Fusion plugin, sample images, and specification
BSD 3-Clause "New" or "Revised" License
632 stars 151 forks source link

working with multipart? #137

Open houourin opened 3 years ago

houourin commented 3 years ago

I've been following some threads here and in WSL forums about it. I have 2 vray exr files 1 is multipart exr2.0 I think. 2 is multilayered exr1.0

1 doesn't work with cryptomatte, 2 works pefectly just is heavy to load when used on heavy comps. For ease of use I would like to use Multipart but so far not getting it to work with the cryptomatte. I've checked the (1) multipart file layers and there is info in the "VrayCriptomatte" and "VrayCriptomatte00" layer but still no luck into using cryptomatte.

Any advice on where should I touch to fix this?

cedricduriau commented 3 years ago

Hi @houourin

Glad to see you reported this officially on here. If I remember correctly you talked to Kristof about this and I checked the Fusion EXRIO use and I hard code a partnum 1 to read information from. I have very limited knowledge over the multipart + exr version differences.

Any chance you could share the images you tested on?

Cheers Cedric

houourin commented 3 years ago

Hello @cedricduriau

Thank you for your reply! Yes I was commenting that in the forum. I don't have that images, but I just made a new ones.

Each file contains 2 Cryptomattes, one for name object and another for material. both of them where created using VRay. ( I also attached the Max Scene )

Like in the forum the one named Multilayered no problem at all. Is just gets slow very very slow when rendering files that are 200MB each. In the other hand Multipart has a quite decent speed but can't use with Cryptomatte :(

The file was too big to upload here so I'm sharing the wetransfer link.

https://wetransfer.com/downloads/ccbff0d333cef84eacb1cf90dcfd701d20210204032955/3b72aa1d250548e4b9dd102445439de220210204033005/34fd23

Let me know if you have any trouble downloading it. and again, Thank you a lot to looking into this!

cedricduriau commented 3 years ago

Hi @houourin

So I decently checked this out and discussed with Kristof and @jonahfriedman.

It seems like neither Nuke nor Fusion supports this so far. I congratulate you, you're the first one to request this if I'm not mistaken! We can look into supporting this on the Fusion side in the future, but I can already tell you it's not on the roadmap atm.

For Fusion we have some major changes/improvements/fixes incoming, so I'll focus on the next releases. If I ever start prototyping this I will keep you posted. In the meantime I might add a dedicated error to avoid confusion regarding this subject.

And finally, sorry about this, you'll have to stick to multi layer for now. I hope you understand and can work your way around this.

Cheers Cedric

houourin commented 3 years ago

Hi Cédric,

Thank you for your explanation. I was not aware that this wasn't working anywhere haha, sorry, well excited for the new things coming to Fusion anyways! and hope In the future the cryptomatte can be made to work with multipart, the speed improvement is notorious with multipart so would be a shame not to exploit it with cryptomatte :) Meanwhile I'll try to find some good middle ground between speed/practicallity.

Thank you again for giving a look into this.

Best regards!


IGNACIO MULLOR VICH || CG SUPERVISOR / LEAD GENERALIST www.ignaciomullor.com http://www.ignaciomullor.com/

On Tue, 16 Mar 2021 at 08:49, Cédric Duriau @.***> wrote:

Hi @houourin https://github.com/houourin

So I decently checked this out and discussed with Kristof and @jonahfriedman https://github.com/jonahfriedman.

It seems like neither Nuke nor Fusion supports this so far. I congratulate you, you're the first one to request this if I'm not mistaken! We can look into supporting this on the Fusion side in the future, but I can already tell you it's not on the roadmap atm.

For Fusion we have some major changes/improvements/fixes incoming, so I'll focus on the next releases. If I ever start prototyping this I will keep you posted. In the meantime I might add a dedicated error to avoid confusion regarding this subject.

And finally, sorry about this, you'll have to stick to multi layer for now. I hope you understand and can work your way around this.

Cheers Cedric

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/Psyop/Cryptomatte/issues/137#issuecomment-799836872, or unsubscribe https://github.com/notifications/unsubscribe-auth/AL6B4WYPBMTRYNNEF7N2HR3TD2MJXANCNFSM4V5FR2ZQ .

nebukadhezer commented 3 years ago

Hm this sounds strange we use multipart (exr 2.0) with Cryptomatte, you need to make sure that the Cryptolayers remain in 32 bit float... I remember when we still converted exrs after rendering to multiparts that it was not working once we set the rule to 32 bit for all CryptoLayers it worked. Can you check your settings there ? Nowadays we render straight from vray to mutlipart with 32 bit 16 bit mixed... I cannot download the data above, dont know why...

houourin commented 3 years ago

maybe link is outdated I'll repost some data and later today I'll check that out too. thanks for the heads up

On Sat, Apr 10, 2021, 5:13 PM Johannes Hezer @.***> wrote:

Hm this sounds strange we use multipart (exr 2.0) with Cryptomatte, you need to make sure that the Cryptolayers remain in 32 bit float... I remember when we still converted exrs after rendering to multiparts that it was not working once we set the rule to 32 bit for all CryptoLayers it worked. Can you check your settings there ? Nowadays we render straight from vray to mutlipart with 32 bit 16 bit mixed... I cannot download the data above, dont know why...

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/Psyop/Cryptomatte/issues/137#issuecomment-817098656, or unsubscribe https://github.com/notifications/unsubscribe-auth/AL6B4WZTK6XZHSVIJTR26JDTIACDBANCNFSM4V5FR2ZQ .

nebukadhezer commented 3 years ago

I just saw that this is labeled fusion only... might be that the problem is there

houourin commented 3 years ago

mmmm i tried with 32bits multipart and still not working.... Vray Frame buffer can use it to select stuff there ( in the latest version ) but fusion still won't select anything :( What are you using, Resolve?

On Sat, Apr 10, 2021, 5:15 PM Johannes Hezer @.***> wrote:

I just saw that this is labeled fusion only... might be that the problem is there

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/Psyop/Cryptomatte/issues/137#issuecomment-817098887, or unsubscribe https://github.com/notifications/unsubscribe-auth/AL6B4W24HHSYED4WDYLGHMDTIACL3ANCNFSM4V5FR2ZQ .

cedricduriau commented 3 years ago

Just to confirm again, multipart EXR image sequences are not supported right now in Cryptomatte for Fusion. They might work, but even then there is no support for you to select parts. Only multi layered EXR image sequences are supported this far.

cgranjon commented 3 years ago

Hm this sounds strange we use multipart (exr 2.0) with Cryptomatte, you need to make sure that the Cryptolayers remain in 32 bit float... I remember when we still converted exrs after rendering to multiparts that it was not working once we set the rule to 32 bit for all CryptoLayers it worked. Can you check your settings there ? Nowadays we render straight from vray to mutlipart with 32 bit 16 bit mixed... I cannot download the data above, dont know why...

I’d be curious to know if you are doing anything specific to have it work. Does it work straight out of the box or do you any in house tools ?

qumpa commented 2 years ago

Hi, Thank you so much for implementing cryptomatte in fusion, you are absolute heroes. I installed it and tested it with supplied sample images and it all works as it should. Loading multilayered exr (rendered with vray from houdini) in the other hand gives me an error. I set Part dropdown menu to CryptoObject. (I am very fresh to Fusion, trying to switch from Nuke)

Edit: Figured out how to get to console and this is what it is saying: [Cryptomatte][Cryptomatte1_1][ERROR] no cryptomatte metadata found ...cryptomatte/fusion/Modules/Lua/cryptomatte_utilities.lua:615: ERROR stack traceback: [C]: in function 'error' ...cryptomatte/fusion/Modules/Lua/cryptomatte_utilities.lua:615: in function 'log_error' ...cryptomatte/fusion/Modules/Lua/cryptomatte_utilities.lua:695: in function 'get_cryptomatte_metadata' /home/k/.cryptomatte/fusion/Fuses/Matte/cryptomatte.fuse:275: in function </home/k/.cryptomatte/fusion/Fuses/Matte/cryptomatte.fuse:251> Cryptomatte1_1 failed at time 95

Here is exr file if anyone is interested: [[](url)](https://www.dropbox.com/s/zdwcgrs4e36135b/test.exr?dl=0)