search

ynput / ayon-deadline

Deadline addon for AYON
Apache License 2.0
3 stars 11 forks source link

failing to Publish Nuke intermediate with sequence on farm if Nuke slate is used #58

Open jrsndl opened 2 weeks ago

jrsndl commented 2 weeks ago

Is there an existing issue for this?

Description

Current Behavior

If intermediate baking preset is configured as extension of image sequence, deadline is failing the publish on validate_expected_and_rendered_files when Nuke Slate is present in the render but not in the intermediate sequence.

Expected Behavior

Integration job should be publishing as expected.

Steps To Reproduce:

  1. setup Nuke ayon+settings://nuke/publish/ExtractReviewIntermediates file extension to jpg
  2. make Nuke script, add Slate node
  3. Publish on farm
  4. the render and it's extract review intermediate is rendered, and publish fails on validate_expected_and_rendered_files

Additional context:

Version

Server 1.42, ayon_core 1.06, ayon_nuke 0.2.5, ayon_deadline 0.3.2

What platform were you running when you found the bug?

Windows

Maybe there needs to be a condition like this in validation: https://github.com/ynput/ayon-deadline/blob/b4f636203d6202c7208b5f5495d76397aed1a482/client/ayon_deadline/plugins/publish/nuke/submit_nuke_deadline.py#L511

Relevant log output:

ERROR:pyblish.plugin:Traceback (most recent call last):
2024-11-11 13:59:01:  0: STDOUT:   File "C:\Users\farmuser\AppData\Local\Ynput\AYON\dependency_packages\ayon_2406251801_windows.zip\dependencies\pyblish\plugin.py", line 528, in __explicit_process
2024-11-11 13:59:01:  0: STDOUT:     runner(*args)
2024-11-11 13:59:01:  0: STDOUT:   File "C:\Users\farmuser\AppData\Local\Ynput\AYON\addons\deadline_0.3.2\ayon_deadline\plugins\publish\global\validate_expected_and_rendered_files.py", line 86, in process
2024-11-11 13:59:01:  0: STDOUT: RuntimeError: Missing expected files: ['renderCompMain.mezzanine.1000.jpg']

renderCompMain_metadata.json
{
    "comment": "farm slate",
    "deadline_publish_job_id": "6731feae0079a42c49550d6d",
    "folderPath": "/shots/shrt/shrt_sh010",
    "fps": 23.976024627685547,
    "frameEnd": 1012,
    "frameStart": 1003,
    "instances": [
        {
            "bakingNukeScripts": [
                {
                    "bakeRenderPath": "//server/mount/projects/T037_Ayon_IOtest2/shots/shrt/shrt_sh010/work/comp/renders/nuke/renderCompMain/renderCompMain.mezzanine.####.jpg",
                    "bakeScriptPath": "//server/mount/projects/T037_Ayon_IOtest2/shots/shrt/shrt_sh010/work/comp/renders/nuke/renderCompMain/renderCompMain.mezzanine.####.nk",
                    "bakeWriteNodeName": "Write1"
                }
            ],
            "colorspace": "ACES - ACES2065-1",
            "comment": "farm slate",
            "deadline": {
                "auth": null,
                "require_authentication": false,
                "url": "http://dps-deadline01.server:8082",
                "verify": true
            },
            "extendFrames": null,
            "families": [
                "render",
                "review",
                "render2d",
                "ftrack",
                "slate"
            ],
            "folderPath": "/shots/shrt/shrt_sh010",
            "fps": 23.976024627685547,
            "frameEnd": 1012,
            "frameEndHandle": 1014,
            "frameStart": 1003,
            "frameStartHandle": 1001,
            "handleEnd": 2,
            "handleStart": 2,
            "inputVersions": [],
            "jobBatchName": "",
            "multipartExr": false,
            "overrideExistingFrame": null,
            "pixelAspect": 2.0,
            "productName": "renderCompMain",
            "productType": "render",
            "representations": [
                {
                    "colorspaceData": {
                        "colorspace": "Output - Rec.709",
                        "config": {
                            "path": "\\\\server\\mount\\projects\\T037_Ayon_IOtest2\\ocio\\aces_1.2\\config.ocio",
                            "template": "{root[work]}/{project[name]}/ocio/aces_1.2/config.ocio"
                        }
                    },
                    "data": {
                        "isIntermediate": true,
                        "isMultiIntermediates": false
                    },
                    "ext": "jpg",
                    "files": [
                        "renderCompMain.mezzanine.1001.jpg",
                        "renderCompMain.mezzanine.1002.jpg",
                        "renderCompMain.mezzanine.1003.jpg",
                        "renderCompMain.mezzanine.1004.jpg",
                        "renderCompMain.mezzanine.1005.jpg",
                        "renderCompMain.mezzanine.1006.jpg",
                        "renderCompMain.mezzanine.1007.jpg",
                        "renderCompMain.mezzanine.1008.jpg",
                        "renderCompMain.mezzanine.1009.jpg",
                        "renderCompMain.mezzanine.1010.jpg",
                        "renderCompMain.mezzanine.1011.jpg",
                        "renderCompMain.mezzanine.1012.jpg",
                        "renderCompMain.mezzanine.1013.jpg",
                        "renderCompMain.mezzanine.1014.jpg"
                    ],
                    "frameEnd": 1014,
                    "frameStart": 1001,
                    "name": "mezzanine",
                    "outputName": "mezzanine",
                    "stagingDir": "{root[work]}/T037_Ayon_IOtest2/shots/shrt/shrt_sh010/work/comp/renders/nuke/renderCompMain",
                    "tags": [
                        "mezzanine",
                        "review",
                        "need_thumbnail"
                    ]
                },
                {
                    "colorspaceData": {
                        "colorspace": "ACES - ACES2065-1",
                        "config": {
                            "path": "\\\\server\\mount\\projects\\T037_Ayon_IOtest2\\ocio\\aces_1.2\\config.ocio",
                            "template": "{root[work]}/{project[name]}/ocio/aces_1.2/config.ocio"
                        }
                    },
                    "ext": "exr",
                    "files": [
                        "renderCompMain.1000.exr",
                        "renderCompMain.1001.exr",
                        "renderCompMain.1002.exr",
                        "renderCompMain.1003.exr",
                        "renderCompMain.1004.exr",
                        "renderCompMain.1005.exr",
                        "renderCompMain.1006.exr",
                        "renderCompMain.1007.exr",
                        "renderCompMain.1008.exr",
                        "renderCompMain.1009.exr",
                        "renderCompMain.1010.exr",
                        "renderCompMain.1011.exr",
                        "renderCompMain.1012.exr",
                        "renderCompMain.1013.exr",
                        "renderCompMain.1014.exr"
                    ],
                    "fps": 23.976024627685547,
                    "frameEnd": 1014,
                    "frameStart": 1000,
                    "name": "exr",
                    "stagingDir": "{root[work]}/T037_Ayon_IOtest2/shots/shrt/shrt_sh010/work/comp/renders/nuke/renderCompMain",
                    "tags": []
                },
                {
                    "colorspaceData": {
                        "colorspace": "ACES - ACES2065-1",
                        "config": {
                            "path": "\\\\server\\mount\\projects\\T037_Ayon_IOtest2\\ocio\\aces_1.2\\config.ocio",
                            "template": "{root[work]}/{project[name]}/ocio/aces_1.2/config.ocio"
                        }
                    },
                    "ext": "jpg",
                    "files": [
                        "renderCompMain.mezzanine.1000.jpg",
                        "renderCompMain.mezzanine.1001.jpg",
                        "renderCompMain.mezzanine.1002.jpg",
                        "renderCompMain.mezzanine.1003.jpg",
                        "renderCompMain.mezzanine.1004.jpg",
                        "renderCompMain.mezzanine.1005.jpg",
                        "renderCompMain.mezzanine.1006.jpg",
                        "renderCompMain.mezzanine.1007.jpg",
                        "renderCompMain.mezzanine.1008.jpg",
                        "renderCompMain.mezzanine.1009.jpg",
                        "renderCompMain.mezzanine.1010.jpg",
                        "renderCompMain.mezzanine.1011.jpg",
                        "renderCompMain.mezzanine.1012.jpg",
                        "renderCompMain.mezzanine.1013.jpg",
                        "renderCompMain.mezzanine.1014.jpg"
                    ],
                    "fps": 23.976024627685547,
                    "frameEnd": 1014,
                    "frameStart": 1000,
                    "name": "jpg",
                    "stagingDir": "{root[work]}/T037_Ayon_IOtest2/shots/shrt/shrt_sh010/work/comp/renders/nuke/renderCompMain",
                    "tags": []
                }
            ],
            "resolutionHeight": 1556,
            "resolutionWidth": 1828,
            "slate": true,
            "slateFrames": {
                "mezzanine": "//server/mount/projects/T037_Ayon_IOtest2/shots/shrt/shrt_sh010/work/comp/renders/nuke/renderCompMain/renderCompMain_mezzanine_slate.png"
            },
            "source": "{root[work]}/T037_Ayon_IOtest2/shots/shrt/shrt_sh010/work/comp/shrt_sh010_comp_v000.nk",
            "stagingDir_persistent": true,
            "task": "comp",
            "useSequenceForReview": false,
            "version": 0
        }
    ],
    "intent": null,
    "job": {
        "Aux": [],
        "Bad": [],
        "ComFra": 0,
        "CompletedChunks": 0,
        "ConcurrencyToken": null,
        "DataSize": -1,
        "Date": "2024-11-11T13:55:09.9437792+01:00",
        "DateComp": "0001-01-01T00:00:00Z",
        "DateStart": "0001-01-01T00:00:00Z",
        "Errs": 0,
        "ExtraElements": null,
        "FailedChunks": 0,
        "IsSub": false,
        "Mach": "dps-deadline01",
        "Main": false,
        "MainEnd": 0,
        "MainStart": 0,
        "OutDir": [
            "/server/mount/projects/T037_Ayon_IOtest2/shots/shrt/shrt_sh010/work/comp/renders/nuke/renderCompMain"
        ],
        "OutFile": [
            "renderCompMain.mezzanine.####.jpg"
        ],
        "PendingChunks": 0,
        "Plug": "Nuke",
        "Props": {
            "AWSPortalAssetFileWhitelist": [],
            "AWSPortalAssets": [],
            "AutoTime": false,
            "AuxSync": false,
            "Batch": "shrt_sh010_comp_v000.nk",
            "Chunk": 10,
            "Cmmt": "farm slate",
            "Conc": 1,
            "ConcLimt": true,
            "Dep": [
                {
                    "EndOffset": 0,
                    "IgnoreFrameOffsets": false,
                    "JobID": "6731fead0079a42c49550d6b",
                    "Notes": "",
                    "OverrideFrameOffsets": false,
                    "OverrideResumeOn": false,
                    "ResumeOnComplete": true,
                    "ResumeOnDeleted": false,
                    "ResumeOnFailed": false,
                    "ResumeOnPercentageCompleted": false,
                    "ResumeOnPercentageValue": 0.0,
                    "StartOffset": 0
                }
            ],
            "DepComp": true,
            "DepDel": false,
            "DepFail": false,
            "DepFrame": false,
            "DepFrameEnd": 0,
            "DepFrameStart": 0,
            "DepPer": -1.0,
            "Dept": "comp",
            "Env": {
                "AYON_APP_NAME": "nuke/14-0v6",
                "AYON_BUNDLE_NAME": "Dazzle-2024-11-04-03",
                "AYON_DEFAULT_SETTINGS_VARIANT": "production",
                "AYON_FOLDER_PATH": "/shots/shrt/shrt_sh010",
                "AYON_LOG_NO_COLORS": "1",
                "AYON_PROJECT_NAME": "T037_Ayon_IOtest2",
                "AYON_RENDER_JOB": "1",
                "AYON_TASK_NAME": "comp",
                "AYON_WORKDIR": "\\\\server\\mount\\projects\\T037_Ayon_IOtest2\\shots\\shrt\\shrt_sh010\\work\\comp",
                "FOUNDRY_LICENSE": "4101@dps-lic01",
                "FTRACK_API_KEY": "ZWE3ZDM3OWMtODFlNi00ZjFmLWJmYmQtNzkxMDU3NDgyNDNmOjo5ZGFjNTA5OC1lZGFkLTQxN2ItYTIxYy0yYzFiMDg2YTVkYjQ",
                "FTRACK_API_USER": "jiri.sindelar",
                "FTRACK_SERVER": "https://dazzlepictures.ftrackapp.com",
                "NUKE_PATH": "C:\\Users\\jiri.sindelar\\AppData\\Local\\Ynput\\AYON\\addons\\nuke_0.2.5\\ayon_nuke\\startup;E:\\_GFX_library\\nuke_new;{OPENPYPE_STUDIO_PLUGINS}\\nuke",
                "OCIO_OPTIMIZATION_FLAGS": "0"
            },
            "EnvOnly": false,
            "EventDir": "",
            "EventOI": [],
            "Ex0": "",
            "Ex1": "",
            "Ex2": "",
            "Ex3": "",
            "Ex4": "",
            "Ex5": "",
            "Ex6": "",
            "Ex7": "",
            "Ex8": "",
            "Ex9": "",
            "ExDic": {},
            "FrameTimeout": false,
            "Frames": "1001-1014",
            "FriStart": "-10675199.02:48:05.4775808",
            "FriStop": "-10675199.02:48:05.4775808",
            "Grp": "nuke",
            "InitializePluginTime": 0,
            "Int": false,
            "IntPer": 100,
            "JobFailErr": 0,
            "JobFailOvr": false,
            "Limits": [
                "nuke"
            ],
            "ListedSlaves": [],
            "MachLmt": 0,
            "MachLmtProg": -1.0,
            "MaxTime": 0,
            "MinTime": 0,
            "MonStart": "-10675199.02:48:05.4775808",
            "MonStop": "-10675199.02:48:05.4775808",
            "Name": "renderCompMain.mezzanine.####.jpg",
            "NoBad": false,
            "NoEvnt": false,
            "NotEmail": [],
            "NotNote": "",
            "NotOvr": false,
            "NotUser": [
                "jiri.sindelar"
            ],
            "OnComp": 2,
            "OptIns": {},
            "OverAutoClean": false,
            "OverClean": false,
            "OverCleanDays": 0,
            "OverCleanType": 1,
            "OvrTaskEINames": false,
            "PathMap": [],
            "PlugDir": "",
            "PlugInfo": {
                "AWSAssetFile0": "//server/mount/projects/T037_Ayon_IOtest2/shots/shrt/shrt_sh010/work/comp/renders/nuke/renderCompMain/renderCompMain.mezzanine.####.jpg",
                "OutputFilePath": "//server/mount/projects/T037_Ayon_IOtest2/shots/shrt/shrt_sh010/work/comp/renders/nuke/renderCompMain",
                "ProjectPath": "//server/mount/projects/T037_Ayon_IOtest2/shots/shrt/shrt_sh010/work/comp/renders/nuke/renderCompMain/renderCompMain.mezzanine.####.nk",
                "SceneFile": "//server/mount/projects/T037_Ayon_IOtest2/shots/shrt/shrt_sh010/work/comp/renders/nuke/renderCompMain/renderCompMain.mezzanine.####.nk",
                "UseGpu": "False",
                "Version": "14.0",
                "WriteNode": "Write1"
            },
            "PoJobScrp": "",
            "PoTskScrp": "",
            "Pool": "all",
            "PrJobScrp": "",
            "PrTskScrp": "",
            "Pri": 50,
            "Protect": false,
            "Region": "",
            "Reload": false,
            "RemTmT": 0,
            "ReqAss": [],
            "SatStart": "-10675199.02:48:05.4775808",
            "SatStop": "-10675199.02:48:05.4775808",
            "Schd": 0,
            "SchdDate": "2024-11-11T13:55:09.9430661+01:00",
            "SchdDays": 1,
            "SchdStop": "0001-01-01T00:00:00Z",
            "ScrDep": [],
            "SecPool": "all",
            "Seq": false,
            "SndEmail": false,
            "SndPopup": false,
            "SndWarn": true,
            "StartTime": 0,
            "SunStart": "-10675199.02:48:05.4775808",
            "SunStop": "-10675199.02:48:05.4775808",
            "TaskEx0": "",
            "TaskEx1": "",
            "TaskEx2": "",
            "TaskEx3": "",
            "TaskEx4": "",
            "TaskEx5": "",
            "TaskEx6": "",
            "TaskEx7": "",
            "TaskEx8": "",
            "TaskEx9": "",
            "Tasks": 2,
            "ThuStart": "-10675199.02:48:05.4775808",
            "ThuStop": "-10675199.02:48:05.4775808",
            "TimeScrpt": false,
            "Timeout": 1,
            "TskFailErr": 0,
            "TskFailOvr": false,
            "TueStart": "-10675199.02:48:05.4775808",
            "TueStop": "-10675199.02:48:05.4775808",
            "User": "jiri.sindelar",
            "WedStart": "-10675199.02:48:05.4775808",
            "WedStop": "-10675199.02:48:05.4775808",
            "White": false
        },
        "Purged": false,
        "QueuedChunks": 0,
        "RenderingChunks": 0,
        "SnglTskPrg": "0 %",
        "Stat": 6,
        "SuspendedChunks": 0,
        "Tile": false,
        "TileCount": 0,
        "TileFile": [],
        "TileFrame": 0,
        "TileX": 0,
        "TileY": 0,
        "_id": "6731fead0079a42c49550d6c"
    },
    "source": "{root[work]}/T037_Ayon_IOtest2/shots/shrt/shrt_sh010/work/comp/shrt_sh010_comp_v000.nk",
    "user": "jiri.sindelar",
    "version": 0
}
jrsndl commented 2 weeks ago

Additional note: The jpeg representation is for some reason listed twice in the render json.