VR Mode skipping frames

[seandearnaley]

Tried the new VR mode in 5.2-- ran a large batch and noticed the frame files had many randomly missing frames, making stitching impossible--- started after frame 10 so wonder if it's turbo related [update 4/11/22 5:47pm tried turbo off, no frame file name skipping]-thinking this must be some kind of bug...

{
    "text_prompts": {
        "0": [
            "Cybernetic Xenomorph by H.R. Giger, highly detailed rendering in the style of colorful visionary art"
        ]
    },
    "image_prompts": {},
    "clip_guidance_scale": 51000,
    "tv_scale": 75,
    "range_scale": 1666,
    "sat_scale": 90000,
    "cutn_batches": 1,
    "max_frames": 10000,
    "interp_spline": "Linear",
    "init_image": null,
    "init_scale": 1000,
    "skip_steps": 10,
    "frames_scale": 1500,
    "frames_skip_steps": "60%",
    "perlin_init": false,
    "perlin_mode": "mixed",
    "skip_augs": false,
    "randomize_class": true,
    "clip_denoised": false,
    "clamp_grad": true,
    "clamp_max": 0.05,
    "seed": 1436827437,
    "fuzzy_prompt": false,
    "rand_mag": 0.05,
    "eta": 0.8,
    "width": 832,
    "height": 448,
    "diffusion_model": "512x512_diffusion_uncond_finetune_008100",
    "use_secondary_model": true,
    "steps": 100,
    "diffusion_steps": 1000,
    "diffusion_sampling_mode": "ddim",
    "ViTB32": true,
    "ViTB16": true,
    "ViTL14": false,
    "RN101": false,
    "RN50": true,
    "RN50x4": false,
    "RN50x16": false,
    "RN50x64": false,
    "cut_overview": "[12]*400+[4]*600",
    "cut_innercut": "[4]*400+[12]*600",
    "cut_ic_pow": 1,
    "cut_icgray_p": "[0.2]*400+[0]*600",
    "key_frames": true,
    "angle": "0:(0)",
    "zoom": "0: (1)",
    "translation_x": "0: (0)",
    "translation_y": "0: (0)",
    "translation_z": "0:(15)",
    "rotation_3d_x": "0: (0)",
    "rotation_3d_y": "0: (0)",
    "rotation_3d_z": "0:(-0.002)",
    "midas_depth_model": "dpt_large",
    "midas_weight": 0.3,
    "near_plane": 200,
    "far_plane": 10000,
    "fov": 120,
    "padding_mode": "border",
    "sampling_mode": "bicubic",
    "video_init_path": "/content/training.mp4",
    "extract_nth_frame": 2,
    "video_init_seed_continuity": true,
    "turbo_mode": true,
    "turbo_steps": "2",
    "turbo_preroll": 10
}

[aletts]

Can you send your output filename listing? It's likely really helpful in debugging.

Or alternatively, maybe no one ever tested it with turbo_mode set to True. I don't know if that's compatible with VR Mode. If that's the case, we should note it (and/or fix it).

[seandearnaley]

here is an example one-- you can see the frame filenames start jumping after 10, im trying with turbo off now and it seems to be working fine. filenamelisting.txt

[twmmason]

I'll run some investigations on this and see if there is an issue.