[Bug]: Rife4.6 error when doing interpolation of mp4

chifeisoong commented 1 year ago

Have you read the latest version of the FAQ?

[X] I have visited the FAQ page right now and my issue is not present there

Is there an existing issue for this?

[X] I have searched the existing issues and checked the recent builds/commits of both this extension and the webui

Are you using the latest version of the Deforum extension?

[X] I have Deforum updated to the lastest version and I still have the issue.

What happened?

the RIFE module interpolation couldn't continue after frames is extracted

Steps to reproduce the problem

Go to .... interpolate video / exixting images (load in the mp4)
Press .... interp X = 2 ; slomo=2
...interpolate video

error occur after frames are extracted from video"

FILM engine works OK , only RIFE not working (was working previously)

What should have happened?

No response

WebUI and Deforum extension Commit IDs

webui commit id - a9fed7c364061ae6efb37f797b6b522cb3cf7aa2 deforum exten commit id - ffd2db46f12f95d3d5ab9663100914104d02a649

On which platform are you launching the webui with the extension?

Local PC setup (Windows)

Deforum settings

nil

Webui core settings

nil

Console logs

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "D:\AI\stable-diffusion-webui\venv\lib\site-packages\gradio\routes.py", line 337, in run_predict
    output = await app.get_blocks().process_api(
  File "D:\AI\stable-diffusion-webui\venv\lib\site-packages\gradio\blocks.py", line 1015, in process_api
    result = await self.call_function(
  File "D:\AI\stable-diffusion-webui\venv\lib\site-packages\gradio\blocks.py", line 833, in call_function
    prediction = await anyio.to_thread.run_sync(
  File "D:\AI\stable-diffusion-webui\venv\lib\site-packages\anyio\to_thread.py", line 31, in run_sync
    return await get_asynclib().run_sync_in_worker_thread(
  File "D:\AI\stable-diffusion-webui\venv\lib\site-packages\anyio\_backends\_asyncio.py", line 937, in run_sync_in_worker_thread
    return await future
  File "D:\AI\stable-diffusion-webui\venv\lib\site-packages\anyio\_backends\_asyncio.py", line 867, in run
    result = context.run(func, *args)
  File "D:\AI\stable-diffusion-webui/extensions/deforum-for-automatic1111-webui/scripts\deforum_helpers\args.py", line 1206, in upload_vid_to_interpolate
    process_interp_vid_upload_logic(file, engine, x_am, sl_enabled, sl_am, keep_imgs, f_location, f_crf, f_preset, in_vid_fps, f_models_path, file.orig_name)
  File "D:\AI\stable-diffusion-webui/extensions/deforum-for-automatic1111-webui/scripts\deforum_helpers\frame_interpolation.py", line 64, in process_interp_vid_upload_logic
    process_video_interpolation(frame_interpolation_engine=engine, frame_interpolation_x_amount=x_am, frame_interpolation_slow_mo_enabled = sl_enabled,frame_interpolation_slow_mo_amount=sl_am, orig_vid_fps=in_vid_fps, deforum_models_path=f_models_path, real_audio_track=audio_file_to_pass, raw_output_imgs_path=outdir, img_batch_id=None, ffmpeg_location=f_location, ffmpeg_crf=f_crf, ffmpeg_preset=f_preset, keep_interp_imgs=keep_imgs, orig_vid_name=folder_name, resolution=resolution)
  File "D:\AI\stable-diffusion-webui/extensions/deforum-for-automatic1111-webui/scripts\deforum_helpers\frame_interpolation.py", line 93, in process_video_interpolation
    run_rife_new_video_infer(interp_x_amount=frame_interpolation_x_amount, slow_mo_enabled = frame_interpolation_slow_mo_enabled, slow_mo_x_amount=frame_interpolation_slow_mo_amount, model=actual_model_folder_name, fps=fps, deforum_models_path=deforum_models_path, audio_track=real_audio_track, raw_output_imgs_path=raw_output_imgs_path, img_batch_id=img_batch_id, ffmpeg_location=ffmpeg_location, ffmpeg_crf=ffmpeg_crf, ffmpeg_preset=ffmpeg_preset, keep_imgs=keep_interp_imgs, orig_vid_name=orig_vid_name, UHD=UHD)
  File "D:\AI\stable-diffusion-webui/extensions/deforum-for-automatic1111-webui/scripts/deforum_helpers/src\rife\inference_video.py", line 81, in run_rife_new_video_infer
    raise ValueError(f"{args.modelDir} could not be found. Please contact deforum support {e}")
ValueError: RIFE46 could not be found. Please contact deforum support No module named 'rife.rife_new_gen'

Additional information

No response

chifeisoong commented 1 year ago

deforum commit hash is ffd2db46 *

chifeisoong commented 1 year ago

Manage to fix, by pressing the generate button at least once, after a fresh install

deforum-art / sd-webui-deforum