qiuyu96 / CoDeF

[CVPR'24 Highlight] Official PyTorch implementation of CoDeF: Content Deformation Fields for Temporally Consistent Video Processing
https://qiuyu96.github.io/CoDeF/
Other
4.84k stars 385 forks source link

How can I reduce the blur in my canonical image? #75

Open vedantroy opened 1 year ago

vedantroy commented 1 year ago

I have this clip:

https://github.com/qiuyu96/CoDeF/assets/8407819/8d579b02-50a5-40a4-8847-3ce70a4fc3dc

The canonical image is very blurry:

canonical_0

Is this expected behavior? Is this just the result because the clip has too much motion?

Experiment config:

mask_dir: null

img_wh: [1920, 1080]
canonical_wh: [1920, 1080]
# canonical_wh: [720, 1280]

lr: 0.001
bg_loss: 0.003

ref_idx: null # 0

N_xyz_w: [8,]
flow_loss: 1
flow_step: -1
self_bg: True

deform_hash: True
vid_hash: True

num_steps: 10000
decay_step: [2500, 5000, 7500]
annealed_begin_step: 4000
annealed_step: 4000
save_model_iters: 2000