search

DachunKai / EvTexture

[ICML 2024] EvTexture: Event-driven Texture Enhancement for Video Super-Resolution
https://dachunkai.github.io/evtexture.github.io/
Apache License 2.0
804 stars 47 forks source link

request for colab notebook #2

Open GeeveGeorge opened 1 week ago

GeeveGeorge commented 1 week ago

hope you guys setup a colab inference notebook where users can upload .mp4 and check the results.

DachunKai commented 1 week ago

Thank you for your suggestion! Our model is an event-based VSR method that requires both video and event data as input as link, with event data can be generated using an event simulator. We plan to simplify this process and provide a convenient Colab notebook for inference on user-provided videos. Additionally, we aim to deploy our model on HuggingFace for easier future access.

DachunKai commented 1 week ago

@GeeveGeorge Hi, GeeveGeorge. We noticed that runpod.io has already implemented a Colab notebook for testing our model. Thanks to runpod.io for this effort! We hope it helps you, but we haven't tested it yet. For user-provided videos, we are working on developing a simple system that allows users to upload their videos and receive super-resolved results. Thank you!

FDFGGH commented 1 week ago

@GeeveGeorge Hi, GeeveGeorge. We noticed that runpod.io has already implemented a Colab notebook for testing our model. Thanks to runpod.io for this effort! We hope it helps you, but we haven't tested it yet. For user-provided videos, we are working on developing a simple system that allows users to upload their videos and receive super-resolved results. Thank you!

tested. not working = (

0smboy commented 4 days ago

@FDFGGH jupyter try this:


!git clone https://github.com/camenduru/EvTexture
!mkdir -p /content/EvTexture/experiments/pretrained_models/EvTexture

!wget https://github.com/DachunKai/EvTexture/releases/download/v0.0/EvTexture_REDS_BIx4.pth -O /content/EvTexture/experiments/pretrained_models/EvTexture/EvTexture_REDS_BIx4.pth
!wget https://github.com/DachunKai/EvTexture/releases/download/v0.0/EvTexture_Vimeo90K_BIx4.pth -O /content/EvTexture/experiments/pretrained_models/EvTexture/EvTexture_Vimeo90K_BIx4.pth
!wget https://github.com/DachunKai/EvTexture/releases/download/v0.0/test_sets_REDS4_h5.zip -O /content/EvTexture/experiments/pretrained_models/EvTexture/test_sets_REDS4_h5.zip
!wget https://github.com/DachunKai/EvTexture/releases/download/v0.0/test_sets_Vid4_h5.zip -O /content/EvTexture/experiments/pretrained_models/EvTexture/test_sets_Vid4_h5.zip
!wget https://github.com/DachunKai/EvTexture/releases/download/v0.0/visual_results_EvTexture_REDS4_BIx4.zip -O /content/EvTexture/experiments/pretrained_models/EvTexture/visual_results_EvTexture_REDS4_BIx4.zip
!wget https://github.com/DachunKai/EvTexture/releases/download/v0.0/visual_results_EvTexture_Vid4_BIx4.zip -O /content/EvTexture/experiments/pretrained_models/EvTexture/visual_results_EvTexture_Vid4_BIx4.zip

%cd /content/EvTexture/experiments/pretrained_models/EvTexture
!unzip test_sets_Vid4_h5.zip
!mv /content/EvTexture/experiments/pretrained_models/EvTexture/Vid4_h5 /content/EvTexture/datasets/Vid4_h5

%cd /content/EvTexture/experiments/pretrained_models/EvTexture
!unzip test_sets_REDS4_h5.zip
!mv /content/EvTexture/experiments/pretrained_models/EvTexture/REDS4_h5 /content/EvTexture/datasets/REDS4_h5

%cd /content/EvTexture
!pip install .

%cd /content/EvTexture
!python basicsr/test.py -opt options/test/EvTexture/test_EvTexture_Vid4_BIx4.yml

%cd /content/EvTexture
!python basicsr/test.py -opt options/test/EvTexture/test_EvTexture_REDS4_BIx4.yml
0smboy commented 4 days ago

Testing ok on ubuntu:

#prepare pretrained_models dirs
cd /opt/
git clone https://github.com/camenduru/EvTexture
cd EvTexture
mkdir -p experiments/pretrained_models/EvTexture

#download model and data files
cd experiments/pretrained_models/EvTexture
wget https://github.com/DachunKai/EvTexture/releases/download/v0.0/EvTexture_REDS_BIx4.pth 
wget https://github.com/DachunKai/EvTexture/releases/download/v0.0/EvTexture_Vimeo90K_BIx4.pth 
wget https://github.com/DachunKai/EvTexture/releases/download/v0.0/test_sets_REDS4_h5.zip
wget https://github.com/DachunKai/EvTexture/releases/download/v0.0/test_sets_Vid4_h5.zip

# unzip datasets
unzip test_sets_Vid4_h5.zip
mv Vid4_h5 /opt/EvTexture/datasets/
unzip test_sets_REDS4_h5.zip
mv REDS4_h5 /opt/EvTexture/datasets/

#install dependencies
cd /op/EvTexture
pip install .

#run single gpu for Vid4
python basicsr/test.py -opt options/test/EvTexture/test_EvTexture_Vid4_BIx4.yml
#run single gpu for REDS4
python basicsr/test.py -opt options/test/EvTexture/test_EvTexture_REDS4_BIx4.yml

#run multi gpus for Vid4
python -m torch.distributed.run --nproc_per_node=8 --master_port=7860 basicsr/test.py -opt options/test/EvTexture/test_EvTexture_Vid4_BIx4.yml --launcher pytorch

#run multi gpus for REDS4
python -m torch.distributed.run --nproc_per_node=8 --master_port=7860 basicsr/test.py -opt options/test/EvTexture/test_EvTexture_REDS4_BIx4.yml --launcher pytorch
FDFGGH commented 4 days ago

@0smboy, I'm not much of a pro. I can't say I'm really familiar with command prompt. While testing this notebook I'm getting some errors and script stops. I can copy the output of what I'm encountering.

DachunKai commented 3 days ago

Hi everyone. We've uploaded a Colab file for a quick test. Special thanks to @0smboy and the EvTexture-jupyter project.

FDFGGH commented 2 days ago

@DachunKai thanks. are there any instructions how to use it?

DachunKai commented 2 days ago

@FDFGGH Maybe you can read this tutorial link to learn how to use Google Colab. Thanks.

FDFGGH commented 2 days ago

I (kind of) know how to use the Collab. How to feed video files into this exact notebook?