Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

request for colab notebook #2

Open
GeeveGeorge opened this issue Jun 23, 2024 · 10 comments
Open

request for colab notebook #2

GeeveGeorge opened this issue Jun 23, 2024 · 10 comments

Comments

@GeeveGeorge
Copy link

hope you guys setup a colab inference notebook where users can upload .mp4 and check the results.

@DachunKai
Copy link
Owner

Thank you for your suggestion! Our model is an event-based VSR method that requires both video and event data as input as link, with event data can be generated using an event simulator. We plan to simplify this process and provide a convenient Colab notebook for inference on user-provided videos. Additionally, we aim to deploy our model on HuggingFace for easier future access.

@DachunKai
Copy link
Owner

@GeeveGeorge Hi, GeeveGeorge. We noticed that runpod.io has already implemented a Colab notebook for testing our model. Thanks to runpod.io for this effort! We hope it helps you, but we haven't tested it yet. For user-provided videos, we are working on developing a simple system that allows users to upload their videos and receive super-resolved results. Thank you!

@FDFGGH
Copy link

FDFGGH commented Jun 27, 2024

@GeeveGeorge Hi, GeeveGeorge. We noticed that runpod.io has already implemented a Colab notebook for testing our model. Thanks to runpod.io for this effort! We hope it helps you, but we haven't tested it yet. For user-provided videos, we are working on developing a simple system that allows users to upload their videos and receive super-resolved results. Thank you!

tested. not working = (

@0smboy
Copy link

0smboy commented Jul 1, 2024

@FDFGGH jupyter try this:

!git clone https://github.com/camenduru/EvTexture
!mkdir -p /content/EvTexture/experiments/pretrained_models/EvTexture

!wget https://github.com/DachunKai/EvTexture/releases/download/v0.0/EvTexture_REDS_BIx4.pth -O /content/EvTexture/experiments/pretrained_models/EvTexture/EvTexture_REDS_BIx4.pth
!wget https://github.com/DachunKai/EvTexture/releases/download/v0.0/EvTexture_Vimeo90K_BIx4.pth -O /content/EvTexture/experiments/pretrained_models/EvTexture/EvTexture_Vimeo90K_BIx4.pth
!wget https://github.com/DachunKai/EvTexture/releases/download/v0.0/test_sets_REDS4_h5.zip -O /content/EvTexture/experiments/pretrained_models/EvTexture/test_sets_REDS4_h5.zip
!wget https://github.com/DachunKai/EvTexture/releases/download/v0.0/test_sets_Vid4_h5.zip -O /content/EvTexture/experiments/pretrained_models/EvTexture/test_sets_Vid4_h5.zip
!wget https://github.com/DachunKai/EvTexture/releases/download/v0.0/visual_results_EvTexture_REDS4_BIx4.zip -O /content/EvTexture/experiments/pretrained_models/EvTexture/visual_results_EvTexture_REDS4_BIx4.zip
!wget https://github.com/DachunKai/EvTexture/releases/download/v0.0/visual_results_EvTexture_Vid4_BIx4.zip -O /content/EvTexture/experiments/pretrained_models/EvTexture/visual_results_EvTexture_Vid4_BIx4.zip


%cd /content/EvTexture/experiments/pretrained_models/EvTexture
!unzip test_sets_Vid4_h5.zip
!mv /content/EvTexture/experiments/pretrained_models/EvTexture/Vid4_h5 /content/EvTexture/datasets/Vid4_h5

%cd /content/EvTexture/experiments/pretrained_models/EvTexture
!unzip test_sets_REDS4_h5.zip
!mv /content/EvTexture/experiments/pretrained_models/EvTexture/REDS4_h5 /content/EvTexture/datasets/REDS4_h5

%cd /content/EvTexture
!pip install .

%cd /content/EvTexture
!python basicsr/test.py -opt options/test/EvTexture/test_EvTexture_Vid4_BIx4.yml

%cd /content/EvTexture
!python basicsr/test.py -opt options/test/EvTexture/test_EvTexture_REDS4_BIx4.yml

@0smboy
Copy link

0smboy commented Jul 1, 2024

Testing ok on ubuntu:

#prepare pretrained_models dirs
cd /opt/
git clone https://github.com/camenduru/EvTexture
cd EvTexture
mkdir -p experiments/pretrained_models/EvTexture

#download model and data files
cd experiments/pretrained_models/EvTexture
wget https://github.com/DachunKai/EvTexture/releases/download/v0.0/EvTexture_REDS_BIx4.pth 
wget https://github.com/DachunKai/EvTexture/releases/download/v0.0/EvTexture_Vimeo90K_BIx4.pth 
wget https://github.com/DachunKai/EvTexture/releases/download/v0.0/test_sets_REDS4_h5.zip
wget https://github.com/DachunKai/EvTexture/releases/download/v0.0/test_sets_Vid4_h5.zip


# unzip datasets
unzip test_sets_Vid4_h5.zip
mv Vid4_h5 /opt/EvTexture/datasets/
unzip test_sets_REDS4_h5.zip
mv REDS4_h5 /opt/EvTexture/datasets/

#install dependencies
cd /op/EvTexture
pip install .

#run single gpu for Vid4
python basicsr/test.py -opt options/test/EvTexture/test_EvTexture_Vid4_BIx4.yml
#run single gpu for REDS4
python basicsr/test.py -opt options/test/EvTexture/test_EvTexture_REDS4_BIx4.yml

#run multi gpus for Vid4
python -m torch.distributed.run --nproc_per_node=8 --master_port=7860 basicsr/test.py -opt options/test/EvTexture/test_EvTexture_Vid4_BIx4.yml --launcher pytorch

#run multi gpus for REDS4
python -m torch.distributed.run --nproc_per_node=8 --master_port=7860 basicsr/test.py -opt options/test/EvTexture/test_EvTexture_REDS4_BIx4.yml --launcher pytorch

@FDFGGH
Copy link

FDFGGH commented Jul 1, 2024

@0smboy, I'm not much of a pro.
I can't say I'm really familiar with command prompt.
While testing this notebook I'm getting some errors and script stops.
I can copy the output of what I'm encountering.

@DachunKai
Copy link
Owner

Hi everyone. We've uploaded a Colab file for a quick test. Special thanks to @0smboy and the EvTexture-jupyter project.

@FDFGGH
Copy link

FDFGGH commented Jul 3, 2024

@DachunKai
thanks. are there any instructions how to use it?

@DachunKai
Copy link
Owner

@FDFGGH Maybe you can read this tutorial link to learn how to use Google Colab. Thanks.

@FDFGGH
Copy link

FDFGGH commented Jul 3, 2024

I (kind of) know how to use the Collab. How to feed video files into this exact notebook?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants