PWC-Net_tf

PWC-Network with TensorFlow

input image0, estimated flow at each 5 scale, ground truth flow, input image1

Acknowledgments

• NVlabs/PWC-Net: original implementation (by Caffe / PyTorch).
• NVIDIA/flownet2-pytorch: framework, data transformers, loss functions, and many details about flow estimation.
• nameloss-Chatoyant/PWC-Net_pytorch: Referenced implementation.

Working confirmed. I hope this helps you.
Adding PWCDCNet: advanced model! I'm going to make the trained parameters avaliable ASAP! :)
Unofficial implementation of CVPR2018 paper: Deqing Sun et al. "PWC-Net: CNNs for Optical Flow Using Pyramid, Warping, and Cost Volume". arXiv

Usage

• Requirements
  • Python 3.6+
  • PyTorch 0.4.0 (mainly in in data handling)
  • TensorFlow 1.8+

Training (the case SintelClean)

# Training from scratch
python train.py --dataset SintelClean --dataset_dir /path/to/MPI-Sintel-complete 

# Start with learned checkpoint
python train.py --dataset SintelClean --dataset_dir /path/to/MPI-Sintel-complete --resume /path/to/model.ckpt

After running above script, utilize GPU-id is asked, (-1:CPU). You can use other learning configs (like --n_epoch or --batch_size) see all arguments in train.py, regards.

Testing (inferring optical flow) by paired images

python test.py --input_images /path/to/image_0 /path/to/image_1 --resume /path/to/model.ckpt

# for multiple images (using wild-card for 001.png, 002.png, 003.png, ...)
python test_continuous.py -i /path/to/images* -r /path/to/model.ckpt