Code Monkey home page Code Monkey logo

realsr's Introduction

Dataset:

Captured device: (Canon 5D3 and Nikon D810) + (24∼105mm, f/4.0 zoom lens)

A part of this dataset was used in the RealSR challenge in NTIRE 2019 (in conjunction with CVPR 2019).

Version 1: 234 scenes (204 scenes for training & 30 scenes for testing), as reported in the original paper (HR has the same resolution as LR).

Version 2: 559 scenes (459 scenes for training & 100 scenes for testing), the extended version (HR has the same resolution as LR).

Methods PSNR 2 3 4 SSIM 2 3 4
KPN(K=5) 33.41 30.47 28.80 0.913 0.860 0.826
KPN(K=7) 33.42 30.49 28.84 0.913 0.861 0.826
KPN(K=13) 33.44 30.52 28.92 0.913 0.863 0.829
KPN(K=19) 33.45 30.57 28.99 0.914 0.864 0.832
LP-KPN(K=5) 33.49 30.60 29.05 0.917 0.865 0.834

Version 3: 559 scenes (459 scenes for training & 100 scenes for testing), the extended version (HR and LR have different resolution).

Detail for training & testing: Trained on the RGB domain and tested on Y channel (images from Version 3).

Methods PSNR 2 3 4 SSIM 2 3 4
Bicubic - 28.6284 27.2378 - 0.8088 0.7643
Baseline (Our) - 30.6003 28.6508 - 0.8630 0.8206

Visualization (zooming factor: 4)
More results can be downloaded here.

Code:

Model: Pretrained Caffe models

  1. Models for PSNR/SSIM
  2. Models for Visualization

The above provided models (for quantitative metrics and visual quality) are both trained with the loss ratio in 1:1:1.
We select different models at different epochs for different purposes.

Caffe: training code & testing code

  1. Download the new layers in folder 'Layer'
  2. Modify the caffe.proto (Path: caffe/src/caffe/proto/)
  3. Compile Caffe and Matcaffe (installation)

-- Training --

  1. Generate the training data
  2. run *solver.prototxt to train the network

-- Testing --

  1. run Test.m

Alignment code:

  1. Put your own image pairs in the folder and modify the path
  2. run Demo.m in folder 'Alignment'
  3. Central region crop
Pipeline:

(1) coarse align the image pairs;
(2) central crop the image pairs;
(3) finer align the cropped image pairs;
(4) discard those misaligned image pairs.

Citation:

If you find this work useful for your research, please cite:

@inproceedings{cai2019toward,
  title={Toward real-world single image super-resolution: A new benchmark and a new model},
  author={Cai, Jianrui and Zeng, Hui and Yong, Hongwei and Cao, Zisheng and Zhang, Lei},
  booktitle={Proceedings of the IEEE International Conference on Computer Vision},
  year={2019}
}
@inproceedings{cai2019ntire,
  title={Ntire 2019 challenge on real image super-resolution: Methods and results},
  author={Cai, Jianrui and Gu, Shuhang and Timofte, Radu and Zhang, Lei},
  booktitle={Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops},
  year={2019}
}

Contact:

Please contact me if there is any question (Jianrui CAI: [email protected]).

realsr's People

Contributors

csjcai avatar

Watchers

James Cloos avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.