Code Monkey home page Code Monkey logo

hcflow's Introduction

Jingyun Liang visitorsGitHub Followers

Email / Homepage / Google Scholar / Github

I am currently a PhD Student at Computer Vision Lab, ETH Zürich, Switzerland. I am co-supervised by Prof. Luc Van Gool and Prof. Radu Timofte. I also work closely with Dr. Kai Zhang. I mainly focus on low-level vision research, especially on image and video restoration, such as

  • image/video super-resolution (SR)
  • image/video deblurring
  • image/video denoising
  • ...

🚀 News

  • 2022-10-04: Our new paper RVRT, NeurlPS2022 achieves SOTA video restoration results with balanced size, memory and runtime.
  • 2022-08-30: See our papers on real-world image denoising (SCUNet) and video denoising (ReViD).
  • 2022-07-30: Three papers, including EFNet (event-based image deblurring, oral), DATSR (reference image SR) and DAVSR (video SR), accepted by ECCV2022.
  • 2022-01-28: Our new paper VRT outperforms previous Video SR/ deblurring/ denoising/ frame interpolation/ space-time video SR methods by up to 😍 2.16dB. 😍
  • 2021-10-20: SwinIR is awarded the best paper prize in ICCV-AIM2021.
  • 2021-08-01: Three papers (HCFlow, MANet and BSRGAN) accepted by ICCV2021.
  • 2021-03-29: One paper (FKP) accepted by CVPR2021.

🌱 Repositories

Topic Title Badge
real-world video denoising Practical Real Video Denoising with Realistic Degradation Model arXivGitHub Stars
event-based image deblurring Event-based Fusion for Motion Deblurring with Cross-modal Attention, ECCV2022 arXivGitHub Stars
reference image SR Reference-based Image Super-Resolution with Deformable Attention Transformer, ECCV2022 arXivGitHub Stars
interpretable video restoration Towards Interpretable Video Super-Resolution via Alternating Optimization, ECCV2022 arXivGitHub Stars
transformer-based video restoration Recurrent Video Restoration Transformer with Guided Deformable Attention arXivGitHub Starsdownload google colab logo
transformer-based video restoration VRT: A Video Restoration Transformer arXivGitHub Starsdownload google colab logo
transformer-based image restoration SwinIR: Image Restoration Using Swin Transformer arXivGitHub Starsdownload google colab logo
real-world image denoising Practical Blind Denoising via Swin-Conv-UNet and Data Synthesis arXivGitHub Stars
real-world image SR Designing a Practical Degradation Model for Deep Blind Image Super-Resolution, ICCV2021 arXivGitHub Stars
blind image SR Mutual Affine Network for Spatially Variant Kernel Estimation in Blind Image Super-Resolution, ICCV2021 arXivGitHub Starsdownload google colab logo
blind image SR Flow-based Kernel Prior with Application to Blind Super-Resolution, CVPR2021 arXivGitHub Stars
normalizing flow-based image SR and image rescaling Hierarchical Conditional Flow: A Unified Framework for Image Super-Resolution and Image Rescaling, ICCV2021 arXivGitHub Starsdownload google colab logo
image/ video restoration Image/ Video Restoration Toolbox GitHub StarsdownloadGitHub Forks

hcflow's People

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

hcflow's Issues

NAN

image
Hello, I have a question to ask you. This error will appear in the middle of running the code. Could you give me some guidance?

Code versions of BRISQUE and NIQE used in paper

Hi,
I have run performance tests with the Matlab versions of the NIQE and BRISQUE codes and found deviations from the values reported in the paper.
Could you please provide a link to the code you used?
thanks a lot~

The code implementation and the paper description seem different

Hi, your work is excellent, but there is one thing I don't understand.

What is written in the paper is:

"A diagonal covariance matrix with all diagonal elements close to zero"

But the code implementation in HCFlowNet_SR_arch.py line 64 is:
basic. Gaussian diag.logp (LR, - torch. Ones_ like(lr)*6, fake_ lr_ from_ hr)

why use - torch. Ones_ like(lr)*6 as covariance matrix? This seems to be inconsistent with the description in the paper

NaN when training

When i trained HCFlow model with DF2K dataset, it showed NaN in nll loss
(I used DF2K-tr.pklv4 & DF2K-tr_X4.pklv4 from SRFlow)
capture

New Super-Resolution Benchmarks

Hello,

MSU Graphics & Media Lab Video Group has recently launched two new Super-Resolution Benchmarks.

If you are interested in participating, you can add your algorithm following the submission steps:

We would be grateful for your feedback on our work!

About training and inference time?

Thanks for your nice work!

I want to know how much time do you need to train and inference with your models.

Furthermore, will information about params / FLOPs be reported?

Thanks.

environment

ImportError: /home/hbw/gcc-build-5.4.0/lib64/libstdc++.so.6: version `GLIBCXX_3.4.22' not found (required by /home/hbw/anaconda3/lib/python3.8/site-packages/scipy/fft/_pocketfft/pypocketfft.cpython-38-x86_64-linux-gnu.so)

Is this error due to my GCC version being too low, and your version is?
looking forward to your reply!

Testing without GT

Is there a way to run the test without GT? I just want to infer the model. I found a mode called LQ which -I think- should only load the images in LR directory. But this mode gives me the error:
assert real_crop * self.opt['scale'] * 2 > self.opt['kernel_size']
TypeError: '>' not supported between instances of 'int' and 'NoneType'

in LQ_dataset.py", line 88

How to make an invertible mapping between two variables whose dimensions are different ?

Maybe this is a stupid question, but I have been puzzled for quite a long time. In the image super-resolution task, the input and output have different dimensions. How to build such an invertible mapping between them ?
Take an example:
If I have a low-resolution(LR) image x, and I have had an invertible function G. I can feed LR image x into G, and generate an HR image y. But can you ensure that we could obtain an output the same as x when we feed y into G_inverse?

y = G(x)
x' = G_inverse(y) =? x

I would appreciate it if you could offer some help.

deploy

how to deploy to onnx or torchscript.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.