Comments (4)
Just to add to the understanding (its whats already written here, just re-stated): net_d has nothing to do with the network.
Since you listed SPAN and SAFMN, it doesnt matter, you could list all of them here (ATD, SRFormer, HAT, SwinIR, ESRGAN, etc) or not a single one. It is more coupled to a loss, gan loss, not a network.
So none of those require a net_d. All of them can use it. Its not the network. (im just stating my points in the extreme to make it more clear)
An official pretrain almost never has a net_d because in most cases they are trained with pixel loss only on bicubic downsampled dataset like div2k or df2k. Thats what you will most likely find in papers or in official github repositories. Unless they release a real world model where they use the Real-ESRGAN degradation pipeline or something similiar, where they add noise, blur, compression to the dataset so the model can deal with those.
If you want to see a manual example of this you can have a look at my 4xNomosWebPhoto Dataset PDF where I showed how I created it, it is also attached in the release of my 4xNomosWebPhoto_realplksr model.
Hm maybe not the best example but you could have a look at what I used for my SPAN pretrains since I included the config files in the attachements where I basically deactivated any loss except pixel (or mssim) and ran on a downsampled-only lr.
Maybe this helps a bit, simply wanted to add to the already answers here.
from neosr.
Hi, glad you got it working.
About GAN and discriminator: it works regardless of the network. GAN is usually applied to real-world SISR to push the network to generate more perceptually pleasant images. The default configurations on neosr of all networks targets the best real-world SISR practices, so in all of them GAN is enabled. Neosr also supports different kinds of discriminators that you can try out. Unet-SN is standard, but a2fpn
also works pretty well (sometimes even better, depending on your dataset and LQ degradations).
from neosr.
So, if I understood your reply correctly,
Q1. discriminators in neosr boost real world SISR and does it work independently from the generator network?
Q2. If I am looking at more research-focused SR, is it perfectly fine to turn-off the discriminator setting first during my experiments?
Thank you.
from neosr.
Yes to both Q1 and Q2. About Q2: usually when training from scratch (no pretrained network), you should disable GAN and train with only pixel_opt
or mssim_opt
first. GAN is only used after you have a stable model.
from neosr.
Related Issues (20)
- Add Anime4K models HOT 26
- Huge performance drop after update HOT 3
- wrapper around train.py, ... scripts and release on pypi
- `train_realesrgan.yml` is named "train_esrgan" HOT 1
- imwrite raise IOError when trying to write an image where the filename contains unicode characters HOT 2
- How to save a model fully in pth? Not state dict HOT 3
- Document which architectures have been modified and are incompatible with the original architecture HOT 4
- Add tile option HOT 2
- Modifications for CRAFT, SwinIR, and DCTLAS are not detectable HOT 8
- Automatically remove old checkpoints and visualizations HOT 4
- and again rgb_mean HOT 1
- assets HOT 3
- dataset_enlarge_ratio description HOT 1
- Mismatched resume state issue HOT 1
- All architectures with `rgb_mean = (0.5, 0.5, 0.5)` are incompatible HOT 9
- Python version problem HOT 4
- model zoo HOT 1
- can not start train HOT 3
- GPU memory not fixed when training HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from neosr.