Output size discriminator about pix2pix HOT 10 CLOSED

This is because the (default) discriminator is a "PatchGAN" (Section 2.2.2 in the paper). This discriminator slides across the generated image, convolutionally, trying to classify if each overlapping 70x70 patch is real or fake. This results in a 30x30 grid of classifier outputs, each corresponding to a different patch in the generated image.

from pix2pix.

@phillipi If I want to classify each overlapping a minor patch eg. like 16 x 16 patch is real or fake, should this results in a which size grid of classifier outputs? any formula or hints can provide?

from pix2pix.

You can use this script to determine the receptive field (e.g., 16 x 16) of a given architecture:
https://github.com/phillipi/pix2pix/blob/master/scripts/receptive_field_sizes.m

I'm not sure what the formula would be for calculating output grid size given desired receptive field. For a given architecture, you can always check the output size by running it on an image and calling out:size() on the output out.

from pix2pix.

@phillipi Thank you for you quick response. I am not familiar with the Matlab. Would you please be more specify how can I get the output with the script you provided. Thank you so much.

from pix2pix.

That script gives you the receptive field of a neuron. The equation to compute the input receptive field size from a given output receptive field size is (for a single convolutional layer):
input_size = (output_size - 1) * stride + kernel_size

You can call this recursively to compute the receptive field sizes across multiple layers.

from pix2pix.

@phillipi Thank you for you kind explanation. I am sorry that I didn't define my question well. The problem is when I use 70*70 patch GAN as discriminator in code, the output is not as sharp as what described in the paper in some occasion.

This looks good, but my results is not sharp enough as sample

So I wonder maybe the patch GAN size as default code is 70*70 is too large for the discriminator to classify the fake or real. If I want to enhance the sharpness should I enlarge the patch size or decrease the patch size? or any other suggestions ?

from pix2pix.

@kenshinzh what's your input and output? To produce good colorization results, one needs to map L to ab. Look at Notes on Colorization for more details.

from pix2pix.

Actually, my experments is from a B2A direction which is not the color corrections. I just take this B/W for illustration. all the input image is as the demo 256*256

from pix2pix.

In the colorizations in the paper, we concatenate the predicted ab map with the ground truth L. This has the effect of making the results look nice and crisp since most of the high frequencies are in the L channel. If you just look at the raw predicted ab it tends to look less sharp.

I don't think there is a simple relationship between discriminator patch size and and sharpness. In practice 70x70 usually works pretty well for me, but you could try a few variants to see what works in your application.

from pix2pix.

from pix2pix.