Code Monkey home page Code Monkey logo

Comments (11)

AnushaManila avatar AnushaManila commented on September 17, 2024 9

By loading the CelebA HQ dataset and using the same code, I'm getting similar results to NVIDIA.
Training time is 24 days on Titan X (Pascal) GPU.
The model works fine and the sample result that generated at 512X512 resolution is attached.
samples

from pggan-pytorch.

nashory avatar nashory commented on September 17, 2024 1

At the moment, the dataloader resize the input image on cpu in real time. If resize all images in advance, the training time would be decreased significantly. By the way, the result now looks pretty good :)
Are you preparing paper using pggan? just curious :)

from pggan-pytorch.

nashory avatar nashory commented on September 17, 2024

yeah, I guess it's been a quite long time since my last update.
The code is working properly until it reaches 256 resolution.
I have not tried with CelebA-HQ yet, but it should be working as well :)
Most bugs have been fixed already, so please feel free to use this.
(I will update the 256x256 results soon. too busy these days!)

from pggan-pytorch.

bluddy avatar bluddy commented on September 17, 2024

Am I correct in saying this is still very slow? I've had it running for 3 days on a Titan XP, and my resulting faces are somewhat... monstrous. I'm using default values, btw.

from pggan-pytorch.

nashory avatar nashory commented on September 17, 2024

my results are shown in README.
what do you mean monstrous? Is it far from mine?
could you show me what you've got?
And yes, the training is slow. The authors trained almost a week as well.

from pggan-pytorch.

bluddy avatar bluddy commented on September 17, 2024

Well, some of the images are pretty good, but even after almost a week, many of the images come out terrible -- pieces don't fit together, or are really smudged. Did NVIDIA hand-pick the images in the paper to look that good?

from pggan-pytorch.

nashory avatar nashory commented on September 17, 2024

I've trained to reproduce the issue with default settings.
The current result is like below, and it took around 3 days using P40 single GPU.
Yes, I see some images look smashed terribly. (but not that much, though.)

My hypothesis about this is that:

    1. NVIDIA authors hand-picked good looking images? (not sure)
    1. It might be working well if using easier domain? (performing face detection and crop on CelebA, or using Anime dataset?)
    1. There is something wrong in my code? (possibly not... checked more than thousands of times)
    1. Wrong optimization parameter? (the result changes significantly depending on the adam optimizer beta1/beta2 values.)

I think we need to go through this issue based on the hypothesis above.
what do you think?

my result so far.

2017-12-29 10 31 31
2017-12-29 10 31 54

from pggan-pytorch.

bluddy avatar bluddy commented on September 17, 2024

Yeah I'm getting the same kind of results. Some areas are 'smushed', but more importantly, the network doesn't seem to be able to combine the pieces from the features in a seamless way, causing the uncanny valley / 'Frankenstein' effect. This problem was noticeable at lower resolution levels as well, but I was hoping it would get better, though it didn't.

Maybe the algorithm needs to run longer on lower resolutions to work out those kinks before we go up in resolution. Perhaps once those patterns are there, they can't be eliminated, since the lower layers have already been formed for the most part.

from pggan-pytorch.

bluddy avatar bluddy commented on September 17, 2024

I didn't realize you weren't supporting Wasserstein loss yet. This could be a very big element.

from pggan-pytorch.

nashory avatar nashory commented on September 17, 2024

Have you tried to use wasserstein loss by any chance?

from pggan-pytorch.

AnushaManila avatar AnushaManila commented on September 17, 2024

Thank you for sharing this code in pytorch!
I have cited this GitHub in my thesis.
Pggan experiments are a part of my thesis work, have not planned more than this for now:-)

from pggan-pytorch.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.