Code Monkey home page Code Monkey logo

Comments (4)

w-e-w avatar w-e-w commented on June 3, 2024

I don't know what's causing issue but you got to realize 100% is not 100%

the progress while we showing is only the sampling steps
but there's also other things that happen after
such as the VAE or potentially other post processing
so the true progress is 100%+vae+other post processing

so if you "preemptively stops 1 step before the final"
all that dose is make 100%+vae+other post processing in to 95%+vae+other post processing

if it gets stuck afterwards like in VAE, it's still stuck

I'm guessing the issue is during VAE your system doesn't have enough vram and start using system ram which causes massive slow down
see #11063 (comment)

live preview works differently from normal image, (it essentially decodes the latent space using a different method by default using a cheaper method so it's quicker)

2024-05-09 15_57_18_786 chrome

if the issue is with VRAM usage during VAE pahse
there's a couple of things you can try
you can try using TAESD as the final VAE, using TAESD will result in image quality drop but should be much faster and use less VRAM
2024-05-09 15_58_10_921 chrome
or you can try https://github.com/pkuliyi2015/multidiffusion-upscaler-for-automatic1111
this can reduce the vram usage during VAE pahse


if the issue is it getting stuck during other post processing then more investigation needs to be done


you should really fill in the issue report with the proper information we requested
like the Sysinfo, if you uploaded that then I can see your settings and what system you're on what graphics card you're using
which may give us clue on what is causing the issue

from stable-diffusion-webui.

CoddedApple avatar CoddedApple commented on June 3, 2024

@w-e-w Updated Sysinfo
Just checked a few generations, vram is around 4.6~/6.0 during hires then spikes to 5.7~/6.0 on final processing for a 576x640 image upscaled by 2x.

from stable-diffusion-webui.

w-e-w avatar w-e-w commented on June 3, 2024

as expected RTX 2060 with 6GB vram
if it spikes up to 6 then then it's likely that it's actually going into System RAM which can cause slow down

so I think it's highly likely it's caused by not enough VRAM
if you want to test i if this is the case you can you fellow #11063 (comment)
and set CUDA - Sysmem Fallback Policy.to Prefer No Sysmem Fallback
this ment the driver will not try to use system RAM but just ERROR when not enouth VRAM (image gen will fail)

it is possible in your situation --medvram or --lowvram may help
enableing FP8 weight in setting may also help
basically all the settings that reduces vram use may help

from stable-diffusion-webui.

CoddedApple avatar CoddedApple commented on June 3, 2024

@w-e-w I don't know if it's actually a vram issue. For a normal 50-90 second gen the vram will spike to 5.8~ on final and normal ram will bump up a bit. I just got a generation that took 8+ minutes but it also only spiked to 5.8 and bumped up normal ram a little, so there's no difference there besides the time it takes to finish. Between the 8 minute gen and the gen before it which took 54 seconds, the only difference was the seed and a slight change made to the prompt, the size and everything else was kept the same.

I followed the instructions and turned CUDA - Sysmem Fallback Policy but it didn't do anything different when generating. I even tried making a couple images twice as large as I normally do, capped at vram 5.8 and uses a bunch of ram but no delay and no failure.

from stable-diffusion-webui.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.