Comments (7)
as far as i understand, those are not really controlnet model preprocessors, they are just masking helpers - and sdnext already has those and more built-in (control module -> masking).
and not sure why you mention outpainting in this context? outpainting is different than inpainting.
from automatic.
Mh, that is a video where the preprocessor is used (link redirect on the good timecode) : https://youtu.be/wyDRHRuHbAU?t=410
For me he is doing outpainting, or maybe im wrong ? Is the tool you mentionned capable of doing this type of resizing ?
from automatic.
i've taken a quick look at video and i don't see any outpainting there. outpainting would be if i had 512x512 image and i want to make it 512x1024 by adding NEW content to left 256px and right of the original image. and yes, sdnext can do that as well.
what he's doing is simple img2img plus adding tile upscaling at the end of the video.
from automatic.
Not to offend but did we look the same video ? (Even his step 3 is named: "3. Outpaint using ControlNet", Haha).
If we take a look a bit earlier you can see he generated a 768x768 pic, then in img2img he’s using the ControlNet inpaint_only+lama to Resize&Fill (so outpaint) to achieve a resolution of 1368x768. So yeah he’s adding new content to right and left.
Also if you talking about the Outpaint feature in Image, yeah i’ve tested it, but it needs to have high denoising to get a proper image, and in return it’s changing the whole pic and not only the extra size, instead of this method who just accordingly of the og pic, adds new relative content on extras (maybe it’s possible to do the same with current tool, but i didn’t find out).
So I may have misunderstood, but i don’t think so.
Here his workflow a bit sped up:
-
generate image in 768x768
-
sent it to img and fix problems with inpaint
-
send it back to image, then change the resolution to 1368x768. Set denoising to 0.9. Check enable ControlNet, enable "Upload independent control image" checkbox and put the current image in the field.
Set preprocessor to "inpaint_only+lama", and set model to "control_v11p_sd15_inpaint".
Set resize mode to "Resize and Fill".
Final step of step 3, generate till you have a good image. -
In image, upscale by 2 the previous final image generated using the ControlNet preprocessor "inpaint_global_harmonious" and still the same model.
-
Final step. Set ControlNet preprocessor to "tile_resample" and model to "control_v11fle_sd15_tile". Now upscale the image using the extensions Ultimate SD Upscale.
Waiting for your reply, thx for your time.
from automatic.
I must admit I skipped over that.
i much rather prefer when ppl explain what they want to achieve than point to go-there-I-want-that.
from automatic.
Sorry, but i literally explain the goal on first message...
The achievement is to add these controlnets preprocessors to create nice outpainting following along the current pic without modiying it but add the extras. The video was only to give you a context of use, because you asked me why i talk about outpaint, wathever. My ask is only to improve SDN about outpainting, because right now i can't see a good uses of outpainting, as far as i know.
Maybe we can already do this kind of outpainting, then i would be glad to know the method, but if not, is it possible to add these, or even to improve the current outpaint tool ? (also the preprocessors are good for inpaint fixes)
Current Workflow:
- Set a 768x768 pic, in Image tab.
- Set resize mode to outpaint, and set width to 1368.
- Set denoising to 0.9 otherwise it can't achieve a good result.
- Generate.
Result: The output is 1368x768, but changed the whole pic.
Expected result: The output is 1368x768, the main pic isnt modified (768x768 part), and extras on right and left are coherent from the content of main pic.
from automatic.
sorry i wasn't clear - you did explain it in the previous writeup. keeping this open, will need some work.
from automatic.
Related Issues (20)
- [Issue]: Face HiRes doesn’t properly execute from API HOT 2
- [Issue]: 'OnnxRawPipeline' object is not callable HOT 4
- [Issue]: Restore button causes error during rendering in second pass HOT 8
- Failed to load ZLUDA: Could not find module 'C:\ZLUDA\nvrtc64_112_0.dll' (or one of its dependencies). Try using the full path with constructor syntax. HOT 1
- [Issue]: Cannot generate an image, only "txt2img starting" is shown HOT 10
- [ISSUE]: Unable to launch SD.Next due to Missing Module from Torch HOT 5
- Is FLUX and AuraFlow supported? HOT 1
- [Feature]: Control: Allow resizing the input images in Control units to match the target resolution aspect ratio HOT 2
- [Feature]: Control: allow reading control parameters from the metadata HOT 1
- [Issue]: Regional prompt not working with NNCF HOT 6
- [Issue]: Huge Security concern HOT 17
- [Issue]: Aura SR 4x upscaler blows up at the end of upscaling when "Unload upscaler after processing" option is checked HOT 2
- [Issue]: /sdapi/v1/control not returning image HOT 1
- [Feature]: Control: provide a way to tell whether a model has been downloaded or not HOT 3
- [Issue]: Installation suddenly returns in 'FileNotFoundError'> value=[Errno 2] HOT 1
- [Issue]: dev 5e1da44b bad XYZ performance and errors HOT 1
- [Issue]: OSError: [WinError 126] Não foi possível encontrar o módulo especificado. Error loading "E:\ia\automatic\venv\lib\site-packages\torch\lib\fbgemm.dll" or one of its dependencies. HOT 3
- [Issue]: PonyLoras don't work in XL models HOT 4
- [Feature]: Control: Offload model if unit is inactive HOT 3
- [Feature]: Stable Diffusion Long Prompt Weighted Embedding HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from automatic.