Whenever I run an uspcale (usually with controlnet_tile) it seems to introduce a lot o

Any tips for upscaling? about animatediff-cli-prompt-travel HOT 2 CLOSED

s9roll7 commented on June 15, 2024

Any tips for upscaling?

from animatediff-cli-prompt-travel.

Comments (2)

xnmt9 commented on June 15, 2024 1

this is great thanks - I'll try it + also test out background loras to see if it helps

from animatediff-cli-prompt-travel.

s9roll7 commented on June 15, 2024

I am using tile + ip2p and there seems to be a flicker in the areas not affected by the lora.
In this video I am using lora on the characters and there is little to no flickering on the characters.
I have not tried it, but maybe I should have used lora in the background when generating it.

original
animatediff generate -c CONFIG_JSON_PATH -W 512 -H 768 -L 128 -C 16

org_converted.webm

animatediff tile-upscale FRAME_DIR -W 768

    "upscale_config": {
        "scheduler": "k_dpmpp_sde",
        "steps": 20,
        "strength": 0.5,
        "guidance_scale": 10,
        "controlnet_tile": {
            "enable": true,
            "controlnet_conditioning_scale": 1.0,
            "guess_mode": false,
            "control_guidance_start": 0.0,
            "control_guidance_end": 1.0
        },
        "controlnet_line_anime": {
            "enable": false,
            "controlnet_conditioning_scale": 1.0,
            "guess_mode": false,
            "control_guidance_start": 0.0,
            "control_guidance_end": 1.0
        },
        "controlnet_ip2p": {
            "enable": true,
            "controlnet_conditioning_scale": 0.5,
            "guess_mode": false,
            "control_guidance_start": 0.0,
            "control_guidance_end": 1.0
        },
        "controlnet_ref": {
            "enable": false,
            "use_frame_as_ref_image": false,
            "use_1st_frame_as_ref_image": false,
            "ref_image": "ref_image/path_to_your_ref_img.jpg",
            "attention_auto_machine_weight": 1.0,
            "gn_auto_machine_weight": 1.0,
            "style_fidelity": 0.25,
            "reference_attn": true,
            "reference_adain": false
        }
    },

converted.webm