FreeU Advanced版本Free Advanced Plus (ID: 169240)

FreeU Advanced Plus

Let's say you and I grab dinner, and movie after lunch? ???

These examples are for FreeU - Dinner and a Movie (FreeU Advanced Plus) which is a alpha branch of FreeU Adanced. This version patches the UNetModel.forward method fromopenaimodel.py

This is a temporary patch until there is official methods to patch the input blocks and middle block. FreeU - Free Lunch and Dinner (FreeU Advanced) doesn't require patching the UNetModel class.

INSTALLATION

Preferably visit the Github and choose the branch right for you (main or dinner_and_a_movie).
git clone -b [main|dinner_and_a_movie] https://github.com/WASasquatch/FreeU_Advanced.git
Otherwise you can download one of the versions from civitai and extract the folder within the archive to ComfyUI/custom_nodes

Examples of default node settings applied across blocks.

Input Parameters

model (MODEL): Model to patch
target_block (COMBO): Which block to target; input_block, middle_block, and output_block
multiscale_mode (COMBO): A list of available multiscale modes:
- ["Default", "Bandpass", "Low-Pass", "High-Pass", "Pass-Through", "Gaussian-Blur", "Edge-Enhancement", "Sharpen", "Multi-Bandpass", "Multi-Low-Pass", "Multi-High-Pass", "Multi-Pass-Through", "Multi-Gaussian-Blur", "Multi-Edge-Enhancement", "Multi-Sharpen"]
multiscale_strength (FLOAT, Default: 1.0, Range: [0.0, 1.0], Step: 0.001): Strength of scaling
b1_slice (INT, Default: 640, Range: [64, 1280], Step: 1): The size of the array slice for b1 operation
b2_slice (INT, Default: 640, Range: [64, 640], Step: 1): The size of the array slice for b2 operation
b1 (FLOAT, Default: 1.1, Range: [0.0, 10.0], Step: 0.001): b1 output multiplier
b2 (FLOAT, Default: 1.2, Range: [0.0, 10.0], Step: 0.001): b2 output multiplier
s1 (FLOAT, Default: 0.9, Range: [0.0, 10.0], Step: 0.001): s1 Fourier transform scale strength
s2 (FLOAT, Default: 0.2, Range: [0.0, 10.0], Step: 0.001): s2 Fourier transform scale strength

Optional Parameters

b1_mode (COMBO): Blending modes for b1 multiplied result.
- ['bislerp', 'colorize', 'cosine interp', 'cuberp', 'hslerp', 'inject', 'lerp', 'linear dodge', 'slerp']
b1_blend (FLOAT, Default: 1.0, Range: [0.0, 100], Step: 0.001): Blending strength for b1.
b2_mode (COMBO): Blending modes for b2 multiplied result.
- ['bislerp', 'colorize', 'cosine interp', 'cuberp', 'hslerp', 'inject', 'lerp', 'linear dodge', 'slerp']
b2_blend (FLOAT, Default: 1.0, Range: [0.0, 100], Step: 0.001): Blending strength for b2.
threshold (INT, Default: 1.0, Range: [1, 10], Step: 1): The exposed threshold value of the Fourier transform function.
use_override_scales (COMBO): "true", or "false" on whether to use override_scales
override_scales (STRING, Default: [Multiline String]): Override scales. Create custom scales and experiment with results.
- Example 10, 1.5 would create the multiscale_mode effect Sharpen
- You can use #, // and ! to comment out lines.

FreeU BibTex

@article{Si2023FreeU,

 author    = {Chenyang Si, Ziqi Huang, Yuming Jiang, Ziwei Liu},

 title     = {FreeU: Free Lunch in Diffusion U-Net},

 journal   = {arXiv},

 year      = {2023},

}