LTXV - Animating images that typically don't yield good results版本v1.0 (ID: 1237181)

In this tutorial, we will learn how to animate images using LTXV, specifically those that initially do not yield good results.

The workflow used is a customized modification of the following workflow:

https://github.com/sandner-art/ai-research/blob/main/LTXV-Video/ltxvideo_I2V-motionfix.json

This approach was inspired by the idea of using blur effects to improve results, as proposed by VoidVisionary in:

https://civitai.com/models/1057138

The zip includes: The workflow, a .png image of the Mona Lisa without blur, a .png image of the Mona Lisa with blur and a .psd archive with the edition.

This workflow incorporates a modified version of the VAE created by SpacePXL, which you can find here:

https://huggingface.co/spacepxl/ltx-video-0.9-vae-finetune/tree/main

In this case, I am using ltx-video-v0.9-vae_finetune_all.safetensors, which you should place in the models/VAE folder of ComfyUI.

The model used for LTX is ltx-video-2b-v.0.9.1.safetensors, which should be placed in the models/checkpoints folder of ComfyUI:

https://huggingface.co/Lightricks/LTX-Video/tree/main

The text encoder used is t5-v1_1-xxl-encoder-Q6_K.gguf:

https://huggingface.co/city96/t5-v1_1-xxl-encoder-gguf/tree/main, which should be placed in the models/clip folder of ComfyUI.

This workflow utilizes the following custom nodes:

• https://github.com/Kosinkadink/ComfyUI-VideoHelperSuite

• https://github.com/city96/ComfyUI-GGUF

• https://github.com/logtd/ComfyUI-LTXTricks

Once everything is set up, we will load the initial image of the Mona Lisa. If we use it as is (without blur) and render it, we will get a very limited animation. To enhance the animation, we will simply use a image editor, select the face, copy it, paste it onto another layer, and apply a slight horizontal motion blur. I’ve provided a Photoshop file where the face has been converted into a Smart Object with a horizontal motion blur of 12 applied. I also add the image of the Mona Lisa already blurred.

If we now copy and paste our modified image into ComfyUI, we will see a much smoother and more natural animation.

This technique can be applied to almost any image, and experimentation is encouraged.

描述:

训练词语: