Tik Tok Dance Workflow (Animate LCM, IPAdapter, Controlnet)版本v5.0 (ID: 729455)

Introduction

This workflow is used to create AI Tiktok dance videos, with the action of the AI avatar driven by an actual dance video.

v7 includes audio reactive background using Depthflow and RyanOnThe Inside nodes.

Models Needed

The models required are the red nodes in the workflow, explanation is in the notes (brown nodes) in the workflow. Recommend to install with ComfyUI Manager.

• SD1.5 LCM: https://civitai.com/models/81458?modelVersionId=256668

• SDXL Lightning: https://civitai.com/models/133005/juggernaut-xl?modelVersionId=920957

• AnimateLCM_sd15_t2v.ckpt (https://huggingface.co/wangfuyun/AnimateLCM)

• Install Using Manager:

  • IPAdapter Models. ip-adapter_sd15.safetensors, ip-adapter-plus_sd15.safetensors.

  • Clip-Vision. CLIP-ViT-H-14-laion2B-s32B-b79K.safetensors and CLIP-ViT-bigG-14-laion2B-39B-b160k.safetensors.

  • AnimateDiff V3: v3_sd15_mm.ckpt, v3_sd15_adapter.ckpt.

  • xinsir/ControlNet++: All-in-one ControlNet (ProMax model).

  • control_v11f1p_sd15_depth.safetensors

  • depth_anything_v2_vitl.pth

Custom Nodes Needed

Install missing custom nodes using manager.

• ComfyUI's ControlNet Auxiliary Preprocessors

• ComfyUI Frame Interpolation

• ComfyUI_IPAdapter_plus

• ComfyUI-Advanced-ControlNet

• AnimateDiff Evolved

• ComfyUI-VideoHelperSuite

• rgthree's ComfyUI Nodes

• ComfyUI Essentials

• KJNodes for ComfyUI

• Crystools

• ComfyUI-Inspyrenet-Rembg

• Depthflow Nodes

• RyanOnTheInside

描述:

Photon LCM is used as the model and the LoRA is no longer required.

An initial generation is used to create a more consistent feel in the video.

Reactor is used to swap a face into the video.

训练词语: