CogvideoX Image to Video ComfyUI workflow版本v1.0 (ID: 1255983)

A image to video ComfyUI workflow with CogVideoX. Tested with CogvideoX Fun 1.1 and 1.5. Note that the motion lora does not work with the Fun 1.5 model. Just with the 1.1 one.

The zipfile contains the json file, the starter image, and the png file from creation, which also contains the workflow.

This workflow also contains a CogVideoX motion lora for the camera movement. And you can also add further instructions in the prompt. CogVideoX relies at motion informations in text form.

It also has a very simple upscaling method implemented. I am at my journey to figure out a special upscaling workflow though. But for some it might still be useful. It is super fast compared to an upsampling by another ksampler.

CogVideo creation size is limited. The old version 1.1 is fixed to a 16:10 format. And 720x480 resolution. The new version 1.5 goes up to double size, but the motion lora that i use here does not work with it.

There are some collapsed Note nodes besides the important nodes. Click at them to expand them. 

The Note nodes contain further informations. And in case of the models also links to the models, and where to put them. 

This is my first upload at Civitai, so suggesstions and feedback is very welcome.

EDIT:
The example video rendered in 8 minutes plus some overhead for preparation, without the upscaling with CogvideoX Fun version 1.1. at an 4060 TI. Version 1.5 renders doube as fast. But the motion lora does not work. Upscaling is another 4 minutes then if i remember right.
I was not able to run CogvideoX at my old card with 8 Gb. That's too low. 12 gb should work. But i cannot test it. I render at a card with 16 gb at the moment.

Webpage: https://www.tomgoodnoise.de/index.php/ai/workflows/

And there is an explanation video at Youtube:

描述:

Initial release

训练词语: