黄亦玫-Character-LoRA-for-flux1-dev版本v1.0 (ID: 728170)

2024-08-18

发现同样的png info复制进去后，kaggle出图跟示例图有一些细小差别，感觉很奇怪，可能是显存不同导致导致出图有细微差别,

发现原因在于，封面图用的是flux1-dev.safetensors，kaggle测试用的是flux1-dev-bnb-nf4.safetensors模型，因此出图效果有细微差别,

I noticed slight differences between the Kaggle generated image and the local generated image after copying the same PNG info, it is really weird. Maybe the VRAM differences result in the image-generating differences.

The reason for the discovery is that the cover post image uses flux1-dev.safetensors, while the Kaggle test uses the flux1-dev-bnb-nf4.safetensors model, resulting in slight differences in the rendering effect.

---

2024-08-16

我写了个Kaggle上部署Forge的入门指南，可能会有帮助：‌‍​‍‬​‌‍​​​​​‬​‌​⁠​​⁠​‬⁠​‌​‌‍​​‬​​‌‌​‬‌​​​​​‍​⁠​​‬免费的云端16G显卡跑Flux！Kaggle上部署SD-Forge2.0指南 - Feishu Docs

I wrote a tutorial for deploying Forge-webUI on Kaggle, the scripts might be helpful: https://sap7x39yn02.feishu.cn/wiki/WPW2wcrOIiudnEkm9Zwc5YBNnPc

---

2024-08-16

得益于Zhanglvmin大神的努力，sd-webUI-Forge已经支持FLux1-dev和Flux1-schnell模型，我训练了一个基于flux1-dev.safetensors微调的人像LoRA，已经用Forge体验过，发布出来，欢迎大家体验,

Thanks to the efforts of the amazing lllyasviel, sd-webUI-Forge now supports the Flux1-dev and Flux1-schnell models. I’ve trained a portrait LoRA based on flux1-dev.safetensors and have already tested it with Forge. I'm releasing it for everyone to try out.

概述：

• lora是基于flux1-dev.safetensors进行训练的，载入base model和lora后，提示词里加入涉及woman的描述，得到的图片基本都会呈现黄亦玫的面部特征,（黄亦玫是一部电视剧里的角色）

• 经过Zhanglvmin的更新，flux1-dev上训练的lora也支持了flux1-dev-bnb-nf4.safetensors模型,

• 在comfyUI里一样可以在flux1-dev.safetensors基础上使用该lora,

Overview:

• This LoRA was trained based on flux1-dev.safetensors. After loading the base model and the LoRA, adding prompts related to "woman" will usually result in images featuring the facial characteristics of Huang Yimei (a character from a TV series).

• Thanks to lllyasviel’s updates, LoRAs trained on flux1-dev now also support the flux1-dev-bnb-nf4.safetensors model.

• This LoRA can also be used with flux1-dev.safetensors in webUI-Forge and ComfyUI.

使用步骤：

• Lora

  • 下载本lora模型后，放入./stable-diffusion-webui-forge/models/Lora里，flux1-dev.safetensors下载后放入./stable-diffusion-webui-forge/models/Stable-diffusion里,

• LoRA使用

  • 在prompt文本框里加入lora名称<lora:lora_huangyimei_flux1_dev_v1:0.9>和其他描述性的提示词，点击Generate即可使用本lora进行模型推理,0.9是LoRA的权重，也可以换成0~1的任何小数,

Usage Steps:

• LoRA:

  • Download the LoRA model and place it in ./stable-diffusion-webui-forge/models/Lora. Download flux1-dev.safetensors and place it in ./stable-diffusion-webui-forge/models/Stable-diffusion.

• Using the LoRA:

  • In the prompt text box, add the LoRA name <lora:lora_huangyimei_flux1_dev_v1:0.9> along with other descriptive prompts. Click "Generate" to use this LoRA for inference. The 0.9 represents the LoRA weight, which can be adjusted to any decimal between 0 and 1.

使用细节：

• 推荐尺寸有768*1152,768*1360,832*1216等等,(训练集的尺寸是768*1152和768*768)

• 像素如果用512*512，画出的人物手部容易畸形,原因在于画面太小，留给手部的空间很有限，无法在那么小的像素里画出完好的人手,

• 出图人物的清晰度不够高的话，可以把迭代步数从20步提升到40步,

• 手部如果有问题，可以锁定种子数，微调迭代步数steps,

• 训练集里的图片几乎基本都是半身像、牛仔镜头像，没有全身像,因此使用LoRA生成全身图，效果不好,等后续增加了训练集里图片的数量和质量，可以解决这个问题,

• 跑图的时候，不是每一次出图都会符合预期,需要先20步迭代或25步迭代跑多张图，发现满意的图了，锁定种子之后，xyz plot测试恰当的迭代步数,

• flux模型对提示词服从度更高，手指出问题的情况也更少，应对复杂提示词、绘制复杂场面时表现更好,因此可以在flux出图之后，去SD精修,

Details:

• Recommended resolutions include 768*1152, 768*1360, 832*1216, etc. (The training set images are in 768*1152 and 768*768 resolutions).

• Using a resolution of 512*512 can result in distorted hand features due to limited canvas space, which makes it difficult to render hands accurately at such low pixel counts.

• If the generated image lacks sharpness, try increasing the iteration steps from 20 to 40.

• If hand features are problematic, lock the seed and fine-tune the iteration steps (steps).

• The training set primarily consists of half-body and cowboy shots, with very few full-body images. As a result, generating full-body images with this LoRA may produce unsatisfactory results. This issue can be improved by expanding the training set with higher-quality images.

• Flux models have higher prompt adherence and fewer issues with hand rendering. They also perform better when handling complex prompts and scenes. Therefore, you can use flux to generate an image first, then refine it with SD (Stable Diffusion).

• When generating images, the results may not always meet your expectations on the first try. Generating many pictures with one prompt by running iterations with 20 or 25 steps. Once you find a satisfactory image, lock the seed and use an XYZ plot to test for the optimal number of iteration steps.”

描述:

训练词语: