[LoRA] Shibuya Kanon (Love Live! Superstar!!)版本v1 (ID: 56136)

Update: SDXL 1.0 version here, with additional ability to generate Kanon with glasses and training outfit.

Trained using around 150 anime screenshots from season 1 and season 2. 20-30 images are chosen from sideway angles (booru tag from side). This is important, as previous models I trained for Kanon as well as other characters lacked the ability to generate sideway images.

Activation tag: shibuya kanon

To generate school uniform: student uniform, gray dress, red ribbon, neck ribbon, pinafore dress, white shirt

To generate glasses: glasses. For v2, include bangs, hair between eyes as well (the model will generate her wearing glasses without bangs if not prompted)

Notes for v2

This version produces images extremely close to the anime art style. Most importantly, it rarely distorts her eyes. The key to this might be using a high repeat number and low learning rate, as well as a large enough LoRA capacity (I used 32/16). See changelog (About this version section on the left pane) for more details regarding the training parameters.

Model and ratio:

• Meina_Hentai*: around 0.6-0.7. I recommend using this since it is what the LoRA has been fine-tuned from. Do not get fooled by the name, it is actually a good SFW model

• Anything v4.5, AOMv3: similar to the above. Also precisely describes Kanon, though generated images have high saturation

Demo images did not went through any highres upscaler.

Notes for v1

Model and ratio:

• Anything v4.5: use a LoRA ratio of around 0.6-0.8

• Corneos7thHeavenMix: ratio about 0.7-0.8. Good for generating anime style art

• AOM3A1: around 0.6. Might confuse left and right bangs if generate sideway images

AOM3A1 also has the tendency to change Kanon's hairstyle to hair bun, hair tie, or add random hair bow, ornament, etc. Consider adding those to the negative prompt if you don't want them to appear in your images.

Comparing v2 and v1

Left: v1, right: v2. All images are generated with Meina_Hentai and AOMv3 VAE

描述:

Trained in 150 anime screencaps from season 1 and season 2

Finetuned from NovelAI (anime-final-pruned-fp16)

Parameters:

[additional_network_arguments]

unet_lr = 0.0005

text_encoder_lr = 0.0001

network_dim = 16

network_alpha = 8

network_module = "networks.lora"



[optimizer_arguments]

learning_rate = 0.0005

lr_scheduler = "cosine_with_restarts"

lr_scheduler_num_cycles = 3

lr_warmup_steps = 130

optimizer_type = "AdamW8bit"



[training_arguments]

max_train_epochs = 10

save_every_n_epochs = 5

train_batch_size = 2

clip_skip = 2

seed = 42

max_token_length = 225

xformers = true

lowram = true

max_data_loader_n_workers = 8

persistent_data_loader_workers = true

save_precision = "fp16"

mixed_precision = "fp16"

output_dir = "/content/drive/MyDrive/lora_training/output/shibukano"

logging_dir = "/content/drive/MyDrive/lora_training/log"

output_name = "shibukano"

log_prefix = "shibukano"

save_state = false



[model_arguments]

pretrained_model_name_or_path = "/content/animefull-final-pruned-fp16.safetensors"



[saving_arguments]

save_model_as = "safetensors"



[dreambooth_arguments]

prior_loss_weight = 1.0



[dataset_arguments]

cache_latents = true

训练词语: shibuya kanon