Introducing Texture Hell

This is my first publicly released sd model. It is meant specifically to create albedo/diffuse textures for use in video games and animations. It has been fully finetuned on the sd2.1 768 base model to provide you with high resolution results. Let's dive into the details.

Please read my description first before using this model, as it is rather diffrent to use than the usual sd models.

Training and prompt tips

The dataset consists of 350 high-quality images sourced from Poly Heaven, ensuring a diverse and representative range of albedo textures.

Clip 1 was used throughout training.

Prompts where comma seperated tag lists (no clip/bert full text descriptions). The most import one is "texture", followed by any material you are interested. Though because of the limited dataset, there are lacking domains (e.g. flesh and cloth). I plan to improve on diversity on subsequent versions. A full list of tags used on images with a frequency usage statistic is available -here- to help you identify potentially interesting tags. But there is probably a lot of room to experiment with other words, i was only able to do rudimentary testing.

Very Important: there are some aerial textures inside the dataset (ie. beach taken by drone from very far up) for landscape textures. If you don't want this type of texture, put "aerial" into negative prompt.

All example images have full prompt information inside them for more information about samplers, steps etc.

Tiling and WebUI

Please note that the textures generated do not perfectly tile. While there is a tiling option available in the WebUI, i do not recommend using it. Instead, i have found a "reasonable" manual workflow to turn them into seamless textures. A tutorial can be found on my Huggingface page:

https://huggingface.co/Nazzaroth2/texture-hell

I hope to improve the inherent tiling ability of the model in further versions, especially a bigger dataset and good tagging should help here.

Other Textures

My first try involded generating the full set of textures needed for the normal pbr-based render pipeline(normal, height, roughness, etc). The initial results are promising, though the reduction in resolution and limited dataset made me change my plans. This might change in the future.

In the meantime you can use other software to create these textures from the albedo image. I personally used the free option Materialize https://boundingboxsoftware.com/materialize . But there are of course also paid versions like Substance Designer.

I am curious to see what you all are able to make with this model and hope it can help you in your projects. If you have any ideas for improvements or a specific material type you think is lacking inside the model, i am happy to hear from you.

Happy texturing!

P.S. Why Texture Hell? Because hell is way more interesting than boring old heaven :3

描述:

训练词语: texture