|
--- |
|
license: other |
|
license_name: faipl |
|
license_link: https://freedevproject.org/faipl-1.0-sd |
|
language: |
|
- en |
|
tags: |
|
- text-to-image |
|
- stable-diffusion |
|
- safetensors |
|
- stable-diffusion-xl |
|
base_model: cagliostrolab/animagine-xl-3.1 |
|
widget: |
|
- text: >- |
|
1girl, green hair, sweater, looking at viewer, upper body, beanie, |
|
outdoors, night, turtleneck, masterpiece, best quality |
|
parameter: |
|
negative_prompt: >- |
|
nsfw, lowres, bad anatomy, bad hands, text, error, missing fingers, |
|
extra digit, fewer digits, cropped, worst quality, low quality, normal |
|
quality, jpeg artifacts, signature, watermark, username, blurry, artist |
|
name |
|
example_title: 1girl |
|
--- |
|
<style> |
|
.title-container { |
|
display: flex; |
|
justify-content: center; |
|
align-items: center; |
|
height: 100vh; /* Adjust this value to position the title vertically */ |
|
} |
|
|
|
.title { |
|
font-size: 2.5em; |
|
text-align: center; |
|
color: #333; |
|
font-family: 'Helvetica Neue', sans-serif; |
|
text-transform: uppercase; |
|
letter-spacing: 0.1em; |
|
padding: 0.5em 0; |
|
background: transparent; |
|
} |
|
|
|
.title span { |
|
background: -webkit-linear-gradient(45deg, #bdabe3, #b39a3e); |
|
-webkit-background-clip: text; |
|
-webkit-text-fill-color: transparent; |
|
} |
|
|
|
.custom-table { |
|
table-layout: fixed; |
|
width: 100%; |
|
border-collapse: collapse; |
|
margin-top: 2em; |
|
} |
|
|
|
.custom-table td { |
|
width: 50%; |
|
vertical-align: top; |
|
padding: 10px; |
|
box-shadow: 0px 0px 0px 0px rgba(0, 0, 0, 0.15); |
|
} |
|
.custom-image-container { |
|
position: relative; |
|
width: 100%; |
|
margin-bottom: 0em; |
|
overflow: hidden; |
|
border-radius: 10px; |
|
transition: transform .7s; |
|
/* Smooth transition for the container */ |
|
} |
|
.custom-image-container:hover { |
|
transform: scale(1.05); |
|
filter: none; |
|
/* Scale the container on hover */ |
|
} |
|
.custom-image { |
|
width: 100%; |
|
height: auto; |
|
object-fit: cover; |
|
border-radius: 10px; |
|
transition: transform .7s; |
|
margin-bottom: 0em; |
|
} |
|
.nsfw-filter { |
|
filter: blur(8px); /* Apply a blur effect */ |
|
transition: filter 0.3s ease; /* Smooth transition for the blur effect */ |
|
} |
|
|
|
.overlay { |
|
position: absolute; |
|
bottom: 0; |
|
left: 0; |
|
right: 0; |
|
color: white; |
|
width: 100%; |
|
height: 40%; |
|
display: flex; |
|
flex-direction: column; |
|
justify-content: center; |
|
align-items: center; |
|
font-size: 1vw; |
|
font-style: bold; |
|
text-align: center; |
|
opacity: 0; |
|
/* Keep the text fully opaque */ |
|
background: linear-gradient(0deg, rgba(0, 0, 0, 0.8) 60%, rgba(0, 0, 0, 0) 100%); |
|
transition: opacity .5s; |
|
} |
|
.custom-image-container:hover .overlay { |
|
opacity: 1; |
|
} |
|
.overlay-text { |
|
background: linear-gradient(45deg, #7ed56f, #28b485); |
|
-webkit-background-clip: text; |
|
color: transparent; |
|
text-shadow: 2px 2px 4px rgba(0, 0, 0, 0.7); |
|
|
|
.overlay-subtext { |
|
font-size: 0.75em; |
|
margin-top: 0.5em; |
|
font-style: italic; |
|
} |
|
|
|
.overlay, |
|
.overlay-subtext { |
|
text-shadow: 2px 2px 4px rgba(0, 0, 0, 0.5); |
|
} |
|
|
|
</style> |
|
<h1 class="title"> |
|
<span>UrangDiffusion 1.4</span> |
|
</h1> |
|
<table class="custom-table"> |
|
<tr> |
|
<td> |
|
<div class="custom-image-container"> |
|
<img class="custom-image" src="https://cdn-uploads.huggingface.co/production/uploads/64333a074521083b9d2aab3b/jsyeY4utstuMKH3euh-Ix.png" alt="sample1"> |
|
</div> |
|
<div class="custom-image-container"> |
|
<img class="custom-image" src="https://cdn-uploads.huggingface.co/production/uploads/64333a074521083b9d2aab3b/ZlJxvv-33cMG6o5wcym6t.png" alt="sample4"> |
|
</div> |
|
</td> |
|
<td> |
|
<div class="custom-image-container"> |
|
<img class="custom-image" src="https://cdn-uploads.huggingface.co/production/uploads/64333a074521083b9d2aab3b/E13T0Vp6VAs6PKHk_AqW2.png" alt="sample2"> |
|
</div> |
|
<div class="custom-image-container"> |
|
<img class="custom-image" src="https://cdn-uploads.huggingface.co/production/uploads/64333a074521083b9d2aab3b/HEvvWe8wuefG_GtFueE0z.png" alt="sample3"> |
|
</td> |
|
<td> |
|
<div class="custom-image-container"> |
|
<img class="custom-image" src="https://cdn-uploads.huggingface.co/production/uploads/64333a074521083b9d2aab3b/yEcm1kGs_3eLF3fo0XxfB.png" alt="sample1"> |
|
</div> |
|
<div class="custom-image-container"> |
|
<img class="custom-image" src="https://cdn-uploads.huggingface.co/production/uploads/64333a074521083b9d2aab3b/53rtgGxO7ZUDrPnj8Wfd7.png" alt="sample4"> |
|
</div> |
|
</td> |
|
</tr> |
|
</table> |
|
|
|
**UrangDiffusion 1.4** (oo-raw-ng Diffusion) is an updated version of UrangDiffusion 1.3. This version provides refreshed dataset, better image tagging, improvements over the last iteration, training parameter correction, and better overall generation results. |
|
|
|
## Standard Prompting Guidelines |
|
The model is finetuned from Animagine XL 3.1. However, there is a little bit changes on dataset captioning, therefore there is some different default prompt used: |
|
|
|
**Default prompt**: |
|
``` |
|
1girl/1boy, character name, from what series, everything else in any order, masterpiece, best quality, amazing quality, very aesthetic |
|
``` |
|
|
|
**Default negative prompt**: |
|
``` |
|
nsfw, lowres, (bad), text, error, fewer, extra, missing, worst quality, jpeg artifacts, low quality, watermark, unfinished, displeasing, oldest, early, chromatic aberration, signature, extra digits, artistic error, username, scan, [abstract], |
|
``` |
|
|
|
**Default configuration:** |
|
|
|
Default configuration: Euler a with around 25-30 steps, CFG 5-7, and ENSD set to 31337. Sweet spot is around **26 steps** and **CFG 5**. |
|
|
|
## Training Configurations |
|
|
|
- Finetuned from: [Animagine XL 3.1](https://huggingface.co/cagliostrolab/animagine-xl-3.1) |
|
|
|
**Pretraining:** |
|
|
|
- Dataset size: 34,368 images |
|
|
|
- GPU: 1xA100 |
|
|
|
- Optimizer: AdaFactor |
|
|
|
- Unet Learning Rate: 3.75e-6 |
|
|
|
- Text Encoder Learning Rate: 1.875e-6 |
|
|
|
- Batch Size: 48 |
|
|
|
- Gradient Accumulation: 1 |
|
|
|
- Warmup steps: 100 steps |
|
|
|
- Min SNR Gamma: 5 |
|
|
|
- Epoch: 10 (epoch 9 is used) |
|
|
|
**Finetuning:** |
|
|
|
- Dataset size: 7,104 images |
|
|
|
- GPU: 1xA100 |
|
|
|
- Optimizer: AdaFactor |
|
|
|
- Unet Learning Rate: 3e-6 |
|
|
|
- Text Encoder Learning Rate: - (Train TE set to False) |
|
|
|
- Batch Size: 48 |
|
|
|
- Gradient Accumulation: 1 |
|
|
|
- Warmup steps: 5% |
|
|
|
- Min SNR Gamma: 5 |
|
|
|
- Epoch: 10 (epoch 8 is used) |
|
|
|
- Noise Offset: 0.0357 |
|
|
|
## Added Series |
|
|
|
**Wuthering Waves**, **Zenless Zone Zero**, **Sewayaki Kitsune no Senko-san**, and **hololiveEN -Justice-** have been added to the model. |
|
|
|
## Special Thanks |
|
- **CagliostroLab** for sponsoring the model pretraining by letting me borrowed the organization’s RunPod account. |
|
|
|
- **My co-workers(?) at CagliostroLab** for the insights and feedback. |
|
|
|
- **Nur Hikari** and **Vanilla Latte** for quality control. |
|
|
|
- **Linaqruf**, my tutor and role model in AI-generated images. |
|
|
|
## License |
|
**UrangDiffusion 1.4** falls under the **[Fair AI Public License 1.0-SD](https://freedevproject.org/faipl-1.0-sd/)** license. |
