Upload folder using huggingface_hub

0_SwiftLoRA/adapter_config.json

@@ -0,0 +1,34 @@
+{
+  "alpha_pattern": {},
+  "auto_mapping": null,
+  "base_model_name_or_path": null,
+  "bias": "none",
+  "enable_lora": null,
+  "fan_in_fan_out": false,
+  "inference_mode": false,
+  "init_lora_weights": true,
+  "layer_replication": null,
+  "layers_pattern": null,
+  "layers_to_transform": null,
+  "loftq_config": {},
+  "lora_alpha": 64,
+  "lora_dropout": 0.0,
+  "lora_dtype": null,
+  "lorap_emb_lr": 1e-06,
+  "lorap_lr_ratio": 16.0,
+  "megatron_config": null,
+  "megatron_core": "megatron.core",
+  "model_key_mapping": null,
+  "modules_to_save": null,
+  "peft_type": "LORA",
+  "r": 64,
+  "rank_pattern": {},
+  "revision": null,
+  "swift_type": "LORA",
+  "target_modules": "(cond_stage_model.*(q_proj|k_proj|v_proj|out_proj|mlp.fc1|mlp.fc2))|(model.*(to_q|to_k|to_v|to_out.0|net.0.proj|net.2))$",
+  "task_type": null,
+  "use_dora": false,
+  "use_merged_linear": false,
+  "use_qa_lora": false,
+  "use_rslora": false
+}

0_SwiftLoRA/adapter_model.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e8f7627401d1372d0ed3d183d498fd97fedcc9d2672ff244e1642591ea3c7dc8
+size 138393741

README.md

@@ -0,0 +1,168 @@
+---
+frameworks:
+- Pytorch
+license: apache-2.0
+tasks:
+- efficient-diffusion-tuning
+---
+
+<p align="center">
+
+  <h2 align="center">SD15-TEXT_LORA-3DStyle-20240523-test</h2>
+  <p align="center">
+    <br>
+        <a href="https://github.com/modelscope/scepter/"><img src="https://img.shields.io/badge/powered by-scepter-6FEBB9.svg"></a>
+    <br>
+  </p>
+
+## Model Introduction
+test123
+
+## Model Parameters
+<table>
+<thead>
+  <tr>
+    <th rowspan="2">Base Model</th>
+    <th rowspan="2">Tuner Type</th>
+    <th colspan="4">Training Parameters</th>
+  </tr>
+  <tr>
+    <th>Batch Size</th>
+    <th>Epochs</th>
+    <th>Learning Rate</th>
+    <th>Resolution</th>
+  </tr>
+</thead>
+<tbody align="center">
+  <tr>
+    <td rowspan="8">SD1.5</td>
+    <td>TEXT_LORA</td>
+    <td>4</td>
+    <td>50</td>
+    <td>0.0001</td>
+    <td>[512, 512]</td>
+  </tr>
+</tbody>
+</table>
+
+
+<table>
+<thead>
+  <tr>
+    <th>Data Type</th>
+    <th>Data Space</th>
+    <th>Data Name</th>
+    <th>Data Subset</th>
+  </tr>
+</thead>
+<tbody align="center">
+  <tr>
+    <td>Dataset zip</td>
+    <td></td>
+    <td>/home/scepter/cache/scepter_ui/datasets/scepter_txt2img_3D_example</td>
+    <td>default</td>
+  </tr>
+</tbody>
+</table>
+
+
+## Model Performance
+Given the input "a boy wearing a jacket," the following image may be generated:
+
+![image](./image.jpg)
+
+## Model Usage
+### Command Line Execution
+* Run using Scepter's SDK, taking care to use different configuration files in accordance with the different base models, as per the corresponding relationships shown below
+<table>
+<thead>
+  <tr>
+    <th rowspan="2">Base Model</th>
+    <th rowspan="1">LORA</th>
+    <th colspan="1">SCE</th>
+    <th colspan="1">TEXT_LORA</th>
+    <th colspan="1">TEXT_SCE</th>
+  </tr>
+</thead>
+<tbody align="center">
+  <tr>
+    <td rowspan="8">SD1.5</td>
+    <td><a href="https://github.com/modelscope/scepter/blob/main/scepter/methods/examples/generation/stable_diffusion_1.5_512_lora.yaml">lora_cfg</a></td>
+    <td><a href="https://github.com/modelscope/scepter/blob/main/scepter/methods/scedit/t2i/sd15_512_sce_t2i_swift.yaml">sce_cfg</a></td>
+    <td><a href="https://github.com/modelscope/scepter/blob/main/scepter/methods/examples/generation/stable_diffusion_1.5_512_text_lora.yaml">text_lora_cfg</a></td>
+    <td><a href="https://github.com/modelscope/scepter/blob/main/scepter/methods/scedit/t2i/stable_diffusion_1.5_512_text_sce.yaml">text_sce_cfg</a></td>
+  </tr>
+</tbody>
+<tbody align="center">
+  <tr>
+    <td rowspan="8">SD2.1</td>
+    <td><a href="https://github.com/modelscope/scepter/blob/main/scepter/methods/examples/generation/stable_diffusion_2.1_768_lora.yaml">lora_cfg</a></td>
+    <td><a href="https://github.com/modelscope/scepter/blob/main/scepter/methods/scedit/t2i/sd21_768_sce_t2i_swift.yaml">sce_cfg</a></td>
+    <td><a href="https://github.com/modelscope/scepter/blob/main/scepter/methods/examples/generation/stable_diffusion_2.1_768_text_lora.yaml">text_lora_cfg</a></td>
+    <td><a href="https://github.com/modelscope/scepter/blob/main/scepter/methods/scedit/t2i/sd21_768_text_sce_t2i_swift.yaml">text_sce_cfg</a></td>
+  </tr>
+</tbody>
+<tbody align="center">
+  <tr>
+    <td rowspan="8">SDXL</td>
+    <td><a href="https://github.com/modelscope/scepter/blob/main/scepter/methods/examples/generation/stable_diffusion_xl_1024_lora.yaml">lora_cfg</a></td>
+    <td><a href="https://github.com/modelscope/scepter/blob/main/scepter/methods/scedit/t2i/sdxl_1024_sce_t2i_swift.yaml">sce_cfg</a></td>
+    <td><a href="https://github.com/modelscope/scepter/blob/main/scepter/methods/examples/generation/stable_diffusion_xl_1024_text_lora.yaml">text_lora_cfg</a></td>
+    <td><a href="https://github.com/modelscope/scepter/blob/main/scepter/methods/scedit/t2i/sdxl_1024_text_sce_t2i_swift.yaml">text_sce_cfg</a></td>
+  </tr>
+</tbody>
+</table>
+
+* Running from Source Code
+
+```shell
+git clone https://github.com/modelscope/scepter.git
+cd scepter
+pip install -r requirements/recommended.txt
+PYTHONPATH=. python scepter/tools/run_inference.py
+  --pretrained_model {this model folder}
+  --cfg {lora_cfg} or {sce_cfg} or {text_lora_cfg} or {text_sce_cfg}
+  --prompt 'a boy wearing a jacket'
+  --save_folder 'inference'
+```
+
+* Running after Installing Scepter (Recommended)
+```shell
+pip install scepter
+python -m scepter/tools/run_inference.py
+  --pretrained_model {this model folder}
+  --cfg {lora_cfg} or {sce_cfg} or {text_lora_cfg} or {text_sce_cfg}
+  --prompt 'a boy wearing a jacket'
+  --save_folder 'inference'
+```
+### Running with Scepter Studio
+
+```shell
+pip install scepter
+# Launch Scepter Studio
+python -m scepter.tools.webui
+```
+
+* Refer to the following guides for model usage.
+
+(video url)
+
+## Model Reference
+If you wish to use this model for your own purposes, please cite it as follows.
+```bibtex
+@misc{SD15-TEXT_LORA-3DStyle-20240523-test,
+    title = {SD15-TEXT_LORA-3DStyle-20240523-test, https://huggingface.co/jiangzeyinzi/SD15-TEXT_LORA-3DStyle-20240523-test},
+    author = {jiangzeyinzi},
+    year = {2024}
+}
+```
+This model was trained using [Scepter Studio](https://github.com/modelscope/scepter); [Scepter](https://github.com/modelscope/scepter)
+is an algorithm framework and toolbox developed by the Alibaba Tongyi Wanxiang Team. It provides a suite of tools and models for image generation, editing, fine-tuning, data processing, and more. If you find our work beneficial for your research,
+please cite as follows.
+```bibtex
+@misc{scepter,
+    title = {SCEPTER, https://github.com/modelscope/scepter},
+    author = {SCEPTER},
+    year = {2023}
+}
+```

configuration.json

@@ -0,0 +1 @@
+{}

params.yaml

@@ -0,0 +1,34 @@
+DESCRIPTION: test123
+PARAMS:
+  base_model: stable_diffusion
+  base_model_revision: SD1.5
+  bucket_no_upscale: false
+  bucket_resolution_steps: 64.0
+  data_type: Dataset zip
+  enable_resolution_bucket: false
+  eval_prompts:
+  - a boy wearing a jacket
+  - a dog running on the lawn
+  learning_rate: 0.0001
+  lora_alpha: 64.0
+  lora_rank: 64.0
+  max_bucket_resolution: 1024.0
+  min_bucket_resolution: 256.0
+  ms_data_name: /home/scepter/cache/scepter_ui/datasets/scepter_txt2img_3D_example
+  ms_data_space: ''
+  ms_data_subname: default
+  ori_data_name: 3D_example
+  prompt_prefix: ''
+  push_to_hub: false
+  replace_keywords: ''
+  resolution_height: 512
+  resolution_width: 512
+  save_interval: 25
+  sce_ratio: 1
+  text_lora_alpha: 256.0
+  text_lora_rank: 256.0
+  train_batch_size: 4
+  train_epoch: 50
+  tuner_name: TEXT_LORA
+  work_dir: ''
+  work_name: ''