Hugging Face's logo

thrunlab
/
original_glue_cola

Transformers
Safetensors
mistral
trl
sft
Generated from Trainer
text-generation-inference
Inference Endpoints
Model card Files Community
lukeleeai commited on
Commit
b49c710
•
1 Parent(s): b98f7bf

Training in progress, step 50

Browse files
Files changed (7) hide show
  1. README.md +4 -4
  2. adapter_config.json +2 -2
  3. adapter_model.safetensors +1 -1
  4. model-00001-of-00003.safetensors +1 -1
  5. model-00002-of-00003.safetensors +1 -1
  6. model-00003-of-00003.safetensors +1 -1
  7. training_args.bin +1 -1
README.md CHANGED
@@ -19,7 +19,7 @@ should probably proofread and complete it, then remove this comment. -->
19
 
20
  This model is a fine-tuned version of [mistralai/Mistral-7B-Instruct-v0.1](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.1) on an unknown dataset.
21
  It achieves the following results on the evaluation set:
22
- - Loss: 3.1416
23
  - Accuracy: 0.5853
24
 
25
  ## Model description
@@ -44,10 +44,10 @@ The following hyperparameters were used during training:
44
  - eval_batch_size: 16
45
  - seed: 0
46
  - distributed_type: multi-GPU
47
- - num_devices: 4
48
  - gradient_accumulation_steps: 2
49
- - total_train_batch_size: 64
50
- - total_eval_batch_size: 64
51
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
52
  - lr_scheduler_type: linear
53
  - training_steps: 1
 
19
 
20
  This model is a fine-tuned version of [mistralai/Mistral-7B-Instruct-v0.1](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.1) on an unknown dataset.
21
  It achieves the following results on the evaluation set:
22
+ - Loss: 3.1608
23
  - Accuracy: 0.5853
24
 
25
  ## Model description
 
44
  - eval_batch_size: 16
45
  - seed: 0
46
  - distributed_type: multi-GPU
47
+ - num_devices: 2
48
  - gradient_accumulation_steps: 2
49
+ - total_train_batch_size: 32
50
+ - total_eval_batch_size: 32
51
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
52
  - lr_scheduler_type: linear
53
  - training_steps: 1
adapter_config.json CHANGED
@@ -19,10 +19,10 @@
19
  "rank_pattern": {},
20
  "revision": null,
21
  "target_modules": [
 
22
  "v_proj",
23
- "down_proj",
24
  "gate_proj",
25
- "q_proj"
26
  ],
27
  "task_type": "CAUSAL_LM"
28
  }
 
19
  "rank_pattern": {},
20
  "revision": null,
21
  "target_modules": [
22
+ "q_proj",
23
  "v_proj",
 
24
  "gate_proj",
25
+ "down_proj"
26
  ],
27
  "task_type": "CAUSAL_LM"
28
  }
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:4872ee8bb56e7c0f946ec0db350785c4320b9c6d8d1dfc18654de98f37aa32d3
3
  size 205555592
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7f94acb29af39cdd30b52d2b5cb2480192add2d5503cfe540910288eec22993d
3
  size 205555592
model-00001-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:8bb1d0e7cde59c8ca619a85ffff6915c3f0788adf24f1ccf690e6604c5f28e9d
3
  size 4943163992
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:706b9414e303b804b2b4a33561b9f74287ad622cdf1c029d9624b2648d1c5dad
3
  size 4943163992
model-00002-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:b1e339aeb63538b6da3f83a4db82d120fa84262fde088e1e40379ea71fe7ab5f
3
  size 4999821144
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6b8d2339fc0094554e8bde54863832035b1e719d7a4fcbf130cefbd53425f623
3
  size 4999821144
model-00003-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e4ff7b0fa53416781f1ee573a89328d4c4b6142af51f0ba93224e37e0c9399b8
3
  size 4540517840
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:097515acca12bf753d19048b5c2b1ff6615e2d2b5857cbd9cb0be6ef01507d1f
3
  size 4540517840
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:1b9fbe5b79458c2785d566fa342c362673c1b5a5d1886aa84fd11bc7fe959576
3
  size 6008
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ef8e4f6cf1e1d9dcb165a9211d12ec220baecf11a6d9f322934f4a72d264cd25
3
  size 6008