Hugging Face's logo

thrunlab
/
original_glue_cola

Transformers
Safetensors
mistral
trl
sft
Generated from Trainer
text-generation-inference
Inference Endpoints
Model card Files Community
lukeleeai commited on
Commit
ab04b98
•
1 Parent(s): 99a3205

End of training

Browse files
Files changed (4) hide show
  1. README.md +24 -3
  2. model-00001-of-00003.safetensors +1 -1
  3. model-00002-of-00003.safetensors +1 -1
  4. model-00003-of-00003.safetensors +1 -1
README.md CHANGED
@@ -19,8 +19,8 @@ should probably proofread and complete it, then remove this comment. -->
19
 
20
  This model is a fine-tuned version of [mistralai/Mistral-7B-Instruct-v0.1](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.1) on an unknown dataset.
21
  It achieves the following results on the evaluation set:
22
- - Loss: 3.1608
23
- - Accuracy: 0.5853
24
 
25
  ## Model description
26
 
@@ -50,10 +50,31 @@ The following hyperparameters were used during training:
50
  - total_eval_batch_size: 32
51
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
52
  - lr_scheduler_type: linear
53
- - training_steps: 1
54
 
55
  ### Training results
56
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
57
 
58
 
59
  ### Framework versions
 
19
 
20
  This model is a fine-tuned version of [mistralai/Mistral-7B-Instruct-v0.1](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.1) on an unknown dataset.
21
  It achieves the following results on the evaluation set:
22
+ - Loss: 0.3803
23
+ - Accuracy: 0.8363
24
 
25
  ## Model description
26
 
 
50
  - total_eval_batch_size: 32
51
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
52
  - lr_scheduler_type: linear
53
+ - num_epochs: 10
54
 
55
  ### Training results
56
 
57
+ | Training Loss | Epoch | Step | Validation Loss | Accuracy |
58
+ |:-------------:|:-----:|:----:|:---------------:|:--------:|
59
+ | 0.4253 | 0.22 | 50 | 0.4968 | 0.7553 |
60
+ | 0.5036 | 0.44 | 100 | 0.4704 | 0.7779 |
61
+ | 0.4974 | 0.66 | 150 | 0.4562 | 0.7825 |
62
+ | 0.4649 | 0.88 | 200 | 0.4299 | 0.7880 |
63
+ | 0.3356 | 1.1 | 250 | 0.4155 | 0.8051 |
64
+ | 0.4005 | 1.32 | 300 | 0.4026 | 0.8184 |
65
+ | 0.328 | 1.54 | 350 | 0.4052 | 0.8145 |
66
+ | 0.3632 | 1.76 | 400 | 0.3889 | 0.8270 |
67
+ | 0.3334 | 1.98 | 450 | 0.4176 | 0.8036 |
68
+ | 0.3166 | 2.2 | 500 | 0.4195 | 0.8324 |
69
+ | 0.2649 | 2.42 | 550 | 0.3929 | 0.8254 |
70
+ | 0.2805 | 2.64 | 600 | 0.3877 | 0.8363 |
71
+ | 0.3357 | 2.86 | 650 | 0.3734 | 0.8457 |
72
+ | 0.2476 | 3.08 | 700 | 0.3930 | 0.8418 |
73
+ | 0.2361 | 3.3 | 750 | 0.3893 | 0.8566 |
74
+ | 0.2375 | 3.52 | 800 | 0.3769 | 0.8519 |
75
+ | 0.18 | 3.74 | 850 | 0.3757 | 0.8519 |
76
+ | 0.2305 | 3.96 | 900 | 0.3783 | 0.8465 |
77
+ | 0.1432 | 4.18 | 950 | 0.4876 | 0.8402 |
78
 
79
 
80
  ### Framework versions
model-00001-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:706b9414e303b804b2b4a33561b9f74287ad622cdf1c029d9624b2648d1c5dad
3
  size 4943163992
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:52ff705bd0f11b8fdf5a45c121b572c9f9b4fab5bcdec3793e9dbdebec10e77b
3
  size 4943163992
model-00002-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:6b8d2339fc0094554e8bde54863832035b1e719d7a4fcbf130cefbd53425f623
3
  size 4999821144
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:245906d1502b1c6a162f36247d19d58e7c696b1a24850c72c2fa7d65125c62c7
3
  size 4999821144
model-00003-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:097515acca12bf753d19048b5c2b1ff6615e2d2b5857cbd9cb0be6ef01507d1f
3
  size 4540517840
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:768cc81fca8274878dfee1923e56e23dc0e583391980d671b03e7a683e3b4907
3
  size 4540517840