Hugging Face's logo

DeepDream2045
/
80a89bc3-899f-4e23-9896-759501ad8a54

PEFT
Safetensors
qwen2
axolotl
Generated from Trainer
Model card Files
xet
 Community
DeepDream2045 commited on
Commit
1e1f070
·
verified ·
1 Parent(s): 91da5e7

End of training

Browse files
Files changed (5) hide show
  1. README.md +3 -3
  2. adapter_config.json +5 -5
  3. adapter_model.bin +1 -1
  4. adapter_model.safetensors +1 -1
  5. training_args.bin +1 -1
README.md CHANGED
@@ -103,7 +103,7 @@ xformers_attention: true
103
 
104
  This model is a fine-tuned version of [unsloth/Qwen2.5-3B-Instruct](https://huggingface.co/unsloth/Qwen2.5-3B-Instruct) on the None dataset.
105
  It achieves the following results on the evaluation set:
106
- - Loss: 0.6561
107
 
108
  ## Model description
109
 
@@ -141,8 +141,8 @@ The following hyperparameters were used during training:
141
  | Training Loss | Epoch | Step | Validation Loss |
142
  |:-------------:|:------:|:----:|:---------------:|
143
  | 2.8513 | 0.0165 | 1 | 3.8587 |
144
- | 0.5981 | 0.4115 | 25 | 0.7051 |
145
- | 0.5867 | 0.8230 | 50 | 0.6561 |
146
 
147
 
148
  ### Framework versions
 
103
 
104
  This model is a fine-tuned version of [unsloth/Qwen2.5-3B-Instruct](https://huggingface.co/unsloth/Qwen2.5-3B-Instruct) on the None dataset.
105
  It achieves the following results on the evaluation set:
106
+ - Loss: 0.6542
107
 
108
  ## Model description
109
 
 
141
  | Training Loss | Epoch | Step | Validation Loss |
142
  |:-------------:|:------:|:----:|:---------------:|
143
  | 2.8513 | 0.0165 | 1 | 3.8587 |
144
+ | 0.5986 | 0.4115 | 25 | 0.7033 |
145
+ | 0.5858 | 0.8230 | 50 | 0.6542 |
146
 
147
 
148
  ### Framework versions
adapter_config.json CHANGED
@@ -20,13 +20,13 @@
20
  "rank_pattern": {},
21
  "revision": null,
22
  "target_modules": [
 
 
 
 
23
  "down_proj",
24
- "v_proj",
25
  "gate_proj",
26
- "up_proj",
27
- "q_proj",
28
- "k_proj",
29
- "o_proj"
30
  ],
31
  "task_type": "CAUSAL_LM",
32
  "use_dora": false,
 
20
  "rank_pattern": {},
21
  "revision": null,
22
  "target_modules": [
23
+ "k_proj",
24
+ "q_proj",
25
+ "o_proj",
26
+ "up_proj",
27
  "down_proj",
 
28
  "gate_proj",
29
+ "v_proj"
 
 
 
30
  ],
31
  "task_type": "CAUSAL_LM",
32
  "use_dora": false,
adapter_model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:02ec501265a7cdfa2c821893ee55d3b98ce44e34622cf016235dbba41dbdcb7b
3
  size 239650666
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:92a2634694ed057a4db5fb83510c9f0228cffc092a1f1f5f1b148964e6ca136a
3
  size 239650666
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e17665ce5a09cfa29e3d3dcb84f65d1d7dacfd5b1884c75a226827ecf58dc0b8
3
  size 239536272
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cb9c433e67d7d67735ab4c08b384b700ad7bbb2ef098bc9db8b5f55f05f73f4a
3
  size 239536272
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:85e8dfa1540ca3fe1a9279429500b8935e685568e77962b57855c979b3e8ce15
3
  size 6776
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:94f8966a7f5610ce3154bf3af6bc87a6aa3dca284fbee83e288364d669bb4725
3
  size 6776