Format-blended SFT: chat fluency + preserved benchmark formats
Browse files- README.md +12 -0
- chkpt/quazimoto_sft.pt +2 -2
README.md
CHANGED
|
@@ -333,3 +333,15 @@ If you use this model, please cite:
|
|
| 333 |
}
|
| 334 |
```
|
| 335 |
<!-- CITE_END -->
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 333 |
}
|
| 334 |
```
|
| 335 |
<!-- CITE_END -->
|
| 336 |
+
|
| 337 |
+
## Update: format-blended SFT
|
| 338 |
+
|
| 339 |
+
Short instruction/format SFT on a 60/25/15 blend of HuggingFaceTB/smoltalk,
|
| 340 |
+
GSM8K-train ('#### N' reasoning), and MMLU-style ('Answer: <letter>') examples,
|
| 341 |
+
so chat fluency improves while the benchmark output-formats are preserved.
|
| 342 |
+
Held-out (test-split) before->after:
|
| 343 |
+
|
| 344 |
+
held-out 2.04->1.18, MMLU acc 0.010->0.255, format 0.075->1.000
|
| 345 |
+
|
| 346 |
+
Note: fluency + output-format gains. Benchmark *accuracy* remains near the floor
|
| 347 |
+
for a model this size -- the SFT does not add reasoning ability.
|
chkpt/quazimoto_sft.pt
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:e7b92f2c52afaf5cc3ea87327251d5e51fc7e8101d7c4361767eff9e2f9fb647
|
| 3 |
+
size 317214155
|