Quazim0t0 commited on
Commit
8879584
·
1 Parent(s): 45b15d1

Format-blended SFT: chat fluency + preserved benchmark formats

Browse files
Files changed (2) hide show
  1. README.md +12 -0
  2. chkpt/quazimoto_sft.pt +2 -2
README.md CHANGED
@@ -333,3 +333,15 @@ If you use this model, please cite:
333
  }
334
  ```
335
  <!-- CITE_END -->
 
 
 
 
 
 
 
 
 
 
 
 
 
333
  }
334
  ```
335
  <!-- CITE_END -->
336
+
337
+ ## Update: format-blended SFT
338
+
339
+ Short instruction/format SFT on a 60/25/15 blend of HuggingFaceTB/smoltalk,
340
+ GSM8K-train ('#### N' reasoning), and MMLU-style ('Answer: <letter>') examples,
341
+ so chat fluency improves while the benchmark output-formats are preserved.
342
+ Held-out (test-split) before->after:
343
+
344
+ held-out 2.04->1.18, MMLU acc 0.010->0.255, format 0.075->1.000
345
+
346
+ Note: fluency + output-format gains. Benchmark *accuracy* remains near the floor
347
+ for a model this size -- the SFT does not add reasoning ability.
chkpt/quazimoto_sft.pt CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:3f5e88339e4d88140884d360e58952a9c6f867448d4a5608fbf98cd34cda9815
3
- size 317209099
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e7b92f2c52afaf5cc3ea87327251d5e51fc7e8101d7c4361767eff9e2f9fb647
3
+ size 317214155