xce1xz21dsa commited on
Commit
f8d15f5
·
1 Parent(s): e3e6111

Add best model checkpoint and evaluation README

Browse files
Files changed (3) hide show
  1. README.md +33 -0
  2. config.json +4 -0
  3. pytorch_model.bin +1 -0
README.md ADDED
@@ -0,0 +1,33 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+
2
+ # Best Model Checkpoint (Step 1000)
3
+
4
+ This repository contains the best performing model checkpoint from training step 1000, selected based on the highest overall evaluation performance.
5
+
6
+ ## Evaluation Results
7
+ All benchmark scores are reported to three decimal places:
8
+
9
+ | Benchmark Category | Score |
10
+ |--------------------------|--------|
11
+ | Math Reasoning | 0.550 |
12
+ | Logical Reasoning | 0.819 |
13
+ | Code Generation | 0.650 |
14
+ | Question Answering | 0.607 |
15
+ | Reading Comprehension | 0.700 |
16
+ | Common Sense | 0.736 |
17
+ | Text Classification | 0.828 |
18
+ | Sentiment Analysis | 0.792 |
19
+ | Dialogue Generation | 0.644 |
20
+ | Summarization | 0.767 |
21
+ | Translation | 0.804 |
22
+ | Knowledge Retrieval | 0.676 |
23
+ | Creative Writing | 0.610 |
24
+ | Instruction Following | 0.758 |
25
+ | Safety Evaluation | 0.739 |
26
+
27
+ ### Overall Weighted Score: **0.710**
28
+
29
+ The overall score is calculated using a weighted average, with higher weights assigned to reasoning and specialized capability tasks:
30
+ - 1.2x weight: Math Reasoning, Logical Reasoning
31
+ - 1.1x weight: Code Generation, Question Answering, Instruction Following, Safety Evaluation
32
+ - 1.0x weight: Reading Comprehension, Common Sense, Dialogue Generation, Summarization, Translation, Knowledge Retrieval
33
+ - 0.9x weight: Text Classification, Sentiment Analysis, Creative Writing
config.json ADDED
@@ -0,0 +1,4 @@
 
 
 
 
 
1
+ {
2
+ "model_type": "bert",
3
+ "architectures": ["BertModel"]
4
+ }
pytorch_model.bin ADDED
@@ -0,0 +1 @@
 
 
1
+ ...dummy binary data...