narendarcodes commited on
Commit
ee02aed
Β·
verified Β·
1 Parent(s): 0f19646

Update README with detailed model card - Adaption AutoScientist Challenge

Browse files
Files changed (1) hide show
  1. README.md +14 -21
README.md CHANGED
@@ -52,27 +52,20 @@ This model is trained on **real SEC filing data** with gold reasoning programs t
52
  | **Language** | English (en) |
53
  | **License** | MIT |
54
 
55
- ## πŸ§ͺ AutoScientist Platform Usage (100% Platform-Driven)
56
-
57
- Every step of the training pipeline was executed through the Adaption Labs AutoScientist platform:
58
-
59
- 1. **Adaptive Data Pipeline** β€” Ingested financial reasoning data and performed quality validation (Grade **B** maintained at score 8.9).
60
-
61
- 2. **Prompt Deduplication** β€” Removed duplicate financial questions to ensure diverse calculation patterns.
62
-
63
- 3. **Prompt Rephrase** β€” **Disabled** per platform guidance: rephrasing would corrupt table formatting, column headers, and financial terminology.
64
-
65
- 4. **Reasoning Traces** β€” Enhanced completions with structured mathematical chains: extract variables β†’ state formula β†’ execute step-by-step β†’ verify against gold program.
66
-
67
- 5. **Blueprint Constraints** β€” Defined financial-specific grading criteria:
68
- - MUST extract the relevant variables from the table before computing
69
- - MUST state the exact mathematical formula being used
70
- - MUST execute arithmetic sequentially and show intermediate results
71
- - MUST output the final numeric answer clearly
72
-
73
- 6. **AutoScientist Training Engine** β€” Automated LoRA SFT on the 109B MoE architecture.
74
-
75
- 7. **LLM-as-a-Judge Evaluation** β€” Compared adapted model vs. base on held-out financial prompts.
76
 
77
  ## πŸ“Š Dataset
78
 
 
52
  | **Language** | English (en) |
53
  | **License** | MIT |
54
 
55
+ ## AutoScientist Platform Integration
56
+
57
+ The model was adapted using the automated training features of the Adaption Labs AutoScientist platform:
58
+
59
+ * **Adaptive Data Pipeline:** Validated the financial dataset structure, maintaining a stable Grade B (8.9 score) across multi-step calculation patterns.
60
+ * **Prompt Deduplication:** Removed redundant financial questions, focusing training on unique computation flows.
61
+ * **Prompt Rephrase Constraint:** Prompt rephrasing was disabled to protect the integrity of financial tables, column headers, and tabular structures from corruption.
62
+ * **Reasoning Traces & Blueprint Constraints:** Enforced structured arithmetic thinking. The model is trained to show complete working in a `<think>` trace verified against gold calculation programs before outputting the final answer. The blueprint constraints mandate:
63
+ 1. Extracting the exact cell coordinates and values from the input SEC table.
64
+ 2. Stating the mathematical formula explicitly.
65
+ 3. Executing arithmetic steps sequentially.
66
+ 4. Outputting a clear, verified final numeric value.
67
+ * **Hyperparameter Optimization:** Managed the training run using LoRA SFT targeting the attention and feed-forward layers of meta-llama/Llama-4-Scout-17B-16E-Instruct.
68
+ * **Evaluation:** Compared the adapted model performance against the base model on held-out financial prompts using automated preference scoring.
 
 
 
 
 
 
 
69
 
70
  ## πŸ“Š Dataset
71