Text Generation
PEFT
Safetensors
English
llama4_text
adaption-labs
autoscientist
finance
sec-filings
financial-arithmetic
table-reasoning
lora
hackathon
conversational
4-bit precision
bitsandbytes
Instructions to use narendarcodes/adaption-sec-financial-arithmetic-109b with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use narendarcodes/adaption-sec-financial-arithmetic-109b with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("togethercomputer/Llama-4-Scout-17B-16E-Instruct_bnb_4bit") model = PeftModel.from_pretrained(base_model, "narendarcodes/adaption-sec-financial-arithmetic-109b") - Notebooks
- Google Colab
- Kaggle
Update README with detailed model card - Adaption AutoScientist Challenge
Browse files
README.md
CHANGED
|
@@ -52,27 +52,20 @@ This model is trained on **real SEC filing data** with gold reasoning programs t
|
|
| 52 |
| **Language** | English (en) |
|
| 53 |
| **License** | MIT |
|
| 54 |
|
| 55 |
-
##
|
| 56 |
-
|
| 57 |
-
|
| 58 |
-
|
| 59 |
-
|
| 60 |
-
|
| 61 |
-
|
| 62 |
-
|
| 63 |
-
|
| 64 |
-
|
| 65 |
-
|
| 66 |
-
|
| 67 |
-
|
| 68 |
-
|
| 69 |
-
- MUST state the exact mathematical formula being used
|
| 70 |
-
- MUST execute arithmetic sequentially and show intermediate results
|
| 71 |
-
- MUST output the final numeric answer clearly
|
| 72 |
-
|
| 73 |
-
6. **AutoScientist Training Engine** β Automated LoRA SFT on the 109B MoE architecture.
|
| 74 |
-
|
| 75 |
-
7. **LLM-as-a-Judge Evaluation** β Compared adapted model vs. base on held-out financial prompts.
|
| 76 |
|
| 77 |
## π Dataset
|
| 78 |
|
|
|
|
| 52 |
| **Language** | English (en) |
|
| 53 |
| **License** | MIT |
|
| 54 |
|
| 55 |
+
## AutoScientist Platform Integration
|
| 56 |
+
|
| 57 |
+
The model was adapted using the automated training features of the Adaption Labs AutoScientist platform:
|
| 58 |
+
|
| 59 |
+
* **Adaptive Data Pipeline:** Validated the financial dataset structure, maintaining a stable Grade B (8.9 score) across multi-step calculation patterns.
|
| 60 |
+
* **Prompt Deduplication:** Removed redundant financial questions, focusing training on unique computation flows.
|
| 61 |
+
* **Prompt Rephrase Constraint:** Prompt rephrasing was disabled to protect the integrity of financial tables, column headers, and tabular structures from corruption.
|
| 62 |
+
* **Reasoning Traces & Blueprint Constraints:** Enforced structured arithmetic thinking. The model is trained to show complete working in a `<think>` trace verified against gold calculation programs before outputting the final answer. The blueprint constraints mandate:
|
| 63 |
+
1. Extracting the exact cell coordinates and values from the input SEC table.
|
| 64 |
+
2. Stating the mathematical formula explicitly.
|
| 65 |
+
3. Executing arithmetic steps sequentially.
|
| 66 |
+
4. Outputting a clear, verified final numeric value.
|
| 67 |
+
* **Hyperparameter Optimization:** Managed the training run using LoRA SFT targeting the attention and feed-forward layers of meta-llama/Llama-4-Scout-17B-16E-Instruct.
|
| 68 |
+
* **Evaluation:** Compared the adapted model performance against the base model on held-out financial prompts using automated preference scoring.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 69 |
|
| 70 |
## π Dataset
|
| 71 |
|