Pran-Ker commited on
Commit
118f27d
·
verified ·
1 Parent(s): 7f04b4f

Fix GitHub URL, add leaderboard link, update paper abstract quote

Browse files
Files changed (1) hide show
  1. README.md +28 -26
README.md CHANGED
@@ -15,39 +15,41 @@ tags:
15
  <p align="center">
16
  <a href="https://arxiv.org/abs/2601.16175"><img src="https://img.shields.io/badge/arXiv-2601.16175-b31b1b.svg" alt="arXiv"></a>
17
  <a href="https://test-time-training.github.io/discover/"><img src="https://img.shields.io/badge/Project-Page-blue" alt="Project Page"></a>
18
- <a href="https://github.com/prannayHexo/discover"><img src="https://img.shields.io/badge/GitHub-discover-black?logo=github" alt="GitHub"></a>
19
  <a href="https://colab.research.google.com/github/Pran-Ker/gpu-mode-trimul/blob/main/gpu_mode_trimul.ipynb"><img src="https://colab.research.google.com/assets/colab-badge.svg" alt="Open In Colab"></a>
20
  </p>
21
  </p>
22
 
23
  LoRA adapter for **gpt-oss-120b**, trained with reinforcement learning on the
24
- [GPU Mode TriMul](https://github.com/gpu-mode) competition — triangular matrix multiplication on H100.
 
25
 
26
- Produced via **TTT-Discover** ([Yuksekgonul et al., 2026](https://arxiv.org/abs/2601.16175)),
27
- a method that runs RL *at test time* to let the model discover better solutions by trying and
28
- learning from real execution feedback.
 
 
29
 
30
  ---
31
 
32
  ## What is TTT-Discover?
33
 
34
- > *"We perform reinforcement learning at test time, allowing the LLM to continue training with
35
- > experience specific to the problem at hand."*
36
- > — [Learning to Discover at Test Time](https://arxiv.org/abs/2601.16175)
37
-
38
- The model receives a reward signal based on measured GPU runtime (`reward = 1500 / runtime_μs`)
39
- and learns to write faster Triton kernels through trial and error — no human-written examples needed.
40
 
41
  **Published results (H100, TriMul):**
42
 
43
- | | Runtime ↓ |
44
- |---|---|
45
- | Best Human | 1371 μs |
46
- | Prev. Best AI | — |
47
- | **TTT-Discover** | **1161 μs** |
 
48
 
49
- This checkpoint reached **~3638 μs** at step 14 (best reward 0.412), plateauing at ~3570 μs through step 30.
50
- Starting from this checkpoint instead of scratch saves ~14 steps of cold-start exploration.
51
 
52
  ---
53
 
@@ -64,7 +66,7 @@ Starting from this checkpoint instead of scratch saves ~14 steps of cold-start e
64
  | 25 | 0.281 | 0.156 | ~5340 μs |
65
  | 30 | 0.280 | 0.210 | ~5360 μs |
66
 
67
- > Steps 15–17 had zero reward due to a billing limit on the eval cluster — not a training failure.
68
 
69
  ---
70
 
@@ -78,7 +80,7 @@ sampler_weights/
78
  gpu_mode_trimul.ipynb # Google Colab notebook
79
  ```
80
 
81
- The training state (optimizer + model state for resuming RL) is stored on Tinker at:
82
  `tinker://681a070d-2ef4-5b8c-a216-d4f22dca1efb:train:0/weights/000030`
83
 
84
  ---
@@ -87,7 +89,7 @@ The training state (optimizer + model state for resuming RL) is stored on Tinker
87
 
88
  [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/Pran-Ker/gpu-mode-trimul/blob/main/gpu_mode_trimul.ipynb)
89
 
90
- Open the notebook above to run TTT-Discover on the TriMul task, fork from this checkpoint,
91
  or plug in your own GPU kernel problem.
92
 
93
  ### What you need
@@ -100,14 +102,14 @@ or plug in your own GPU kernel problem.
100
 
101
  > No local GPU required — training runs on Tinker's cluster; kernel evals run on Modal H100s.
102
 
103
- ### Run on TriMul from this checkpoint
104
 
105
  ```python
106
  import asyncio, os
107
  from ttt_discover.rl.train import Config, main as rl_main
108
  from ttt_discover.tinker_utils import misc_utils
109
  from ttt_discover.tinker_utils.dataset_builder import DatasetConfig, get_single_problem_dataset_builder
110
- from examples.gpu_mode.env import GpuModeEnv
111
 
112
  CHECKPOINT = "tinker://681a070d-2ef4-5b8c-a216-d4f22dca1efb:train:0/weights/000030"
113
  EXPERIMENT = "my-trimul-run"
@@ -166,8 +168,8 @@ print(asyncio.run(ask("Write a fast Triton kernel for triangular matmul on H100.
166
  **Learning to Discover at Test Time**
167
  Mert Yuksekgonul\*, Daniel Koceja\*, Xinhao Li\*, Federico Bianchi\*, Jed McCaleb,
168
  Xiaolong Wang, Jan Kautz, Yejin Choi, James Zou†, Carlos Guestrin†, Yu Sun
169
- Stanford · NVIDIA · Astera Institute · UC San Diego · Together AI
170
- [arXiv:2601.16175](https://arxiv.org/abs/2601.16175) · [Project page](https://test-time-training.github.io/discover/)
171
 
172
  ```bibtex
173
  @article{ttt-discover2026,
@@ -186,4 +188,4 @@ Stanford · NVIDIA · Astera Institute · UC San Diego · Together AI
186
  ## Acknowledgments
187
 
188
  - **[GPU Mode](https://github.com/gpu-mode)** — community for GPU kernel optimization and the TriMul competition
189
- - **[Tinker](https://tinker.thinkingmachines.dev)** — LLM training and RL infrastructure
 
15
  <p align="center">
16
  <a href="https://arxiv.org/abs/2601.16175"><img src="https://img.shields.io/badge/arXiv-2601.16175-b31b1b.svg" alt="arXiv"></a>
17
  <a href="https://test-time-training.github.io/discover/"><img src="https://img.shields.io/badge/Project-Page-blue" alt="Project Page"></a>
18
+ <a href="https://github.com/test-time-training/discover"><img src="https://img.shields.io/badge/GitHub-discover-black?logo=github" alt="GitHub"></a>
19
  <a href="https://colab.research.google.com/github/Pran-Ker/gpu-mode-trimul/blob/main/gpu_mode_trimul.ipynb"><img src="https://colab.research.google.com/assets/colab-badge.svg" alt="Open In Colab"></a>
20
  </p>
21
  </p>
22
 
23
  LoRA adapter for **gpt-oss-120b**, trained with reinforcement learning on the
24
+ [GPU Mode TriMul](https://www.gpumode.com/v2/leaderboard/496?tab=rankings) competition —
25
+ triangular matrix multiplication on H100.
26
 
27
+ Produced via **TTT-Discover** ([Yuksekgonul et al., 2026](https://arxiv.org/abs/2601.16175)):
28
+
29
+ > *"We perform reinforcement learning at test time, allowing the LLM to continue training
30
+ > with experience specific to the problem at hand … Our test-time training runs are performed
31
+ > using Tinker, an API by Thinking Machines, with a cost of only a few hundred dollars per problem."*
32
 
33
  ---
34
 
35
  ## What is TTT-Discover?
36
 
37
+ Instead of prompting a frozen model (like AlphaEvolve), TTT-Discover **keeps training** on your
38
+ specific problem at test time. The model earns a reward signal from real execution feedback
39
+ (`reward = 1500 / runtime_μs`) and learns to write faster Triton kernels through trial and error —
40
+ no human-written examples needed.
 
 
41
 
42
  **Published results (H100, TriMul):**
43
 
44
+ | | A100 ↓ | H100 ↓ | B200 ↓ | MI300x ↓ |
45
+ |---|---|---|---|---|
46
+ | Best Human | 4531 μs | 1371 μs | 1005 μs | 2462 μs |
47
+ | **TTT-Discover** | **2198 μs** | **1161 μs** | **905 μs** | **1596 μs** |
48
+
49
+ [Verify on GPU Mode leaderboard →](https://www.gpumode.com/v2/leaderboard/496?tab=rankings)
50
 
51
+ This checkpoint reached **~3638 μs** at step 14 (best reward 0.412).
52
+ Starting from it instead of scratch saves ~14 steps of cold-start exploration.
53
 
54
  ---
55
 
 
66
  | 25 | 0.281 | 0.156 | ~5340 μs |
67
  | 30 | 0.280 | 0.210 | ~5360 μs |
68
 
69
+ > Steps 15–17 had zero reward due to an eval cluster billing limit — not a training failure.
70
 
71
  ---
72
 
 
80
  gpu_mode_trimul.ipynb # Google Colab notebook
81
  ```
82
 
83
+ Training state (for resuming RL with fresh optimizer):
84
  `tinker://681a070d-2ef4-5b8c-a216-d4f22dca1efb:train:0/weights/000030`
85
 
86
  ---
 
89
 
90
  [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/Pran-Ker/gpu-mode-trimul/blob/main/gpu_mode_trimul.ipynb)
91
 
92
+ Open the notebook above to run TTT-Discover on TriMul, fork from this checkpoint,
93
  or plug in your own GPU kernel problem.
94
 
95
  ### What you need
 
102
 
103
  > No local GPU required — training runs on Tinker's cluster; kernel evals run on Modal H100s.
104
 
105
+ ### Warm-start RL from this checkpoint
106
 
107
  ```python
108
  import asyncio, os
109
  from ttt_discover.rl.train import Config, main as rl_main
110
  from ttt_discover.tinker_utils import misc_utils
111
  from ttt_discover.tinker_utils.dataset_builder import DatasetConfig, get_single_problem_dataset_builder
112
+ from examples.gpu_mode.env import GpuModeEnv # from github.com/test-time-training/discover
113
 
114
  CHECKPOINT = "tinker://681a070d-2ef4-5b8c-a216-d4f22dca1efb:train:0/weights/000030"
115
  EXPERIMENT = "my-trimul-run"
 
168
  **Learning to Discover at Test Time**
169
  Mert Yuksekgonul\*, Daniel Koceja\*, Xinhao Li\*, Federico Bianchi\*, Jed McCaleb,
170
  Xiaolong Wang, Jan Kautz, Yejin Choi, James Zou†, Carlos Guestrin†, Yu Sun
171
+ *Stanford · NVIDIA · Astera Institute · UC San Diego · Together AI*
172
+ [arXiv:2601.16175](https://arxiv.org/abs/2601.16175) · [Project page](https://test-time-training.github.io/discover/) · [PDF](https://test-time-training.github.io/discover.pdf)
173
 
174
  ```bibtex
175
  @article{ttt-discover2026,
 
188
  ## Acknowledgments
189
 
190
  - **[GPU Mode](https://github.com/gpu-mode)** — community for GPU kernel optimization and the TriMul competition
191
+ - **[Tinker](https://tinker.thinkingmachines.dev)** — LLM training and RL infrastructure by Thinking Machines