Instructions to use Pran-Ker/gpu-mode-trimul with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use Pran-Ker/gpu-mode-trimul with PEFT:
Task type is invalid.
- Notebooks
- Google Colab
- Kaggle
Fix GitHub URL, add leaderboard link, update paper abstract quote
Browse files
README.md
CHANGED
|
@@ -15,39 +15,41 @@ tags:
|
|
| 15 |
<p align="center">
|
| 16 |
<a href="https://arxiv.org/abs/2601.16175"><img src="https://img.shields.io/badge/arXiv-2601.16175-b31b1b.svg" alt="arXiv"></a>
|
| 17 |
<a href="https://test-time-training.github.io/discover/"><img src="https://img.shields.io/badge/Project-Page-blue" alt="Project Page"></a>
|
| 18 |
-
<a href="https://github.com/
|
| 19 |
<a href="https://colab.research.google.com/github/Pran-Ker/gpu-mode-trimul/blob/main/gpu_mode_trimul.ipynb"><img src="https://colab.research.google.com/assets/colab-badge.svg" alt="Open In Colab"></a>
|
| 20 |
</p>
|
| 21 |
</p>
|
| 22 |
|
| 23 |
LoRA adapter for **gpt-oss-120b**, trained with reinforcement learning on the
|
| 24 |
-
[GPU Mode TriMul](https://
|
|
|
|
| 25 |
|
| 26 |
-
Produced via **TTT-Discover** ([Yuksekgonul et al., 2026](https://arxiv.org/abs/2601.16175))
|
| 27 |
-
|
| 28 |
-
learning
|
|
|
|
|
|
|
| 29 |
|
| 30 |
---
|
| 31 |
|
| 32 |
## What is TTT-Discover?
|
| 33 |
|
| 34 |
-
|
| 35 |
-
|
| 36 |
-
|
| 37 |
-
|
| 38 |
-
The model receives a reward signal based on measured GPU runtime (`reward = 1500 / runtime_μs`)
|
| 39 |
-
and learns to write faster Triton kernels through trial and error — no human-written examples needed.
|
| 40 |
|
| 41 |
**Published results (H100, TriMul):**
|
| 42 |
|
| 43 |
-
| |
|
| 44 |
-
|---|---|
|
| 45 |
-
| Best Human | 1371 μs |
|
| 46 |
-
|
|
| 47 |
-
|
|
|
|
| 48 |
|
| 49 |
-
This checkpoint reached **~3638 μs** at step 14 (best reward 0.412)
|
| 50 |
-
Starting from
|
| 51 |
|
| 52 |
---
|
| 53 |
|
|
@@ -64,7 +66,7 @@ Starting from this checkpoint instead of scratch saves ~14 steps of cold-start e
|
|
| 64 |
| 25 | 0.281 | 0.156 | ~5340 μs |
|
| 65 |
| 30 | 0.280 | 0.210 | ~5360 μs |
|
| 66 |
|
| 67 |
-
> Steps 15–17 had zero reward due to
|
| 68 |
|
| 69 |
---
|
| 70 |
|
|
@@ -78,7 +80,7 @@ sampler_weights/
|
|
| 78 |
gpu_mode_trimul.ipynb # Google Colab notebook
|
| 79 |
```
|
| 80 |
|
| 81 |
-
|
| 82 |
`tinker://681a070d-2ef4-5b8c-a216-d4f22dca1efb:train:0/weights/000030`
|
| 83 |
|
| 84 |
---
|
|
@@ -87,7 +89,7 @@ The training state (optimizer + model state for resuming RL) is stored on Tinker
|
|
| 87 |
|
| 88 |
[](https://colab.research.google.com/github/Pran-Ker/gpu-mode-trimul/blob/main/gpu_mode_trimul.ipynb)
|
| 89 |
|
| 90 |
-
Open the notebook above to run TTT-Discover on
|
| 91 |
or plug in your own GPU kernel problem.
|
| 92 |
|
| 93 |
### What you need
|
|
@@ -100,14 +102,14 @@ or plug in your own GPU kernel problem.
|
|
| 100 |
|
| 101 |
> No local GPU required — training runs on Tinker's cluster; kernel evals run on Modal H100s.
|
| 102 |
|
| 103 |
-
###
|
| 104 |
|
| 105 |
```python
|
| 106 |
import asyncio, os
|
| 107 |
from ttt_discover.rl.train import Config, main as rl_main
|
| 108 |
from ttt_discover.tinker_utils import misc_utils
|
| 109 |
from ttt_discover.tinker_utils.dataset_builder import DatasetConfig, get_single_problem_dataset_builder
|
| 110 |
-
from examples.gpu_mode.env import GpuModeEnv
|
| 111 |
|
| 112 |
CHECKPOINT = "tinker://681a070d-2ef4-5b8c-a216-d4f22dca1efb:train:0/weights/000030"
|
| 113 |
EXPERIMENT = "my-trimul-run"
|
|
@@ -166,8 +168,8 @@ print(asyncio.run(ask("Write a fast Triton kernel for triangular matmul on H100.
|
|
| 166 |
**Learning to Discover at Test Time**
|
| 167 |
Mert Yuksekgonul\*, Daniel Koceja\*, Xinhao Li\*, Federico Bianchi\*, Jed McCaleb,
|
| 168 |
Xiaolong Wang, Jan Kautz, Yejin Choi, James Zou†, Carlos Guestrin†, Yu Sun
|
| 169 |
-
Stanford · NVIDIA · Astera Institute · UC San Diego · Together AI
|
| 170 |
-
[arXiv:2601.16175](https://arxiv.org/abs/2601.16175) · [Project page](https://test-time-training.github.io/discover/)
|
| 171 |
|
| 172 |
```bibtex
|
| 173 |
@article{ttt-discover2026,
|
|
@@ -186,4 +188,4 @@ Stanford · NVIDIA · Astera Institute · UC San Diego · Together AI
|
|
| 186 |
## Acknowledgments
|
| 187 |
|
| 188 |
- **[GPU Mode](https://github.com/gpu-mode)** — community for GPU kernel optimization and the TriMul competition
|
| 189 |
-
- **[Tinker](https://tinker.thinkingmachines.dev)** — LLM training and RL infrastructure
|
|
|
|
| 15 |
<p align="center">
|
| 16 |
<a href="https://arxiv.org/abs/2601.16175"><img src="https://img.shields.io/badge/arXiv-2601.16175-b31b1b.svg" alt="arXiv"></a>
|
| 17 |
<a href="https://test-time-training.github.io/discover/"><img src="https://img.shields.io/badge/Project-Page-blue" alt="Project Page"></a>
|
| 18 |
+
<a href="https://github.com/test-time-training/discover"><img src="https://img.shields.io/badge/GitHub-discover-black?logo=github" alt="GitHub"></a>
|
| 19 |
<a href="https://colab.research.google.com/github/Pran-Ker/gpu-mode-trimul/blob/main/gpu_mode_trimul.ipynb"><img src="https://colab.research.google.com/assets/colab-badge.svg" alt="Open In Colab"></a>
|
| 20 |
</p>
|
| 21 |
</p>
|
| 22 |
|
| 23 |
LoRA adapter for **gpt-oss-120b**, trained with reinforcement learning on the
|
| 24 |
+
[GPU Mode TriMul](https://www.gpumode.com/v2/leaderboard/496?tab=rankings) competition —
|
| 25 |
+
triangular matrix multiplication on H100.
|
| 26 |
|
| 27 |
+
Produced via **TTT-Discover** ([Yuksekgonul et al., 2026](https://arxiv.org/abs/2601.16175)):
|
| 28 |
+
|
| 29 |
+
> *"We perform reinforcement learning at test time, allowing the LLM to continue training
|
| 30 |
+
> with experience specific to the problem at hand … Our test-time training runs are performed
|
| 31 |
+
> using Tinker, an API by Thinking Machines, with a cost of only a few hundred dollars per problem."*
|
| 32 |
|
| 33 |
---
|
| 34 |
|
| 35 |
## What is TTT-Discover?
|
| 36 |
|
| 37 |
+
Instead of prompting a frozen model (like AlphaEvolve), TTT-Discover **keeps training** on your
|
| 38 |
+
specific problem at test time. The model earns a reward signal from real execution feedback
|
| 39 |
+
(`reward = 1500 / runtime_μs`) and learns to write faster Triton kernels through trial and error —
|
| 40 |
+
no human-written examples needed.
|
|
|
|
|
|
|
| 41 |
|
| 42 |
**Published results (H100, TriMul):**
|
| 43 |
|
| 44 |
+
| | A100 ↓ | H100 ↓ | B200 ↓ | MI300x ↓ |
|
| 45 |
+
|---|---|---|---|---|
|
| 46 |
+
| Best Human | 4531 μs | 1371 μs | 1005 μs | 2462 μs |
|
| 47 |
+
| **TTT-Discover** | **2198 μs** | **1161 μs** | **905 μs** | **1596 μs** |
|
| 48 |
+
|
| 49 |
+
[Verify on GPU Mode leaderboard →](https://www.gpumode.com/v2/leaderboard/496?tab=rankings)
|
| 50 |
|
| 51 |
+
This checkpoint reached **~3638 μs** at step 14 (best reward 0.412).
|
| 52 |
+
Starting from it instead of scratch saves ~14 steps of cold-start exploration.
|
| 53 |
|
| 54 |
---
|
| 55 |
|
|
|
|
| 66 |
| 25 | 0.281 | 0.156 | ~5340 μs |
|
| 67 |
| 30 | 0.280 | 0.210 | ~5360 μs |
|
| 68 |
|
| 69 |
+
> Steps 15–17 had zero reward due to an eval cluster billing limit — not a training failure.
|
| 70 |
|
| 71 |
---
|
| 72 |
|
|
|
|
| 80 |
gpu_mode_trimul.ipynb # Google Colab notebook
|
| 81 |
```
|
| 82 |
|
| 83 |
+
Training state (for resuming RL with fresh optimizer):
|
| 84 |
`tinker://681a070d-2ef4-5b8c-a216-d4f22dca1efb:train:0/weights/000030`
|
| 85 |
|
| 86 |
---
|
|
|
|
| 89 |
|
| 90 |
[](https://colab.research.google.com/github/Pran-Ker/gpu-mode-trimul/blob/main/gpu_mode_trimul.ipynb)
|
| 91 |
|
| 92 |
+
Open the notebook above to run TTT-Discover on TriMul, fork from this checkpoint,
|
| 93 |
or plug in your own GPU kernel problem.
|
| 94 |
|
| 95 |
### What you need
|
|
|
|
| 102 |
|
| 103 |
> No local GPU required — training runs on Tinker's cluster; kernel evals run on Modal H100s.
|
| 104 |
|
| 105 |
+
### Warm-start RL from this checkpoint
|
| 106 |
|
| 107 |
```python
|
| 108 |
import asyncio, os
|
| 109 |
from ttt_discover.rl.train import Config, main as rl_main
|
| 110 |
from ttt_discover.tinker_utils import misc_utils
|
| 111 |
from ttt_discover.tinker_utils.dataset_builder import DatasetConfig, get_single_problem_dataset_builder
|
| 112 |
+
from examples.gpu_mode.env import GpuModeEnv # from github.com/test-time-training/discover
|
| 113 |
|
| 114 |
CHECKPOINT = "tinker://681a070d-2ef4-5b8c-a216-d4f22dca1efb:train:0/weights/000030"
|
| 115 |
EXPERIMENT = "my-trimul-run"
|
|
|
|
| 168 |
**Learning to Discover at Test Time**
|
| 169 |
Mert Yuksekgonul\*, Daniel Koceja\*, Xinhao Li\*, Federico Bianchi\*, Jed McCaleb,
|
| 170 |
Xiaolong Wang, Jan Kautz, Yejin Choi, James Zou†, Carlos Guestrin†, Yu Sun
|
| 171 |
+
*Stanford · NVIDIA · Astera Institute · UC San Diego · Together AI*
|
| 172 |
+
[arXiv:2601.16175](https://arxiv.org/abs/2601.16175) · [Project page](https://test-time-training.github.io/discover/) · [PDF](https://test-time-training.github.io/discover.pdf)
|
| 173 |
|
| 174 |
```bibtex
|
| 175 |
@article{ttt-discover2026,
|
|
|
|
| 188 |
## Acknowledgments
|
| 189 |
|
| 190 |
- **[GPU Mode](https://github.com/gpu-mode)** — community for GPU kernel optimization and the TriMul competition
|
| 191 |
+
- **[Tinker](https://tinker.thinkingmachines.dev)** — LLM training and RL infrastructure by Thinking Machines
|