RASR-94M-base

RASR (Reinforced Amortized Symbolic Regression) is a transformer trained for symbolic regression. Given a numeric dataset (X, y), it samples candidate closed-form expressions, refines their constants numerically, and returns the Pareto front of fit against expression size, without any per-dataset training.

This is the pre-trained-only checkpoint, before reinforcement-learning post-training. It is the starting point of the post-trained variants and of your own post-training. For fitting data, use a post-trained variant such as RASR-94M-L.

Variants

Model Size penalty ฮป Description
RASR-94M-L 0.05 Default, best fit
RASR-94M-M 0.15 Smaller expressions, slightly lower fit
RASR-94M-S 0.5 Smallest expressions
RASR-94M-base n/a Pre-trained only, no post-training

Usage

Install the RASR code from github.com/automl/rasr. The weights are downloaded automatically on first use:

from src.rasr.inference.rasr import RASR

model = RASR(model_path="davidotte/RASR-94M-base")
model.fit(X, y)
print(model.get_expression())
y_pred = model.predict(X)

for c in model.pareto_front_:  # Candidates not beaten on both fit and size.
    print(c.complexity, c.r2, c.expression_string)

Uses a GPU if one is available. On a CPU, pass a smaller num_candidates (default 256) for faster fits. Inputs must be numeric without missing values, with at most 11 features.

Model details

  • Architecture: Encoder-decoder transformer with 94M parameters. The encoder alternates attention over rows and features, and the decoder generates expressions in prefix notation.
  • Operators: +, *, /, pow2โ€“pow5, pow1_2โ€“pow1_5, abs, inv, sin, cos, tanh, exp, log.
  • Pre-training: Supervised on ~62M fully synthetic datasets, with inputs drawn from the TabICLv2 prior, data-conditioned constants and heteroscedastic or structured noise.

Results

Benchmark RASR-94M-base
SRBench 2.0 black-box track (12 datasets) Mean improvability 10.0%, mean size 37.4 nodes, mean fitting time 762 s (post-training lowers these to 7.4%, 27.5 nodes and 133 s for RASR-94M-L)

See the paper for the full evaluation.

Citation

If you use RASR in your work, please cite:

@misc{otte2026improvingneuralsymbolic,
  title         = {Improving Neural Symbolic Regression with a Diverse Prior and Post-training Alignment},
  author        = {David Otte and J{\"o}rg K.H. Franke and Frank Hutter},
  year          = {2026},
  eprint        = {2610.17994},
  archivePrefix = {arXiv},
  primaryClass  = {cs.LG},
  url           = {https://arxiv.org/abs/2610.17994}
}
Downloads last month

-

Downloads are not tracked for this model. How to track
Safetensors
Model size
94.1M params
Tensor type
BF16
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Collection including davidotte/RASR-94M-base

Paper for davidotte/RASR-94M-base