AI & ML interests

None defined yet.

Recent Activity

ucr-max 
posted an update about 2 hours ago
view post
Post
8
Published under Universal Computing Research: Atom2.7m, a 2.74M-parameter causal LM experiment with arithmetic-aware numeric representation.

It keeps regular BPE-style text continuation, while adding structure for numeric spans: digit ordering, place_ids, and role_ids.

Atom2.7m reaches 69.24% accuracy on ArithMark2.0.

The question behind the project is narrow: how much of small-model arithmetic performance depends on representation, rather than scale alone?

Model: UniversalComputingResearch/Atom2.7m
Article: https://huggingface.co/blog/ucr-max/atom2-7m-arithmetic-representation
Demo: UniversalComputingResearch/Atom2.7-Demo
  • 1 reply
·