-
CLIMB: CLustering-based Iterative Data Mixture Bootstrapping for Language Model Pre-training
Paper • 2504.13161 • Published • 98 -
Hebbian Learning based Orthogonal Projection for Continual Learning of Spiking Neural Networks
Paper • 2402.11984 • Published -
BlackGoose Rimer: Harnessing RWKV-7 as a Simple yet Superior Replacement for Transformers in Large-Scale Time Series Modeling
Paper • 2503.06121 • Published • 5 -
Timer: Transformers for Time Series Analysis at Scale
Paper • 2402.02368 • Published • 2
mattsta
mattsta
AI & ML interests
sequence-to-sequence, time-series models; novel tokenization schemes; high throughput low compute solutions
Recent Activity
updated a collection about 21 hours ago
stuff i never have time to read liked a model 3 days ago
amd/Instella-MoE-16B-A3B-Base liked a model 3 days ago
amd/Instella-MoE-16B-A3B-DPOOrganizations
