Hugging Face's logo
Banaxi's picture
🔄 BananaMind 2 Pro is getting trained

Banaxi PRO

Banaxi-Tech
127 11 121
Shawnuc's profile picture robotBLZ's profile picture AMAImedia's profile picture
·

AI & ML interests

SLMs, training from scratch, LoRA, TTS, Ternary models. AI Interpretability. BCI. Contact at banaxitech@gmail.com

Recent Activity

new activity about 2 hours ago
BananaMind/BananaMind-2-Micro:i like gguf
repliedto their post about 2 hours ago
We're excited to release BananaMind 2 Micro, our smallest model yet. It fits a compact architecture in only 2.9M parameters achieving the highest parameter efficiency on BananaMind Base Bench against comparable models. It achieves comparable performance to GPT S2 5M and GPT S 5M at almost half the size while beating CMA 1M Mini. BananaMind 2 Micro achieved the #1 spot on the Open SLM Leaderboard for the sub 3M category (not added yet but it achieves #1) For the training we used Muon + the XSA Refresh Gate with a 5e-2 lr for Muon and 4e-3 for the 1D weights. Its score on our efficiency measure is 0.326 getting the first place with Syn 2.6M on the second place scoring 0.291 and GPT S 5M at 0.235* Check it out at https://huggingface.co/BananaMind/BananaMind-2-Micro and follow us at: @vovaRL @DedeProGames @Banaxi-Tech https://huggingface.co/BananaMind Our new releases aren't stopping 🚀 August 13-14 BananaMind 2 Pro
repliedto their post about 2 hours ago
We're excited to release BananaMind 2 Micro, our smallest model yet. It fits a compact architecture in only 2.9M parameters achieving the highest parameter efficiency on BananaMind Base Bench against comparable models. It achieves comparable performance to GPT S2 5M and GPT S 5M at almost half the size while beating CMA 1M Mini. BananaMind 2 Micro achieved the #1 spot on the Open SLM Leaderboard for the sub 3M category (not added yet but it achieves #1) For the training we used Muon + the XSA Refresh Gate with a 5e-2 lr for Muon and 4e-3 for the 1D weights. Its score on our efficiency measure is 0.326 getting the first place with Syn 2.6M on the second place scoring 0.291 and GPT S 5M at 0.235* Check it out at https://huggingface.co/BananaMind/BananaMind-2-Micro and follow us at: @vovaRL @DedeProGames @Banaxi-Tech https://huggingface.co/BananaMind Our new releases aren't stopping 🚀 August 13-14 BananaMind 2 Pro
View all activity

Organizations

ML intern explorers's profile picture Unsloth Jobs Explorers's profile picture BananaMind AI's profile picture BananaMind Model Previewers's profile picture North ML Previews's profile picture BananaMind Tetris Challenge's profile picture