Hugging Face's logo
Logicvex AI's picture
🔄 In a Training Loop

Logicvex AI

MultivexAI
22 3 48
appvoid's profile picture jaithree's profile picture PhysiQuanty's profile picture
·

AI & ML interests

A machine learning collective focused on AGI. We believe Tiny Language Models are the future, so we build and share them—along with datasets—to support community progress. Not a company.

Recent Activity

repliedto Banaxi-Tech's post about 15 hours ago
We're announcing BananaMind 2 Micro, our smallest model in the BananaMind 2 model family. This model is not released yet, training has not started yet. It uses only 2.9M parameters, while being overtrained on 75B tokens to get the maximum intelligence per parameter. The key changes are: No more AdamW, the model will use the Muon optimizer offering up to 2x faster convergence and higher lr. LR goes to 2.2e-2. We're adding the XSA refresh gate from the TX4 architecture into our own. Training will start on August 3, release date is estimated to be August 4-6. On August 3 we will also release our Public Preview of BananaMind 2 Pro. Follow us to know when our models release https://huggingface.co/BananaMind @Banaxi-Tech
repliedto Banaxi-Tech's post about 16 hours ago
We're announcing BananaMind 2 Micro, our smallest model in the BananaMind 2 model family. This model is not released yet, training has not started yet. It uses only 2.9M parameters, while being overtrained on 75B tokens to get the maximum intelligence per parameter. The key changes are: No more AdamW, the model will use the Muon optimizer offering up to 2x faster convergence and higher lr. LR goes to 2.2e-2. We're adding the XSA refresh gate from the TX4 architecture into our own. Training will start on August 3, release date is estimated to be August 4-6. On August 3 we will also release our Public Preview of BananaMind 2 Pro. Follow us to know when our models release https://huggingface.co/BananaMind @Banaxi-Tech
repliedto Banaxi-Tech's post about 17 hours ago
We're announcing BananaMind 2 Micro, our smallest model in the BananaMind 2 model family. This model is not released yet, training has not started yet. It uses only 2.9M parameters, while being overtrained on 75B tokens to get the maximum intelligence per parameter. The key changes are: No more AdamW, the model will use the Muon optimizer offering up to 2x faster convergence and higher lr. LR goes to 2.2e-2. We're adding the XSA refresh gate from the TX4 architecture into our own. Training will start on August 3, release date is estimated to be August 4-6. On August 3 we will also release our Public Preview of BananaMind 2 Pro. Follow us to know when our models release https://huggingface.co/BananaMind @Banaxi-Tech
View all activity

Organizations

AtomixLabs's profile picture Moonware Labs's profile picture