Mixture-of-experts models: many experts per layer, only a few active per token.
🏗️ Building on HF
nk bass
nkthebass
AI & ML interests
None yet
Recent Activity
new activity about 10 hours ago
AxiomicLabs/Open_SLM_Leaderboard:Add TinyBrainBot-360M-A75M-v4.1-MoE-Base and TinyBrainBot-350M-V3-Base updated a collection about 10 hours ago
TinyBrainBot v4.1 updated a model about 10 hours ago
nkthebass/tinybrainbot-360m-a75m-v4.1-moe-base