Variable-width MoE expert pruning (Winnow, formerly GLEAN): pruned OLMoE, Qwen3.6-35B-A3B and poolside Laguna-S-2.1 checkpoints, unhealed and healed.
Henry PRO
hbfreed
·
AI & ML interests
None yet
Recent Activity
updated a model 3 days ago
hbfreed/Laguna-S-2.1-winnow-keep75 published a model 3 days ago
hbfreed/winnow-olmoe-math-keep25-onpolicy published a model 3 days ago
hbfreed/winnow-olmoe-general-keep25-onpolicy