MoE models recomended for 8GB of VRAM + MoE offloading
Patryk
WhiskyAKM
AI & ML interests
LLMs for low end hardware
Recent Activity
updated a model 5 days ago
WhiskyAKM/MiniCPM5-2B-NVFP4-GGUF published a model 5 days ago
WhiskyAKM/MiniCPM5-2B-NVFP4-GGUF updated a collection 5 days ago
Low Vram 2026.09Organizations
