MoE models recomended for 8GB of VRAM + MoE offloading
Patryk
WhiskyAKM
AI & ML interests
LLMs for low end hardware
Recent Activity
updated a model 3 days ago
WhiskyAKM/MiniCPM5-2B-NVFP4-GGUF published a model 3 days ago
WhiskyAKM/MiniCPM5-2B-NVFP4-GGUF updated a collection 3 days ago
Low Vram 2026.09Organizations
models 23
WhiskyAKM/MiniCPM5-2B-GGUF
Text Generation • 3B • Updated • 663
WhiskyAKM/MiniCPM5-2B-NVFP4-GGUF
Text Generation • 3B • Updated • 390 • 1
WhiskyAKM/Nemotron-3.5-Lightning-30B-A3B-GGUF
Text Generation • 33B • Updated • 1.07k
WhiskyAKM/Nemotron-3.5-Lightning-30B-A3B-NVFP4-GGUF
Text Generation • 33B • Updated • 553
WhiskyAKM/Ling-3.0-flash-GGUF
Text Generation • 127B • Updated • 963 • 4
WhiskyAKM/Ling-3.0-Tiny-NVFP4-GGUF
Text Generation • 8B • Updated • 470
WhiskyAKM/Ling-3.0-Tiny-GGUF
Text Generation • 8B • Updated • 1.34k • 3
WhiskyAKM/Gemma-4-26B-A4B-it-qat-GGUF
Any-to-Any • 25B • Updated • 538
WhiskyAKM/Gemma-4-26B-A4B-it-qat-NVFP4-GGUF
Any-to-Any • 25B • Updated • 334
WhiskyAKM/Gemma-4-12B-it-qat-NVFP4-GGUF
Any-to-Any • 12B • Updated • 388 • 1
datasets 0
None public yet