useful-quants/InternVL3-5-8B-W4A16-INT4
Image-Text-to-Text • 3B • Updated • 12
Useful Quants
community
AI & ML interests
Practical quantized model repackagings for local inference, focused on fast, tested, hardware-friendly variants for real homelab workloads.
Recent Activity
View all activity
models 5
useful-quants/Mistral-NeMo-Minitron-8B-Instruct-W4A16
Text Generation • 8B • Updated • 154
useful-quants/InternVL3_5-4B-Instruct-W4A16-BF16Vision
Image-Text-to-Text • 5B • Updated • 12
useful-quants/Phi-4-mini-instruct-W4A16
Text Generation • 4B • Updated • 156
useful-quants/GLM-4.6V-Flash-W4A16-BF16Vision
Image-Text-to-Text • 10B • Updated • 26
datasets 0
None public yet