gemma-4 — Vector Quantized (MLX) - a TheDrainFlorist Collection

TheDrainFlorist 's Collections

Qwen3.8-Flash-Next — Vector Quantized (MLX)

Qwen3.8-27B — Vector Quantized (MLX)

gemma-4 — Vector Quantized (MLX)

Qwen3.6-35B-A3B — Vector Quantized (MLX)

Qwen3.5-397B-A17B — Vector Quantized (MLX)

gemma-4 — Vector Quantized (MLX)

updated 3 days ago

Vector-quantized gemma-4 for MLX: 26B indistinguishable from bf16 at 18.7G; e4b with a better embedding table at 7.4G.

TheDrainFlorist/gemma-4-26b-a4b-it-VQ-6.2bpw

Image-Text-to-Text • 6B • Updated 5 days ago • 187
TheDrainFlorist/gemma-4-e4b-it-VQ-PLE

Image-Text-to-Text • 2B • Updated 6 days ago • 69