Outlier-Ai/gemma-3-4b-it-MLX-4bit

Run this on your Mac with Outlier — a free macOS app for local MLX inference.

gemma-3-4b-it (MLX 4-bit)

MLX 4-bit conversion of google/gemma-3-4b-it. License and base-model fields inherit from the original — see YAML frontmatter above.

Load with mlx-lm

pip install mlx-lm
python -m mlx_lm.generate --model Outlier-Ai/gemma-3-4b-it-MLX-4bit --prompt "Hello" --max-tokens 256

What is Outlier?

A free macOS app that runs MLX models locally — no cloud, no API keys, no usage caps.

➡ outlier.host

Other Outlier conversions

• gemma-3-27b-it (MLX 4-bit) — MLX 4-bit conversion (175 downloads)
• DeepSeek-R1-Distill-Qwen-7B (MLX 4-bit) — MLX 4-bit conversion (1,932 downloads)
• Qwen3-Coder-30B-A3B-Instruct (MLX 4-bit) — MLX 4-bit conversion (1,598 downloads)
• Outlier-Core-27B (MLX 4-bit) — MLX 4-bit conversion (55 downloads)
• Outlier-Nano-4B (MLX 4-bit) — MLX 4-bit conversion (67 downloads)

License

Inherits from upstream (gemma). See base model card.