---
license: gemma
pipeline_tag: text-generation
library_name: mlx
base_model: google/gemma-3-27b-it
base_model_relation: quantized
quantized_by: Outlier-Ai
tags:
- 4-bit
- 4bit
- apple-silicon
- chat
- conversational
- edge-ai
- function-calling
- gemma
- gemma-3
- gemma3
- google
- google-gemma
- instruct
- local-llm
- m1
- m2
- m3
- m4
- mac
- mac-mini
- mac-studio
- macbook-air
- macbook-pro
- macos
- metal
- mlx
- mlx-community
- mlx-lm
- no-cloud
- offline
- on-device
- outlier
- outlier-app
- private
- private-ai
- quantized
- safetensors
- text-generation
- tool-use
language:
- en
- de
- fr
- es
- it
- pt
- nl
- pl
- ro
- cs
- hu
- sv
- da
- fi
widget:
- example_title: General knowledge
  messages:
  - role: user
    content: Explain mixture-of-experts models in plain language.
- example_title: Privacy rationale
  messages:
  - role: user
    content: Three practical reasons to run an LLM locally instead of in the cloud?
- example_title: Summarize
  messages:
  - role: user
    content: Summarize the difference between 4-bit and 8-bit quantization in two
      short paragraphs.
---
> **Run this on your Mac with [Outlier](https://outlier.host/?utm_source=hf&utm_medium=modelcard&utm_campaign=gemma_3_27b_it_mlx_4bit)** — a free macOS app for local MLX inference.

# gemma-3-27b-it (MLX 4-bit)

MLX 4-bit conversion of [`google/gemma-3-27b-it`](https://huggingface.co/google/gemma-3-27b-it). License and base-model fields inherit from the original — see YAML frontmatter above.

## Load with mlx-lm

```bash
pip install mlx-lm
python -m mlx_lm.generate --model Outlier-Ai/gemma-3-27b-it-MLX-4bit --prompt "Hello" --max-tokens 256
```

## What is Outlier?

A free macOS app that runs MLX models locally — no cloud, no API keys, no usage caps.

➡ **[outlier.host](https://outlier.host/?utm_source=hf&utm_medium=modelcard&utm_campaign=gemma_3_27b_it_mlx_4bit)**

## Other Outlier conversions

- [gemma-3-4b-it (MLX 4-bit) — MLX 4-bit conversion (87 downloads)](https://huggingface.co/Outlier-Ai/gemma-3-4b-it-MLX-4bit)
- [DeepSeek-R1-Distill-Qwen-7B (MLX 4-bit) — MLX 4-bit conversion (1,932 downloads)](https://huggingface.co/Outlier-Ai/DeepSeek-R1-Distill-Qwen-7B-MLX-4bit)
- [Qwen3-Coder-30B-A3B-Instruct (MLX 4-bit) — MLX 4-bit conversion (1,598 downloads)](https://huggingface.co/Outlier-Ai/Qwen3-Coder-30B-A3B-Instruct-MLX-4bit)
- [Outlier-Core-27B (MLX 4-bit) — MLX 4-bit conversion (55 downloads)](https://huggingface.co/Outlier-Ai/Outlier-Core-27B-MLX-4bit)
- [Outlier-Nano-4B (MLX 4-bit) — MLX 4-bit conversion (67 downloads)](https://huggingface.co/Outlier-Ai/Outlier-Nano-4B-MLX-4bit)

## License

Inherits from upstream (`gemma`). See base model card.