README.md

metadata

license: gemma
pipeline_tag: text-generation
library_name: mlx
base_model: google/gemma-3-27b-it
base_model_relation: quantized
quantized_by: Outlier-Ai
tags:
  - 4-bit
  - 4bit
  - apple-silicon
  - chat
  - conversational
  - edge-ai
  - function-calling
  - gemma
  - gemma-3
  - gemma3
  - google
  - google-gemma
  - instruct
  - local-llm
  - m1
  - m2
  - m3
  - m4
  - mac
  - mac-mini
  - mac-studio
  - macbook-air
  - macbook-pro
  - macos
  - metal
  - mlx
  - mlx-community
  - mlx-lm
  - no-cloud
  - offline
  - on-device
  - outlier
  - outlier-app
  - private
  - private-ai
  - quantized
  - safetensors
  - text-generation
  - tool-use
language:
  - en
  - de
  - fr
  - es
  - it
  - pt
  - nl
  - pl
  - ro
  - cs
  - hu
  - sv
  - da
  - fi
widget:
  - example_title: General knowledge
    messages:
      - role: user
        content: Explain mixture-of-experts models in plain language.
  - example_title: Privacy rationale
    messages:
      - role: user
        content: Three practical reasons to run an LLM locally instead of in the cloud?
  - example_title: Summarize
    messages:
      - role: user
        content: >-
          Summarize the difference between 4-bit and 8-bit quantization in two
          short paragraphs.

Run this on your Mac with Outlier — a free macOS app for local MLX inference.

gemma-3-27b-it (MLX 4-bit)

MLX 4-bit conversion of google/gemma-3-27b-it. License and base-model fields inherit from the original — see YAML frontmatter above.

Load with mlx-lm

pip install mlx-lm
python -m mlx_lm.generate --model Outlier-Ai/gemma-3-27b-it-MLX-4bit --prompt "Hello" --max-tokens 256

What is Outlier?

A free macOS app that runs MLX models locally — no cloud, no API keys, no usage caps.

➡ outlier.host

Other Outlier conversions

• gemma-3-4b-it (MLX 4-bit) — MLX 4-bit conversion (87 downloads)
• DeepSeek-R1-Distill-Qwen-7B (MLX 4-bit) — MLX 4-bit conversion (1,932 downloads)
• Qwen3-Coder-30B-A3B-Instruct (MLX 4-bit) — MLX 4-bit conversion (1,598 downloads)
• Outlier-Core-27B (MLX 4-bit) — MLX 4-bit conversion (55 downloads)
• Outlier-Nano-4B (MLX 4-bit) — MLX 4-bit conversion (67 downloads)

License

Inherits from upstream (gemma). See base model card.