README.md

---
language:
- en
- zh
- fr
- es
- pt
- de
- it
- ru
- ja
- ko
- ar
- vi
- th
- nl
- pl
license: apache-2.0
library_name: mlx
base_model: google/gemma-4-26b-a4b-it
tags:
- 4-bit
- 4bit
- apple-silicon
- chat
- conversational
- edge-ai
- function-calling
- gemma
- gemma-4
- gemma4
- instruct
- local-llm
- m1
- m2
- m3
- m4
- mac
- mac-mini
- mac-studio
- macbook-air
- macbook-pro
- macos
- metal
- mixture-of-experts
- mlx
- mlx-lm
- mmlu-verified
- moe
- multilingual
- no-cloud
- offline
- on-device
- outlier
- outlier-app
- private
- private-ai
- quantized
- reasoning
- safetensors
- text-generation
- thinking
- tool-use
pipeline_tag: text-generation
model-index:
- name: Outlier-Ai/Outlier-Quick-26B-MLX-4bit
  results:
  - task:
      type: text-generation
      name: Text Generation
    dataset:
      name: MMLU (stratified n=300)
      type: cais/mmlu
      config: all
      split: test
    metrics:
    - type: acc
      name: accuracy
      value: 0.7933
      verified: false
  - task:
      type: text-generation
      name: Text Generation
    dataset:
      name: HumanEval
      type: openai_humaneval
      split: test
    metrics:
    - type: pass@1
      name: pass@1
      value: 0.128
      verified: false
---
> **Part of the [Outlier](https://outlier.host/?utm_source=hf&utm_medium=modelcard&utm_campaign=outlier_quick_26b_mlx_4bit) shipping lineup.** Outlier is a free macOS app that runs this model locally, with one click. Apple Silicon only.

# Outlier Quick 26B-A4B (MLX 4-bit)

Sparse MoE tier (26B params, ~4B active per token). Sits between Lite and Core in latency, with stronger thinking-mode reasoning. Optimized for general chat and reasoning, not for code generation.

## Try it in Outlier

The simplest way to use this model is through the Outlier app — open the tier picker, select **Outlier Quick**, click download, and chat. No setup, no Python, no MLX install, no token quotas.

➡ **[Download Outlier — outlier.host](https://outlier.host/?utm_source=hf&utm_medium=modelcard&utm_campaign=outlier_quick_26b_mlx_4bit)**

A screenshot of the tier picker is at [outlier.host/screenshots/tier-picker.png](https://outlier.host/screenshots/tier-picker.png?utm_source=hf&utm_medium=modelcard&utm_campaign=outlier_quick_26b_mlx_4bit).

## Load this directly (power users)

If you want the raw MLX-4bit weights without the app:

```bash
pip install mlx-lm
python -m mlx_lm.generate \
  --model Outlier-Ai/Outlier-Quick-26B-MLX-4bit \
  --prompt "Write a quicksort in Python." \
  --max-tokens 512
```

```python
from mlx_lm import load, generate
model, tokenizer = load("Outlier-Ai/Outlier-Quick-26B-MLX-4bit")
print(generate(model, tokenizer, prompt="Hello", max_tokens=256))
```

## Verified benchmarks

For σ-qualified MMLU, HumanEval, and Mac inference-speed numbers — with full provenance (source file, command, n, stderr, date) — see **[outlier.host/benchmarks](https://outlier.host/benchmarks?utm_source=hf&utm_medium=modelcard&utm_campaign=outlier_quick_26b_mlx_4bit)**.

## Other Outlier shipping tiers

- [Outlier Nano 4B (entry tier, ~3 GB)](https://huggingface.co/Outlier-Ai/Outlier-Nano-4B-MLX-4bit)
- [Outlier Lite 9B (balanced, ~6 GB)](https://huggingface.co/Outlier-Ai/Outlier-Lite-9B-MLX-4bit)
- [Outlier Core 27B (default, ~16 GB)](https://huggingface.co/Outlier-Ai/Outlier-Core-27B-MLX-4bit)
- [Outlier Code 27B (code-tuned, ~16 GB)](https://huggingface.co/Outlier-Ai/Outlier-Code-27B-MLX-4bit)
- [Outlier Vision 35B-A3B (multimodal, ~20 GB)](https://huggingface.co/Outlier-Ai/Outlier-Vision-35B-A3B-MLX-4bit)

## License

Apache 2.0 (inherits from upstream base model). Conversion artifact only — the underlying weights are governed by the base model's license.