README.md

metadata

license: apache-2.0
pipeline_tag: text-generation
library_name: mlx
base_model: Qwen/Qwen3-32B
base_model_relation: quantized
quantized_by: Outlier-Ai
tags:
  - 4-bit
  - 4bit
  - apple-silicon
  - chat
  - conversational
  - edge-ai
  - function-calling
  - instruct
  - local-llm
  - m1
  - m2
  - m3
  - m4
  - mac
  - mac-mini
  - mac-studio
  - macbook-air
  - macbook-pro
  - macos
  - metal
  - mlx
  - mlx-community
  - mlx-lm
  - no-cloud
  - offline
  - on-device
  - outlier
  - outlier-app
  - private
  - private-ai
  - quantized
  - qwen
  - qwen3
  - reasoning
  - safetensors
  - text-generation
  - thinking
  - tool-use
language:
  - en
  - zh
  - fr
  - es
  - pt
  - de
  - it
  - ru
  - ja
  - ko
  - ar
  - vi
  - th
  - nl
  - pl
widget:
  - example_title: General knowledge
    messages:
      - role: user
        content: Explain mixture-of-experts models in plain language.
  - example_title: Privacy rationale
    messages:
      - role: user
        content: Three practical reasons to run an LLM locally instead of in the cloud?
  - example_title: Summarize
    messages:
      - role: user
        content: >-
          Summarize the difference between 4-bit and 8-bit quantization in two
          short paragraphs.

Run this on your Mac with Outlier — a free macOS app for local MLX inference.

Qwen3-32B (MLX 4-bit)

MLX 4-bit conversion of Qwen/Qwen3-32B. License and base-model fields inherit from the original — see YAML frontmatter above.

Load with mlx-lm

pip install mlx-lm
python -m mlx_lm.generate --model Outlier-Ai/Qwen3-32B-MLX-4bit --prompt "Hello" --max-tokens 256

What is Outlier?

A free macOS app that runs MLX models locally — no cloud, no API keys, no usage caps.

➡ outlier.host

Other Outlier conversions

• Qwen3-Coder-30B-A3B-Instruct (MLX 4-bit) — MLX 4-bit conversion (1,598 downloads)
• Qwen3-14B (MLX 4-bit) — MLX 4-bit conversion (466 downloads)
• Qwen3-8B (MLX 4-bit) — MLX 4-bit conversion (107 downloads)
• Outlier-Core-27B (MLX 4-bit) — MLX 4-bit conversion (55 downloads)
• Outlier-Nano-4B (MLX 4-bit) — MLX 4-bit conversion (67 downloads)

License

Inherits from upstream (apache-2.0). See base model card.