ur-dad-matt commited on
Commit
b77f7e9
Β·
verified Β·
1 Parent(s): 155f709

docs(card): SEO + cross-link refresh (HF-DISCOVERABILITY-001)

Browse files
Files changed (1) hide show
  1. README.md +16 -60
README.md CHANGED
@@ -77,77 +77,33 @@ widget:
77
  content: Summarize the difference between 4-bit and 8-bit quantization in two
78
  short paragraphs.
79
  ---
 
80
 
81
- # Qwen3-32B β€” MLX 4-bit
82
 
83
- 4-bit MLX conversion of [Qwen3-32B](https://huggingface.co/Qwen/Qwen3-32B) for Apple Silicon. Runs natively on
84
- M1, M2, M3, and M4 Macs via `mlx_lm`. Faithful port of the upstream weights β€” no
85
- fine-tuning, no merge.
86
 
87
- ## Quick facts
88
-
89
- - **Upstream base:** [Qwen3-32B](https://huggingface.co/Qwen/Qwen3-32B)
90
- - **Format:** MLX 4-bit (`mlx_lm.convert --q-bits 4 --q-group-size 64`)
91
- - **License:** `apache-2.0`
92
- - **Use case:** chat
93
- - **Runtime:** mlx-lm, LM Studio, Jan, Outlier desktop app
94
- - **Publisher:** Outlier-Ai (solo, Mac-native AI platform)
95
-
96
- ## Quickstart (mlx-lm)
97
 
98
  ```bash
99
- pip install -U mlx-lm
100
- python -m mlx_lm.generate \
101
- --model Outlier-Ai/Qwen3-32B-MLX-4bit \
102
- --prompt "Write a haiku about compilers." \
103
- --max-tokens 256
104
  ```
105
 
106
- ## Quickstart (LM Studio)
107
-
108
- Search for `Outlier-Ai/Qwen3-32B-MLX-4bit`, then Load and chat.
109
-
110
- ## Quickstart (Outlier desktop app)
111
-
112
- One-click install from [outlier.host](https://outlier.host). Listed in the library
113
- picker under `chat`.
114
-
115
- ## Why this repo exists
116
-
117
- This is a canonically-named twin of [Outlier-Ai/Outlier-Qwen3-32B-MLX-4bit](https://huggingface.co/Outlier-Ai/Outlier-Qwen3-32B-MLX-4bit).
118
- Same weights, same quant, different name. The branded repo carries the Outlier
119
- identity; this one carries the upstream identity so it's findable via searches
120
- like "qwen3-32b 4bit mlx". Use whichever path you came across β€” both
121
- point to the same files.
122
-
123
- ## Provenance
124
-
125
- - Converted via `mlx_lm.convert --q-bits 4 --q-group-size 64`
126
- - Source: [Qwen3-32B](https://huggingface.co/Qwen/Qwen3-32B)
127
- - Date produced: 2026-04-19 (Day 19)
128
- - Conversion factory: Outlier MEGA-INFINITE phase3
129
-
130
- ## Related
131
-
132
- - **Branded twin (same weights):** [Outlier-Ai/Outlier-Qwen3-32B-MLX-4bit](https://huggingface.co/Outlier-Ai/Outlier-Qwen3-32B-MLX-4bit)
133
- - **Outlier org on HuggingFace:** [Outlier-Ai](https://huggingface.co/Outlier-Ai)
134
- - **Desktop app:** [outlier.host](https://outlier.host)
135
- - **Founders lifetime ($200, 500-seat cap):** [buy.polar.sh](https://buy.polar.sh/polar_cl_mJfYZsEpEMDcYrgxzvTdnahSeSQNq1UYLqV0l08CUhW)
136
- - **Discord:** [discord.gg/Hapennmdn9](https://discord.gg/Hapennmdn9)
137
 
138
- ## Collections
139
 
140
- - **Outlier for Apple Silicon (MLX):** [huggingface.co/collections/Outlier-Ai/outlier-consumer-edition-69e2fb4a0df119ea1747275e](https://huggingface.co/collections/Outlier-Ai/outlier-consumer-edition-69e2fb4a0df119ea1747275e)
141
- - **Outlier Research MoE:** [huggingface.co/collections/Outlier-Ai/outlier-research-69e2fb3a71984614b3c7a279](https://huggingface.co/collections/Outlier-Ai/outlier-research-69e2fb3a71984614b3c7a279)
142
- - **Outlier Server V3.2:** [huggingface.co/collections/Outlier-Ai/outlier-server-v32-69e2fb4b71984614b3c7a4a3](https://huggingface.co/collections/Outlier-Ai/outlier-server-v32-69e2fb4b71984614b3c7a4a3)
143
 
144
- ## Attribution
145
 
146
- Base model by the upstream author (see [Qwen3-32B](https://huggingface.co/Qwen/Qwen3-32B)). Outlier contributes
147
- the MLX 4-bit conversion and desktop-app packaging. Capability credit for the base
148
- belongs entirely to upstream.
 
 
149
 
150
  ## License
151
 
152
- Redistributed under the upstream license: `apache-2.0`. Respect the terms of
153
- [Qwen3-32B](https://huggingface.co/Qwen/Qwen3-32B) when using this conversion.
 
77
  content: Summarize the difference between 4-bit and 8-bit quantization in two
78
  short paragraphs.
79
  ---
80
+ > **Run this on your Mac with [Outlier](https://outlier.host/?utm_source=hf&utm_medium=modelcard&utm_campaign=qwen3_32b_mlx_4bit)** β€” a free macOS app for local MLX inference.
81
 
82
+ # Qwen3-32B (MLX 4-bit)
83
 
84
+ MLX 4-bit conversion of [`Qwen/Qwen3-32B`](https://huggingface.co/Qwen/Qwen3-32B). License and base-model fields inherit from the original β€” see YAML frontmatter above.
 
 
85
 
86
+ ## Load with mlx-lm
 
 
 
 
 
 
 
 
 
87
 
88
  ```bash
89
+ pip install mlx-lm
90
+ python -m mlx_lm.generate --model Outlier-Ai/Qwen3-32B-MLX-4bit --prompt "Hello" --max-tokens 256
 
 
 
91
  ```
92
 
93
+ ## What is Outlier?
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
94
 
95
+ A free macOS app that runs MLX models locally β€” no cloud, no API keys, no usage caps.
96
 
97
+ ➑ **[outlier.host](https://outlier.host/?utm_source=hf&utm_medium=modelcard&utm_campaign=qwen3_32b_mlx_4bit)**
 
 
98
 
99
+ ## Other Outlier conversions
100
 
101
+ - [Qwen3-Coder-30B-A3B-Instruct (MLX 4-bit) β€” MLX 4-bit conversion (1,598 downloads)](https://huggingface.co/Outlier-Ai/Qwen3-Coder-30B-A3B-Instruct-MLX-4bit)
102
+ - [Qwen3-14B (MLX 4-bit) β€” MLX 4-bit conversion (466 downloads)](https://huggingface.co/Outlier-Ai/Qwen3-14B-MLX-4bit)
103
+ - [Qwen3-8B (MLX 4-bit) β€” MLX 4-bit conversion (107 downloads)](https://huggingface.co/Outlier-Ai/Qwen3-8B-MLX-4bit)
104
+ - [Outlier-Core-27B (MLX 4-bit) β€” MLX 4-bit conversion (55 downloads)](https://huggingface.co/Outlier-Ai/Outlier-Core-27B-MLX-4bit)
105
+ - [Outlier-Nano-4B (MLX 4-bit) β€” MLX 4-bit conversion (67 downloads)](https://huggingface.co/Outlier-Ai/Outlier-Nano-4B-MLX-4bit)
106
 
107
  ## License
108
 
109
+ Inherits from upstream (`apache-2.0`). See base model card.