ur-dad-matt commited on
Commit
86209f4
·
verified ·
1 Parent(s): 032c82d

docs(card): SEO + cross-link refresh (HF-DISCOVERABILITY-001)

Browse files
Files changed (1) hide show
  1. README.md +28 -52
README.md CHANGED
@@ -74,77 +74,53 @@ widget:
74
  content: A train leaves station A at 60 mph and another leaves station B, 180
75
  miles away, at 40 mph toward each other. When do they meet?
76
  ---
 
77
 
78
- # DeepSeek-R1-Distill-Qwen-32B MLX 4-bit
79
 
80
- 4-bit MLX conversion of [DeepSeek-R1-Distill-Qwen-32B](https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Qwen-32B) for Apple Silicon. Runs natively on
81
- M1, M2, M3, and M4 Macs via `mlx_lm`. Faithful port of the upstream weights — no
82
- fine-tuning, no merge.
83
 
84
- ## Quick facts
85
 
86
- - **Upstream base:** [DeepSeek-R1-Distill-Qwen-32B](https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Qwen-32B)
87
- - **Format:** MLX 4-bit (`mlx_lm.convert --q-bits 4 --q-group-size 64`)
88
- - **License:** `mit`
89
- - **Use case:** reasoning
90
- - **Runtime:** mlx-lm, LM Studio, Jan, Outlier desktop app
91
- - **Publisher:** Outlier-Ai (solo, Mac-native AI platform)
92
 
93
- ## Quickstart (mlx-lm)
94
 
95
  ```bash
96
- pip install -U mlx-lm
97
  python -m mlx_lm.generate \
98
  --model Outlier-Ai/DeepSeek-R1-Distill-Qwen-32B-MLX-4bit \
99
- --prompt "Write a haiku about compilers." \
100
  --max-tokens 256
101
  ```
102
 
103
- ## Quickstart (LM Studio)
104
 
105
- Search for `Outlier-Ai/DeepSeek-R1-Distill-Qwen-32B-MLX-4bit`, then Load and chat.
106
-
107
- ## Quickstart (Outlier desktop app)
108
-
109
- One-click install from [outlier.host](https://outlier.host). Listed in the library
110
- picker under `reasoning`.
111
-
112
- ## Why this repo exists
113
-
114
- This is a canonically-named twin of [Outlier-Ai/Outlier-R1-Distill-32B-MLX-4bit](https://huggingface.co/Outlier-Ai/Outlier-R1-Distill-32B-MLX-4bit).
115
- Same weights, same quant, different name. The branded repo carries the Outlier
116
- identity; this one carries the upstream identity so it's findable via searches
117
- like "deepseek-r1-distill-qwen-32b 4bit mlx". Use whichever path you came across — both
118
- point to the same files.
119
-
120
- ## Provenance
121
-
122
- - Converted via `mlx_lm.convert --q-bits 4 --q-group-size 64`
123
- - Source: [DeepSeek-R1-Distill-Qwen-32B](https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Qwen-32B)
124
- - Date produced: 2026-04-19 (Day 19)
125
- - Conversion factory: Outlier MEGA-INFINITE phase3
126
 
127
- ## Related
128
 
129
- - **Branded twin (same weights):** [Outlier-Ai/Outlier-R1-Distill-32B-MLX-4bit](https://huggingface.co/Outlier-Ai/Outlier-R1-Distill-32B-MLX-4bit)
130
- - **Outlier org on HuggingFace:** [Outlier-Ai](https://huggingface.co/Outlier-Ai)
131
- - **Desktop app:** [outlier.host](https://outlier.host)
132
- - **Founders lifetime ($200, 500-seat cap):** [buy.polar.sh](https://buy.polar.sh/polar_cl_mJfYZsEpEMDcYrgxzvTdnahSeSQNq1UYLqV0l08CUhW)
133
- - **Discord:** [discord.gg/Hapennmdn9](https://discord.gg/Hapennmdn9)
134
 
135
- ## Collections
136
 
137
- - **Outlier for Apple Silicon (MLX):** [huggingface.co/collections/Outlier-Ai/outlier-consumer-edition-69e2fb4a0df119ea1747275e](https://huggingface.co/collections/Outlier-Ai/outlier-consumer-edition-69e2fb4a0df119ea1747275e)
138
- - **Outlier Research MoE:** [huggingface.co/collections/Outlier-Ai/outlier-research-69e2fb3a71984614b3c7a279](https://huggingface.co/collections/Outlier-Ai/outlier-research-69e2fb3a71984614b3c7a279)
139
- - **Outlier Server V3.2:** [huggingface.co/collections/Outlier-Ai/outlier-server-v32-69e2fb4b71984614b3c7a4a3](https://huggingface.co/collections/Outlier-Ai/outlier-server-v32-69e2fb4b71984614b3c7a4a3)
140
 
141
- ## Attribution
142
 
143
- Base model by the upstream author (see [DeepSeek-R1-Distill-Qwen-32B](https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Qwen-32B)). Outlier contributes
144
- the MLX 4-bit conversion and desktop-app packaging. Capability credit for the base
145
- belongs entirely to upstream.
 
 
146
 
147
  ## License
148
 
149
- Redistributed under the upstream license: `mit`. Respect the terms of
150
- [DeepSeek-R1-Distill-Qwen-32B](https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Qwen-32B) when using this conversion.
 
74
  content: A train leaves station A at 60 mph and another leaves station B, 180
75
  miles away, at 40 mph toward each other. When do they meet?
76
  ---
77
+ > **Run this on your Mac with [Outlier](https://outlier.host/?utm_source=hf&utm_medium=modelcard&utm_campaign=deepseek_r1_distill_qwen_32b_mlx_4bit)** — a one-click app that loads MLX models locally. macOS arm64, free download.
78
 
79
+ # DeepSeek-R1-Distill-Qwen-32B (MLX 4-bit)
80
 
81
+ MLX 4-bit conversion of [`deepseek-ai/DeepSeek-R1-Distill-Qwen-32B`](https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Qwen-32B), repackaged for Apple Silicon. Original weights, original license — see frontmatter above. This repo only changes the on-disk format (safetensors, MLX 4-bit, `chat_template.jinja`, tokenizer).
 
 
82
 
83
+ ## About this conversion
84
 
85
+ - **Format:** MLX 4-bit safetensors (group size 64, symmetric)
86
+ - **Tooling:** `mlx-lm` 0.31.x compatible
87
+ - **Files:** `model.safetensors` shards · `config.json` · tokenizer · `chat_template.jinja`
88
+ - **License:** inherits from the upstream base model — see YAML `license` field
 
 
89
 
90
+ ### Load directly with `mlx-lm`
91
 
92
  ```bash
93
+ pip install mlx-lm
94
  python -m mlx_lm.generate \
95
  --model Outlier-Ai/DeepSeek-R1-Distill-Qwen-32B-MLX-4bit \
96
+ --prompt "Hello, world." \
97
  --max-tokens 256
98
  ```
99
 
100
+ Or in Python:
101
 
102
+ ```python
103
+ from mlx_lm import load, generate
104
+ model, tokenizer = load("Outlier-Ai/DeepSeek-R1-Distill-Qwen-32B-MLX-4bit")
105
+ print(generate(model, tokenizer, prompt="Hello, world.", max_tokens=256))
106
+ ```
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
107
 
108
+ ## What is Outlier?
109
 
110
+ Outlier is a free macOS app that runs language models on your Mac, fully offline. Pick a model from a tier picker, click download, and chat — no API keys, no cloud round-trips, no usage caps. It ships with its own curated tier of MLX-4bit models and can also load any compatible MLX conversion (including this one) via the model picker.
 
 
 
 
111
 
112
+ Download Outlier (free, Apple Silicon): **[outlier.host](https://outlier.host/?utm_source=hf&utm_medium=modelcard&utm_campaign=deepseek_r1_distill_qwen_32b_mlx_4bit)**
113
 
114
+ For benchmark numbers (MMLU, HumanEval, tok/s on M-series Macs) with full provenance, see [outlier.host/benchmarks](https://outlier.host/benchmarks?utm_source=hf&utm_medium=modelcard&utm_campaign=deepseek_r1_distill_qwen_32b_mlx_4bit).
 
 
115
 
116
+ ## Other Outlier conversions
117
 
118
+ - [DeepSeek-R1-Distill-Qwen-7B (MLX 4-bit) — MLX 4-bit conversion (1,932 downloads)](https://huggingface.co/Outlier-Ai/DeepSeek-R1-Distill-Qwen-7B-MLX-4bit)
119
+ - [DeepSeek-R1-Distill-Llama-8B (MLX 4-bit) MLX 4-bit conversion (1,148 downloads)](https://huggingface.co/Outlier-Ai/DeepSeek-R1-Distill-Llama-8B-MLX-4bit)
120
+ - [DeepSeek-R1-Distill-Qwen-14B (MLX 4-bit) — MLX 4-bit conversion (1,087 downloads)](https://huggingface.co/Outlier-Ai/DeepSeek-R1-Distill-Qwen-14B-MLX-4bit)
121
+ - [Outlier-Core-27B (MLX 4-bit) — MLX 4-bit conversion (55 downloads)](https://huggingface.co/Outlier-Ai/Outlier-Core-27B-MLX-4bit)
122
+ - [Outlier-Nano-4B (MLX 4-bit) — MLX 4-bit conversion (67 downloads)](https://huggingface.co/Outlier-Ai/Outlier-Nano-4B-MLX-4bit)
123
 
124
  ## License
125
 
126
+ This conversion preserves the upstream license declared in the frontmatter (`mit`). Refer to the upstream base model card for the canonical license text and any usage restrictions.