Instructions to use baa-ai/GLM-5.1-RAM-420GB-MLX with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use baa-ai/GLM-5.1-RAM-420GB-MLX with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] hf download baa-ai/GLM-5.1-RAM-420GB-MLX --local-dir GLM-5.1-RAM-420GB-MLX
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Atomic Chat
GLM-5.1 — 420GB (MLX)
Mixed-precision quantized version of zai-org/GLM-5.1 optimised by baa.ai using a proprietary Black Sheep AI method.
Per-tensor bit-width allocation via advanced sensitivity analysis and budget-constrained optimisation — no calibration data required.
Sized for 512GB Apple Silicon machines (378 GB model + 134 GB headroom for OS/KV cache).
Metrics
| Metric | Value |
|--------|-------|
| Size | 382 GB |
| Average bits | 3.6 |
| Architecture | MoE (256 experts) |
Usage
from mlx_lm import load, generate
model, tokenizer = load("baa-ai/GLM-5.1-RAM-420GB-MLX")
response = generate(model, tokenizer, prompt="Hello!", max_tokens=256)
print(response)
Quantized by baa.ai
Black Sheep AI Products
Black Sheep AI builds private AI with the Bounded AI Architecture (BAA): three layers, each bound to something you control, on infrastructure you control. Nothing leaves your boundary.
Ram (Reasoning Layer) — Full-capability frontier models, shrunk to fit smaller GPUs with reasoning kept and certified. They rely strictly on your Data Modules for knowledge, so you swap the model as better ones ship.
Paddock (Knowledge Plane) — Binds your Data Modules directly to the reasoning layer: one per topic, period, person, permission or tenant. Permission, freeze, hand back or delete each one on its own.
Watchman (GRC Layer) — Governance, risk and compliance in a single, complete audit log: every module permission, every bind, every model's provenance. Five certificates before anything goes live.
Shepherd — Takes a frontier model, compresses it into a Ram reasoning model, certifies it with Watchman, binds it to your Paddock, and deploys the Bounded AI Architecture to your infrastructure: your cloud, a Mac Studio, or an air-gapped facility.
Learn more at baa.ai — Private AI for enterprises whose data cannot leave the building.
- Downloads last month
- 239
4-bit
Model tree for baa-ai/GLM-5.1-RAM-420GB-MLX
Base model
zai-org/GLM-5.1