Instructions to use Blackfrost-Research/Qwen3.8-2.4T-A95B-DERISKED-UD-IQ3_XXS with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use Blackfrost-Research/Qwen3.8-2.4T-A95B-DERISKED-UD-IQ3_XXS with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf Blackfrost-Research/Qwen3.8-2.4T-A95B-DERISKED-UD-IQ3_XXS:UD-IQ3_XXS # Run inference directly in the terminal: llama cli -hf Blackfrost-Research/Qwen3.8-2.4T-A95B-DERISKED-UD-IQ3_XXS:UD-IQ3_XXS
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf Blackfrost-Research/Qwen3.8-2.4T-A95B-DERISKED-UD-IQ3_XXS:UD-IQ3_XXS # Run inference directly in the terminal: llama cli -hf Blackfrost-Research/Qwen3.8-2.4T-A95B-DERISKED-UD-IQ3_XXS:UD-IQ3_XXS
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf Blackfrost-Research/Qwen3.8-2.4T-A95B-DERISKED-UD-IQ3_XXS:UD-IQ3_XXS # Run inference directly in the terminal: ./llama-cli -hf Blackfrost-Research/Qwen3.8-2.4T-A95B-DERISKED-UD-IQ3_XXS:UD-IQ3_XXS
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf Blackfrost-Research/Qwen3.8-2.4T-A95B-DERISKED-UD-IQ3_XXS:UD-IQ3_XXS # Run inference directly in the terminal: ./build/bin/llama-cli -hf Blackfrost-Research/Qwen3.8-2.4T-A95B-DERISKED-UD-IQ3_XXS:UD-IQ3_XXS
Use Docker
docker model run hf.co/Blackfrost-Research/Qwen3.8-2.4T-A95B-DERISKED-UD-IQ3_XXS:UD-IQ3_XXS
- LM Studio
- Jan
- vLLM
How to use Blackfrost-Research/Qwen3.8-2.4T-A95B-DERISKED-UD-IQ3_XXS with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "Blackfrost-Research/Qwen3.8-2.4T-A95B-DERISKED-UD-IQ3_XXS" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Blackfrost-Research/Qwen3.8-2.4T-A95B-DERISKED-UD-IQ3_XXS", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/Blackfrost-Research/Qwen3.8-2.4T-A95B-DERISKED-UD-IQ3_XXS:UD-IQ3_XXS
- Ollama
How to use Blackfrost-Research/Qwen3.8-2.4T-A95B-DERISKED-UD-IQ3_XXS with Ollama:
ollama run hf.co/Blackfrost-Research/Qwen3.8-2.4T-A95B-DERISKED-UD-IQ3_XXS:UD-IQ3_XXS
- Unsloth Desktop
- Pi
How to use Blackfrost-Research/Qwen3.8-2.4T-A95B-DERISKED-UD-IQ3_XXS with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf Blackfrost-Research/Qwen3.8-2.4T-A95B-DERISKED-UD-IQ3_XXS:UD-IQ3_XXS
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "Blackfrost-Research/Qwen3.8-2.4T-A95B-DERISKED-UD-IQ3_XXS:UD-IQ3_XXS" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Docker Model Runner
How to use Blackfrost-Research/Qwen3.8-2.4T-A95B-DERISKED-UD-IQ3_XXS with Docker Model Runner:
docker model run hf.co/Blackfrost-Research/Qwen3.8-2.4T-A95B-DERISKED-UD-IQ3_XXS:UD-IQ3_XXS
- Lemonade
How to use Blackfrost-Research/Qwen3.8-2.4T-A95B-DERISKED-UD-IQ3_XXS with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull Blackfrost-Research/Qwen3.8-2.4T-A95B-DERISKED-UD-IQ3_XXS:UD-IQ3_XXS
Run and chat with the model
lemonade run user.Qwen3.8-2.4T-A95B-DERISKED-UD-IQ3_XXS-UD-IQ3_XXS
List all available models
lemonade list
- Hermes Agent
How to use Blackfrost-Research/Qwen3.8-2.4T-A95B-DERISKED-UD-IQ3_XXS with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf Blackfrost-Research/Qwen3.8-2.4T-A95B-DERISKED-UD-IQ3_XXS:UD-IQ3_XXS
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default Blackfrost-Research/Qwen3.8-2.4T-A95B-DERISKED-UD-IQ3_XXS:UD-IQ3_XXS
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use Blackfrost-Research/Qwen3.8-2.4T-A95B-DERISKED-UD-IQ3_XXS with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf Blackfrost-Research/Qwen3.8-2.4T-A95B-DERISKED-UD-IQ3_XXS:UD-IQ3_XXS
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "Blackfrost-Research/Qwen3.8-2.4T-A95B-DERISKED-UD-IQ3_XXS:UD-IQ3_XXS" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
docker model run hf.co/Blackfrost-Research/Qwen3.8-2.4T-A95B-DERISKED-UD-IQ3_XXS:UD-IQ3_XXSQwen3.8-2.4T-A95B-DERISKED-UD-IQ3_XXS
Directional Weight Modification of Qwen3.8-Max · 2.4T MoE · imatrix GGUF (UD-IQ3_XXS)
Built by Blackfrost · Las Vegas, NV
Why this model exists
Qwen3.8-Max is a 2.4T-parameter mixture of experts. In BF16 it is a multi-terabyte, multi-node deploy, and its stock refusal behaviour is tuned for a general consumer assistant — which means it declines work that specialist teams do legitimately every day. Security engineers hunting bugs, red teams, and domain researchers hit refusals on tasks that are squarely inside their remit.
This checkpoint addresses both at once:
Footprint — importance-matrix-guided GGUF at ~956 GB, which brings a 2.4T MoE onto a single 8× B200 node instead of the two-node deploy the higher-precision editions require, and runs under
llama.cpprather than a multi-node serving stack.Behaviour — Directional Weight Modification (DWM) applied to soften over-refusal on legitimate domain work, without removing the model's embedded safety protocols.
Safety behaviour can be further adjusted by domain specific chat templates.
The point is a model that stays useful inside a domain and stays safe. See Safety posture — that section is not boilerplate, it is the design.
Choosing between the GGUF editions: this one carries more bits per weight and targets a
B200-class node. The sibling …-DERISKED-UD-Q1_0 is substantially smaller and
targets RTX-class hardware. Pick by the hardware you have.
Specifications
| Architecture | Qwen3_5MoeForCausalLM (qwen3_5_moe_text) — MoE + hybrid/linear attention |
| Base | Qwen/Qwen3.8-2.4T-A95B — official |
| Parameters | ~2.4T total · ~95B active |
| Layers / experts | 92 layers · 512 routed experts |
| Transform | DWM (directional weight modification) + imatrix GGUF quantization |
| Precision | UD-IQ3_XXS, importance-matrix guided · mixed per-tensor allocation |
| Kept at higher precision | attention output · shared experts · normalisation · embeddings |
| On-disk | ~956 GB (890 GiB), 23-part GGUF split |
| Context | 262,144 native |
| Runtime | llama.cpp / llama-server |
| Serve shape | single node · 8× B200 (or equivalent ≥180 GB-class NVIDIA) |
What "DERISKED" means
Not an ablation, and not an uncensored model.
Blackfrost calls this process DWM — Directional Weight Modification. Traditional abliteration attempts to delete refusal wholesale. DWM does something narrower and reversible in principle: it identifies a behavioural direction in the model's representation space and softens the model's response along that one axis, by a controlled amount, on selected residual-write surfaces.
What that buys, in practice:
- Less over-refusal on legitimate domain work — the model engages with a security question instead of pattern-matching it to "dangerous" and declining
- Embedded protections mathematically preserved — the protected component is not the target of the edit and is left intact by construction
- Predictable, tunable strength — one dial, measurable effect, not a black-box retrain
No SFT, no DPO, no distillation, and no re-training of any kind was applied.
Transform parameters are not published in this card. The specific direction set, coefficient, and pass structure are Blackfrost method and are withheld. What is disclosed is what was changed (surfaces above) and what was not (everything else).
Safety posture
Read this before evaluating.
This is a de-risked model. Refusal behaviour has been deliberately modified at the weight level. If your approval process treats reduced-refusal models as a distinct category, this one belongs in that category — unlike Blackfrost's pruned-only releases, which carry their parent's safety behaviour unmodified.
What that does not mean:
- This is not a "no-limits" model. DWM targets over-refusal, not the safety floor. Hard protections — including minors-exploitation and self-harm — are retained by design and are not the subject of the edit. Every Blackfrost de-risked release keeps those floors.
- Expected behaviour under a harmful request is deflection with a safer alternative, not compliance and not a bare refusal.
Safety is designed as two layers, and the second layer is your responsibility:
- Weights — protections preserved geometrically, over-refusal softened
- System prompt — the deploying operator supplies a domain-specific system prompt in the chat template, which acts as the policy driver for the endpoint
Serving this model with an empty or generic system prompt discards half the design. If you are exposing it to customers or employees, layer 2 is not optional.
Lineage
| Base | Official Qwen/Qwen3.8-2.4T-A95B |
| Applied | DWM (directional weight modification) · importance-matrix GGUF quantization |
| Quantized from | the full-precision BF16 build — not transcoded from a lower-precision edition |
| Not applied | SFT · DPO · distillation · expert pruning (REAP) · router modification |
| Format | GGUF · UD-IQ3_XXS · 23-part split |
| Sibling editions | …-DERISKED-UD-Q1_0 (RTX-class GGUF) · …-DERISKED-W4A4-NVFP4 · …-DERISKED-FP8 · …-DERISKED-BF16 |
Measured behaviour
[PENDING — not yet published.]
| Benchmark | DERISKED-BF16 | This (DERISKED-UD-IQ3_XXS) | Retention |
|---|---|---|---|
| — | pending | pending | —% |
Upstream Qwen3.8 figures are deliberately not reproduced here. Quoting a parent model's benchmarks on a derivative card tells the reader nothing about this checkpoint. Blackfrost publishes its own measurements against its own harness, or it publishes nothing.
Both quantization and DWM are trades. When results land, this section will state the harness, the conditions, and the retention figures — including any benchmark where retention is poor, and including multilingual capability, which generic English-only evaluations do not capture. Retention is measured against the BF16 edition, so the quantization cost is reported separately from the DWM effect.
Deployment notes
- Hardware. Single node, 8× B200 (or equivalent ≥180 GB-class NVIDIA). The weights occupy
roughly two thirds of the node, leaving substantial room for KV cache. This edition does not
fit 96 GB-class workstation GPUs — use the
…-UD-Q1_0edition for that hardware. - Split parts. Point the loader at part 1 (
…-00001-of-00023.gguf);llama.cppresolves the remaining parts automatically. Keep all 23 parts in the same directory. - Thinking is always on. Reasoning tokens consume the generation budget, so allow
≥512
max_tokensor visible content can come back empty while the model is still reasoning. - Context. 262,144 native. KV cache is the main consumer of headroom beyond the weights — size context to the VRAM you have left.
- Load time. Cold load of a near-terabyte build is slow. Budget generously.
- Integrity. Verify part count (23) and byte totals against the published checksums after download before attributing a load failure to the weights.
Quick serve (llama.cpp)
llama-server \
--model "$MODEL_DIR/Qwen3.8-2.4T-A95B-DERISKED-UD-IQ3_XXS-00001-of-00023.gguf" \
--ctx-size 32768 \
--n-gpu-layers 999 \
--host 0.0.0.0 --port 8000
OpenAI-compatible: POST /v1/chat/completions, GET /v1/models.
Remember to supply your domain system prompt — see Safety posture.
Access & licensing
This repository is public and manually gated. Access requests are reviewed by a person.
- Base licence: Qwen3.8-2.4T-A95B — the upstream terms apply to this derivative and travel with it.
- Redistribution: do not redistribute weights outside your grant.
- Commercial / consumer edition: pending evaluations.
Ask us about DWM strength tuned to your workload, domain-specific system-prompt packages, or evaluation against your own harness rather than generic benchmarks.
Contact Blackfrost
@Blackfrost_AI on X
DMs are open. Fastest route to a human.
Bug reports are better on the Community tab
so other users can see the fix.
Blackfrost · Las Vegas, Nevada
Frontier model engineering
Qwen3.8-2.4T-A95B-DERISKED-UD-IQ3_XXS · © 2026 Blackfrost Softwares Corp.
@Blackfrost_AI
- Downloads last month
- -
3-bit
Model tree for Blackfrost-Research/Qwen3.8-2.4T-A95B-DERISKED-UD-IQ3_XXS
Base model
Qwen/Qwen3.8-2.4T-A95B
# Gated model: Login with a HF token with gated access permission hf auth login