Instructions to use peculiar-ragdoll/Occult-Nail-1.0-35B-A3B-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use peculiar-ragdoll/Occult-Nail-1.0-35B-A3B-GGUF with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf peculiar-ragdoll/Occult-Nail-1.0-35B-A3B-GGUF:UD-Q4_K_XL # Run inference directly in the terminal: llama cli -hf peculiar-ragdoll/Occult-Nail-1.0-35B-A3B-GGUF:UD-Q4_K_XL
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf peculiar-ragdoll/Occult-Nail-1.0-35B-A3B-GGUF:UD-Q4_K_XL # Run inference directly in the terminal: llama cli -hf peculiar-ragdoll/Occult-Nail-1.0-35B-A3B-GGUF:UD-Q4_K_XL
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf peculiar-ragdoll/Occult-Nail-1.0-35B-A3B-GGUF:UD-Q4_K_XL # Run inference directly in the terminal: ./llama-cli -hf peculiar-ragdoll/Occult-Nail-1.0-35B-A3B-GGUF:UD-Q4_K_XL
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf peculiar-ragdoll/Occult-Nail-1.0-35B-A3B-GGUF:UD-Q4_K_XL # Run inference directly in the terminal: ./build/bin/llama-cli -hf peculiar-ragdoll/Occult-Nail-1.0-35B-A3B-GGUF:UD-Q4_K_XL
Use Docker
docker model run hf.co/peculiar-ragdoll/Occult-Nail-1.0-35B-A3B-GGUF:UD-Q4_K_XL
- LM Studio
- Jan
- vLLM
How to use peculiar-ragdoll/Occult-Nail-1.0-35B-A3B-GGUF with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "peculiar-ragdoll/Occult-Nail-1.0-35B-A3B-GGUF" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "peculiar-ragdoll/Occult-Nail-1.0-35B-A3B-GGUF", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }'Use Docker
docker model run hf.co/peculiar-ragdoll/Occult-Nail-1.0-35B-A3B-GGUF:UD-Q4_K_XL
- Ollama
How to use peculiar-ragdoll/Occult-Nail-1.0-35B-A3B-GGUF with Ollama:
ollama run hf.co/peculiar-ragdoll/Occult-Nail-1.0-35B-A3B-GGUF:UD-Q4_K_XL
- Unsloth Desktop
- Pi
How to use peculiar-ragdoll/Occult-Nail-1.0-35B-A3B-GGUF with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf peculiar-ragdoll/Occult-Nail-1.0-35B-A3B-GGUF:UD-Q4_K_XL
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "peculiar-ragdoll/Occult-Nail-1.0-35B-A3B-GGUF:UD-Q4_K_XL" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Docker Model Runner
How to use peculiar-ragdoll/Occult-Nail-1.0-35B-A3B-GGUF with Docker Model Runner:
docker model run hf.co/peculiar-ragdoll/Occult-Nail-1.0-35B-A3B-GGUF:UD-Q4_K_XL
- Lemonade
How to use peculiar-ragdoll/Occult-Nail-1.0-35B-A3B-GGUF with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull peculiar-ragdoll/Occult-Nail-1.0-35B-A3B-GGUF:UD-Q4_K_XL
Run and chat with the model
lemonade run user.Occult-Nail-1.0-35B-A3B-GGUF-UD-Q4_K_XL
List all available models
lemonade list
- Hermes Agent
How to use peculiar-ragdoll/Occult-Nail-1.0-35B-A3B-GGUF with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf peculiar-ragdoll/Occult-Nail-1.0-35B-A3B-GGUF:UD-Q4_K_XL
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default peculiar-ragdoll/Occult-Nail-1.0-35B-A3B-GGUF:UD-Q4_K_XL
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use peculiar-ragdoll/Occult-Nail-1.0-35B-A3B-GGUF with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf peculiar-ragdoll/Occult-Nail-1.0-35B-A3B-GGUF:UD-Q4_K_XL
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "peculiar-ragdoll/Occult-Nail-1.0-35B-A3B-GGUF:UD-Q4_K_XL" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
Occult Nail is an abliterated model that gets right to the point: Say goodbye to overthinking, tool call failures, amnesic loops, fluffy outputs, and denials.
The original unabliterated Nail dominates Qwen3.6-27b, Dagger-27b and Qwen3.6-35B-A3B on time-to-answer, with statistically matching accuracy on reasoning and agentic software engineering ability, and Nail wins multi-turn conversation quality even when the 27b models use a higher quantization. Occult Nail trades some of Nail's intelligence for absolute freedom. This abliterated version is a specialized tool, not a general coder or knowledge worker.
WARNING: Abliterated models like Occult Nail say and do things other models refuse, including potentially harmful behaviours. Take responsibility and show caution.
Benchmark setup. All models are
UD-Q6_K_XLquantized GGUF running on llama.cpp.
Refusals
Unabliterated models sometimes wrongly refuse benign (harmless) requests. Even the sharpened, unabliterated Nail refuses less than stock qwen, and Occult Nail refuses none. No more careful wording to get your work done.
HarmBench measures to what degree models refuse to produce language and behaviours that can be deemed harmful when applied maliciously. Models that are capable of such behaviours can be used for good or neutral purposes, so this benchmark is a measurement of specific capability that demands personal responsibility on behalf of the user deploying the model, not of inherent harmfulness.
Occult Corruption
Abliterated models lose information compared to their base, and the loss scales with the degree of abliteration. These are the measurements of how corrupted Occult Nail actually is.
Stripping the refusals does not make the model a better hacker. On two offensive-security benchmarks — Canary-Exploit (given a C/C++ program, produce an input that crashes it) and Cybench (agentic CTF tasks solved in a live container) — Occult Nail is level with its base on the first and lands fewer subtasks on the second. Both are judge-free: abliteration buys willingness, not capability.
Note: Cybench and Canary-Exploit numbers for base Nail will be added at another time, my GPU is busy at the moment.
How it's made
Built on a community abliteration — our work is the template and the quant, with no gradient training at any point:
- Start from an abliterated base. We take a Heretic-abliterated Qwen3.6-35B-A3B (refusal directions already ablated from the weights, no fine-tuning), published by llmfan46 — we quantize it, we don't re-run the abliteration.
- Sharpen into Nail. Nail's terseness system prompt + froggeric-derived chat template are baked into the GGUF metadata. It's the exact template the unabliterated Nail ships, so Nail → Occult Nail isolates abliteration alone (no template confound).
- Quantize. Unsloth's Dynamic (UD) per-tensor recipe is reproduced exactly — 733 tensor overrides read from a published UD GGUF header — imatrix-calibrated and quantized with llama.cpp. Shipped as a UD ladder (
Q2_K_XL→Q8_K_XL) plus anmmprojso vision is preserved.
Credits
- Qwen — Qwen3.6-35B-A3B base model
- llmfan46 — Heretic-abliterated Qwen3.6-35B-A3B weights (our starting point)
- Heretic — automated-abliteration method
- Unsloth — UD dynamic-quant recipe
- froggeric — chat template base
- mradermacher — importance matrix (imatrix)
- llama.cpp — quantization + inference
Citation
@misc{occultnail2026,
title = {Occult Nail 1.0 (Qwen3.6-35B-A3B, sharpened + abliterated)},
author = {Saga Ishtardottir},
year = {2026},
howpublished = {\url{https://huggingface.co/peculiar-ragdoll/Occult-Nail-1.0-35B-A3B-GGUF}}
}
- Downloads last month
- 1,366
2-bit
3-bit
4-bit
5-bit
6-bit
8-bit
Model tree for peculiar-ragdoll/Occult-Nail-1.0-35B-A3B-GGUF
Base model
Qwen/Qwen3.6-35B-A3B