How to use from
llama.cpp
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf Level5Tech/clef-flash-GGUF:
# Run inference directly in the terminal:
llama cli -hf Level5Tech/clef-flash-GGUF:
Install from WinGet (Windows)
winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf Level5Tech/clef-flash-GGUF:
# Run inference directly in the terminal:
llama cli -hf Level5Tech/clef-flash-GGUF:
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-app
# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama serve -hf Level5Tech/clef-flash-GGUF:
# Run inference directly in the terminal:
./build/bin/llama cli -hf Level5Tech/clef-flash-GGUF:
Use Docker
docker model run hf.co/Level5Tech/clef-flash-GGUF:
Quick Links

clef-flash-GGUF

GGUF BF16, Q8_0 and Q4_K_M, for llama.cpp b11671. A quantized build of Cloudflare's Clef-flash (9B), made for "The Noise Floor of a Quantization Comparison" by Aleks Blagojevich and Trevor Sunderland (Level5). This isn't an official Cloudflare release.

Paper: https://arxiv.org/abs/2611.15671

Measurements, recipes and per-record outputs: https://github.com/Level5Tech/clef-quant-bench

The paper and all six builds, in one collection: https://huggingface.co/collections/Level5Tech/the-noise-floor-of-a-quantization-comparison-6afd62e8288cc5e14becefaf

Archived release (all versions): https://doi.org/10.5281/zenodo.24184497

The base model is under Apache-2.0. Its LICENSE is included here, and NOTICE says these weights were modified by quantization.

Citation

@misc{blagojevich2026noisefloorquantizationcomparison,
  title={The Noise Floor of a Quantization Comparison: Engine, restart, batch and kernel drift, measured against 8-bit and 4-bit effects in two decision models},
  author={Aleks Blagojevich and Trevor Sunderland},
  year={2026},
  eprint={2611.15671},
  archivePrefix={arXiv},
  primaryClass={cs.LG},
  url={https://arxiv.org/abs/2611.15671},
}
Downloads last month
732
GGUF
Model size
9B params
Architecture
clef
Hardware compatibility
Log In to add your hardware

4-bit

8-bit

16-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for Level5Tech/clef-flash-GGUF

Finetuned
Qwen/Qwen3.5-9B
Quantized
(65)
this model

Collection including Level5Tech/clef-flash-GGUF

Paper for Level5Tech/clef-flash-GGUF