Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

212

Base only

Active filters: qat

shawnzzzzz/Qwen3-30B-A3B-DAPO-FFN-W4A4-QAT-BF16Master-step-0815

Text Generation • 31B • Updated Jul 12 • 102

YoozLabs/Qwen3.5-4B-qat-lean-4bit-mlx

Text Generation • 0.7B • Updated Jul 21 • 77

YoozLabs/Qwen3.5-0.8B-qat-lean-4bit-mlx

Text Generation • 0.1B • Updated Jul 21 • 53

YoozLabs/Qwen3.5-0.8B-qat-GGUF

Text Generation • 0.8B • Updated Jul 13 • 280

YoozLabs/Qwen3.5-4B-qat-GGUF

Text Generation • 4B • Updated Jul 13 • 361 • 1

yunlou2026/gemma-4-E4B-it-heretic-QAT-GGUF

7B • Updated Jul 14 • 254

AutomatosX/AX-Gemma-4-12B-IT-MLX-QAT-4bit-Assistant-MTP

Image-Text-to-Text • 12B • Updated Jul 23 • 251

AutomatosX/AX-Gemma-4-31B-IT-MLX-QAT-4bit-Assistant-MTP

Image-Text-to-Text • 31B • Updated Jul 23 • 209

AutomatosX/AX-Gemma-4-26B-A4B-IT-MLX-QAT-4bit-Assistant-MTP

Image-Text-to-Text • 26B • Updated Jul 23 • 244

micymike/vilyalabs-med

0.2B • Updated Jul 20 • 4 • 3

ProCreations/grug-27b-qat-q4-gguf

27B • Updated Jul 23 • 128k • 21

WhiskyAKM/Gemma-4-E2B-it-qat-GGUF

Any-to-Any • 5B • Updated Jul 24 • 281

ProCreations/grug-35b-qat-q4-gguf

35B • Updated Jul 23 • 2.08k • 11

WhiskyAKM/Gemma-4-E4B-it-qat-GGUF

Any-to-Any • 7B • Updated Jul 24 • 884

tokenine/catareeya-gemma-4-12b-qat

Text Generation • 12B • Updated Jul 25 • 26

weili-0234/Qwen3.5-27B-NVFP4-QAD-W4A16-LR1e-5-s2640

17B • Updated Jul 25 • 9

weili-0234/Qwen3.5-27B-NVFP4-QAD-W4A4-LR1e-5-s2640

17B • Updated Jul 25 • 14

weili-0234/Qwen3.5-27B-MXFP4-QAD-W4A16-LR1e-5-s2640

16B • Updated Jul 26 • 4

weili-0234/Qwen3.5-27B-NVFP4-QAD-W4A16-LR1e-5-s2640-A4Schema

17B • Updated Jul 26 • 11

WhiskyAKM/Gemma-4-12B-it-qat-GGUF

Any-to-Any • 12B • Updated Jul 27 • 132

MonsieurTapir/gemma-4-E2B-it-qat-mobile-GGUF

5B • Updated Jul 27 • 587 • 1

tokenine/catareeya-4-12b-qat

12B • Updated Jul 29 • 31

WhiskyAKM/Gemma-4-E2B-it-qat-NVFP4-GGUF

Any-to-Any • 5B • Updated Jul 29 • 106

WhiskyAKM/Gemma-4-E4B-it-qat-NVFP4-GGUF

Any-to-Any • 7B • Updated Jul 30 • 954 • 1

WhiskyAKM/Gemma-4-12B-it-qat-NVFP4-GGUF

Any-to-Any • 12B • Updated 23 days ago • 1.25k

AMR5210/qwen3-0.6b-qat-q2k

Text Generation • 0.6B • Updated 26 days ago • 166

jscott3201/hyperion-gemma-4-12b-it-qat-mlx-q4-g64

Text Generation • 12B • Updated Jul 31 • 150

OsaurusAI/DeepSeek-V4-Flash-0731-JANG

Text Generation • 31B • Updated 29 days ago • 3.69k • 9

JANGQ-AI/DeepSeek-V4-Flash-0731-JANG

Text Generation • 31B • Updated 29 days ago • 2.78k • 5

Luigi/voxsum-qwen35-0.8b

Summarization • 0.8B • Updated Aug 1 • 13