Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

211

Base only

Active filters: qat

mlx-community/gemma-4-31B-it-qat-OptiQ-4bit

Text Generation • 31B • Updated Jul 20 • 2.51k • 6

Goekdeniz-Guelmez/Qwen3.5-0.8B-QAT-Demo

Text Generation • 0.8B • Updated Jun 19 • 103

RedTeamLab/Gemma-4-12B-redteam-QAT-MTP

Text Generation • 65.6M • Updated Jul 1 • 41

mavis-ai/Gemma4-E2B-QAT-Q4

Image-Text-to-Text • 1B • Updated Jul 1 • 25

mavis-ai/Gemma4-E4B-QAT-Q4

Image-Text-to-Text • 2B • Updated Jul 1 • 36

FadedRedStar/gemma-4-E2B-it-qat-q4_0-heretic-GGUF

Image-Text-to-Text • 5B • Updated Jul 11 • 917 • 4

FadedRedStar/gemma-4-E4B-it-qat-q4_0-heretic-GGUF

Image-Text-to-Text • 7B • Updated Jul 11 • 4.34k

FadedRedStar/gemma-4-12B-it-qat-q4_0-heretic-GGUF

Image-Text-to-Text • 12B • Updated Jul 11 • 680 • 1

mavis-ai/Gemma4-E2B-QAT-Q5

Image-Text-to-Text • 1B • Updated Jul 2 • 21

mavis-ai/Gemma4-12B-QAT-Q5

Image-Text-to-Text • 2B • Updated Jul 2 • 44

mavis-ai/Gemma4-E4B-QAT-Q5

Image-Text-to-Text • 2B • Updated Jul 2 • 21

mavis-ai/Gemma4-26B-QAT-Q5

Image-Text-to-Text • 5B • Updated Jul 2 • 36

mavis-ai/Gemma4-31B-QAT-Q5

Image-Text-to-Text • 6B • Updated Jul 2 • 42

mlx-community/gemma-4-26B-A4B-it-qat-q4_0-mlx-aligned

Text Generation • 25B • Updated Jul 6 • 473

EigenLabs/gemma-4-31B-it-qat-q4_0-MLX

Text Generation • 6B • Updated Jul 6 • 82

DarrenJiaImbue/gemma-4-E4B-it-qat-litertlm

Text Generation • Updated Jul 7

Thox-ai/ThoxWebby-Gemma-4-E2B

Text Generation • Updated 19 days ago

LeadingPoint/gemma-4-E4B-it-assistant-w4a16

Text Generation • 78.8M • Updated Jul 7 • 9

melcheikh/gemma-4-31B-it-qat-NVFP4-mse-Blackwell

Text Generation • 17B • Updated Jul 10 • 478 • 3

ProCreations/grug-9b-qat-q4

Text Generation • 9B • Updated Jul 10 • 133 • 2

YoozLabs/gemma-4-E4B-it-qat-lean-4bit-mlx

Text Generation • 1B • Updated Jul 12 • 95

YoozLabs/gemma-4-12B-it-qat-lean-4bit-mlx

Text Generation • 12B • Updated Jul 12 • 190

shawnzzzzz/Qwen3-30B-A3B-DAPO-FFN-W4A4-QAT-BF16Master-step-0060

Text Generation • 31B • Updated Jul 12 • 102

shawnzzzzz/Qwen3-30B-A3B-DAPO-FFN-W4A4-QAT-BF16Master-step-0195

Text Generation • 31B • Updated Jul 12 • 83

shawnzzzzz/Qwen3-30B-A3B-DAPO-FFN-W4A4-QAT-BF16Master-step-0330

Text Generation • 31B • Updated Jul 12 • 80

shawnzzzzz/Qwen3-30B-A3B-DAPO-FFN-W4A4-QAT-BF16Master-step-0475

Text Generation • 31B • Updated Jul 12 • 104

shawnzzzzz/Qwen3-30B-A3B-DAPO-FFN-W4A4-QAT-BF16Master-step-0620

Text Generation • 31B • Updated Jul 12 • 113

shawnzzzzz/Qwen3-30B-A3B-DAPO-FFN-W4A4-QAT-BF16Master-step-0730

Text Generation • 31B • Updated Jul 12 • 115

shawnzzzzz/Qwen3-30B-A3B-DAPO-FFN-W4A4-QAT-BF16Master-step-0815

Text Generation • 31B • Updated Jul 12 • 110

YoozLabs/Qwen3.5-4B-qat-lean-4bit-mlx

Text Generation • 0.7B • Updated Jul 21 • 75