Edit Models filters

Model Tree

google/gemma-4-12B-it-qat-q4_0-unquantized

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

62

Base only

Active filters: google/gemma-4-12B-it-qat-q4_0-unquantized

unsloth/gemma-4-12B-it-qat-GGUF

Any-to-Any • 12B • Updated Jul 17 • 1.09M • 442

google/gemma-4-12B-it-qat-q4_0-gguf

Any-to-Any • 12B • Updated Jul 17 • 594k • 276

cyankiwi/gemma-4-12B-it-qat-AWQ-INT4

Any-to-Any • 13B • Updated Jul 21 • 179k • 8

lmstudio-community/gemma-4-12B-it-QAT-GGUF

12B • Updated Jul 20 • 443k • 12

google/gemma-4-12B-it-qat-w4a16-ct

Any-to-Any • 13B • Updated Jul 20 • 1.56M • 56

unsloth/gemma-4-12B-it-qat-w4a16

Any-to-Any • 13B • Updated Jul 17 • 3.41k • 6

DevQuasar/google.gemma-4-12B-it-qat-q4_0-unquantized-GGUF

Text Generation • 12B • Updated Jun 5 • 227 • 3

NeveAI/Neve-Echo-6-12B-QAT-GGUF

Image-Text-to-Text • 12B • Updated Jul 18 • 19 • 1

mradermacher/gemma-4-12B-it-qat-q4_0-unquantized-GGUF

12B • Updated Jun 7 • 122 • 2

prithivMLmods/gemma-4-12B-it-qat-GGUF

Image-Text-to-Text • 12B • Updated Jun 7 • 4.61k • 4

mradermacher/gemma-4-12B-it-qat-q4_0-unquantized-i1-GGUF

12B • Updated Jun 7 • 1.28k • 2

huihui-ai/Huihui-gemma-4-12B-it-qat-q4_0-unquantized-abliterated-GGUF

Any-to-Any • 12B • Updated Jun 8 • 18k • 59

ggnoy/gemma-4-12b-qat-q4

12B • Updated Jun 8 • 64

HarmenWessels/gemma-4-12B-it-qat-int4-ov

Image-Text-to-Text • Updated Jun 8 • 180 • 3

meganovaai/gemma-4-12B-it-qat-w4a16-ct

Any-to-Any • 13B • Updated Jun 8 • 9

olberdingbrands/gemma-4-12B-it-qat-w4a16-ct

Any-to-Any • 13B • Updated Jun 8 • 4 • 1

dahara1/gemma-4-12B-it-qat-UD-japanese-imatrix

Any-to-Any • 12B • Updated Jul 8 • 4.47k • 12

OrpheraAI/gemma-4-12B-it-qat-GGUF

Any-to-Any • 12B • Updated Jun 9 • 29

developerjeremylive/gemma-4-12B-it-qat-q4_0-gguf-etheroi

Any-to-Any • 12B • Updated Jun 10 • 8

developerjeremylive/gemma-4-12B-it-qat-GGUF-etheroi

Any-to-Any • 12B • Updated Jun 10 • 35

steampunque/gemma-4-12B-it-qat-q4_0-unquantized-MP-GGUF

12B • Updated Jun 12 • 50

tinybiggames/Huihui-gemma-4-12B-it-qat-q4_0-unquantized-abliterated-GGUF

Any-to-Any • 12B • Updated Jun 14 • 48

anonoob/gemma-4-12B-it-qat-q4_0-gguf

Any-to-Any • 12B • Updated Jun 14 • 22

smashingtags/gemma-4-12b-it-abliterated-nf4

Image-Text-to-Text • 12B • Updated Jun 14 • 16

idkwhattoputherenow/gemma-4-12B-it-qat-q4_0-maxerr

12B • Updated Jun 15 • 41 • 3

mlx-community/gemma-4-12B-it-qat-OptiQ-4bit

Text Generation • 12B • Updated Jul 20 • 3.35k • 13

mlx-community/Huihui-gemma-4-12B-it-qat-q4_0-unquantized-abliterated-5bit-msq

Any-to-Any • 12B • Updated Jun 15 • 50

JMingo/gemma-4-12B-it-qat-GGUF

12B • Updated Jun 23 • 55

wepiqx/gemma-4-12B-it-SHQ6-GGUF

Text Generation • 12B • Updated Jun 23 • 166 • 2

Pajari/gemma-4-12B-it-qat-Q4_0_V2

12B • Updated Jun 25 • 28