Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

17

Base only

Active filters: iq1_s

0xTank/Kimi-K3-IQ1S-REAP568-64K-4XSPARKS

1.8T • Updated 22 days ago • 5.95k • 1

vcruz305/Qwen3.8-2.4T-A95B-GGUF

Text Generation • 1.2T • Updated 8 days ago • 29 • 2

persadian/DeepSeek-V4-Flash-GGUF

Text Generation • 284B • Updated May 22 • 10

persadian/DeepSeek-V4-Flash-IQ1_S-XL

Text Generation • 229B • Updated May 26 • 789 • 3

Ontologer/FaceNet-Qwen3-8B-2Bit-Heretic

Text Generation • 8B • Updated Jun 20 • 12

Ontologer/NGMI-Qwen3-8B-2Bit-Heretic

Text Generation • 8B • Updated Jun 20 • 5

NGMISystems/NGMI-Qwen3-8B-2Bit-Heretic

Text Generation • 8B • Updated Jun 20 • 1

NGMISystems/NGMI-Qwen3-8B-3Bit-Heretic

Text Generation • 8B • Updated Jun 20 • 8

NGMISystems/NGMI-Qwen3-8B-5Bit-Heretic

Text Generation • 8B • Updated Jun 20 • 8

Ontologer/Ontologer-Qwen3-8B-2Bit-Heretic

Text Generation • 8B • Updated Jun 20 • 9

Ontologer/Ontologer-Qwen3-8B-3Bit-Heretic

Text Generation • 8B • Updated Jun 20 • 5

Ontologer/Ontologer-Qwen3-8B-5Bit-Heretic

Text Generation • 8B • Updated Jun 20 • 7

Delentia/jitna-v0.5-32B-gguf

Text Generation • 33B • Updated Jul 22 • 6

GrEarl/Kimi-K3-GGUF-IQ1_S

Text Generation • 2.8T • Updated 25 days ago • 3.37k • 22

asfgsdfg/Huihui-GLM-5.2-abliterated-Q8-IQ1S-experts-GGUF

Text Generation • 754B • Updated 20 days ago • 325

Academica/Academica-Qwen3-8B-2Bit-Heretic

Text Generation • 8B • Updated 19 days ago • 104

vcruz305/Kimi-K3-GGUF

Text Generation • 1.4T • Updated 11 days ago • 919 • 6