Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

11,876

Base only

Active filters: quantized

empero-ai/Qwythos-9B-Claude-Mythos-5-1M-GGUF

Image-Text-to-Text • 9B • Updated 1 day ago • 2.01M • 2.2k

GnLOLot/MiniCPM5-1B-Claude-Opus-Fable5-Thinking-GGUF

Text Generation • 1B • Updated 2 days ago • 89.9k • 243

empero-ai/Qwythos-9B-v2-GGUF

Image-Text-to-Text • 9B • Updated 4 days ago • 70.3k • 138

ewinregirgojr/MiniCPM5-1B-Agentic-Tooluse-GGUF

Text Generation • 1B • Updated about 12 hours ago • 8.69k • 52

nvidia/Qwen3.6-27B-NVFP4

Text Generation • 18B • Updated 15 days ago • 1.15M • 360

Jiunsong/SuperGLM-5.2-abliterated-NVFP4

Text Generation • 381B • Updated 1 day ago • 302 • 28

InternScience/Agents-A1-Q4_K_M-GGUF

Text Generation • 35B • Updated about 11 hours ago • 46.1k • 108

migtissera/Tess-4-27B-GGUF

Image-Text-to-Text • 27B • Updated 6 days ago • 15.8k • 24

nvidia/Qwen3.6-35B-A3B-NVFP4

Text Generation • 19B • Updated Jun 12 • 8.58M • 466

GnLOLot/MiniCPM5-1B-Claude-Opus-Fable5-V2-Thinking-GGUF

Text Generation • 1B • Updated 2 days ago • 595 • 17

nvidia/GLM-5.2-NVFP4

Text Generation • 381B • Updated 19 days ago • 1.06M • 268

antirez/deepseek-v4-gguf

Text Generation • 284B • Updated May 31 • 4.79M • 325

nvidia/diffusiongemma-26B-A4B-it-NVFP4

Text Generation • 14B • Updated 11 days ago • 2.05M • 106

InternScience/Agents-A1-Q8_0-GGUF

Text Generation • 35B • Updated about 11 hours ago • 11.9k • 32

tencent/Hy3-FP8

Text Generation • 299B • Updated 9 days ago • 12.1k • 58

unsloth/Qwen-Image-Edit-2511-GGUF

Image-to-Image • 20B • Updated Jan 8 • 190k • 535

deadbydawn101/RavenX-CyberAgent-Qwen3.6-35B-A3B-Opus-4.7-OpenMythos-Pentester-BugHunter-RATH-GGUF

Text Generation • 36B • Updated Jun 13 • 23.1k • 101

Jiunsong/SuperHY3-abliterated-NVFP4

Text Generation • 172B • Updated 2 days ago • 672 • 10

mlx-community/Qwen3.6-27B-OptiQ-4bit

Text Generation • 27B • Updated 1 day ago • 13.4k • 68

Jundot/Qwen3.6-27B-oQ4e-mtp

5B • Updated 7 days ago • 2.11k • 9

Jundot/Qwen3.6-35B-A3B-oQ4e-mtp

6B • Updated 7 days ago • 1.6k • 9

Brian6145/Qwen3.6-27B-Claude-Opus-DeepSeek-Distilled-Imatrix-MTP-GGUF

Text Generation • 27B • Updated 1 day ago • 14.3k • 10

ALXOPENSOURCE/lingbot-video-1.3b-fp8

Text-to-Video • Updated 5 days ago • 82 • 8

nvidia/DeepSeek-V4-Flash-NVFP4

Text Generation • 167B • Updated about 1 month ago • 823k • 70

nvidia/Gemma-4-31B-IT-NVFP4

Text Generation • 21B • Updated 2 days ago • 2.4M • • 535

douyamv/Gemma-4-31B-JANG_4M-CRACK-GGUF

Text Generation • 31B • Updated Apr 9 • 308k • 236

Jiunsong/supergemma4-26b-uncensored-mlx-4bit-v2

Text Generation • 25B • Updated Apr 12 • 18k • 277

nvidia/MiniMax-M3-NVFP4

Text Generation • 247B • Updated 19 days ago • 313k • 61

AEON-7/Ornith-1.0-35B-AEON-Ultimate-Uncensored-NVFP4

Text Generation • 21B • Updated 17 days ago • 41.5k • 52

phaseonx11/GLM-5.2-Uncensored-GGUF

Text Generation • 753B • Updated 8 days ago • 2.05k • 17