Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

23,627

Base only

Active filters: llama-cpp

spiritbuun/buun-Qwen3.6-chat_template

Updated 5 days ago • 32

prism-ml/Ternary-Bonsai-8B-gguf

Text Generation • 8B • Updated Apr 20 • 15.9k • 86

barozp/Qwen3.6-28B-REAP20-A3B-GGUF

Text Generation • 28B • Updated Apr 19 • 9.34k • 21

gaston-parravicini/LFM2.5-8B-A1B-Uncensored-Gaston-GGUF

Text Generation • 8B • Updated 3 days ago • 2.66k • 8

prism-ml/Bonsai-8B-gguf

Text Generation • 8B • Updated Apr 18 • 59.9k • 704

hiiamboris/Darwin-28B-Coder-Q4_K_M-GGUF

Text Generation • 27B • Updated 12 days ago • 414 • 5

AlicanKiraz0/Cybersecurity-BaronLLM_Offensive_Security_LLM_Q6_K_GGUF

Text Generation • 8B • Updated Jun 4, 2025 • 672 • 237

Tesslate/OmniCoder-9B-GGUF

9B • Updated Mar 12 • 21.3k • 301

deadbydawn101/gemma-4-E4B-Agentic-Opus-Reasoning-GeminiCLI-GGUF

Text Generation • 8B • Updated Apr 16 • 7.07k • 15

prism-ml/Ternary-Bonsai-4B-gguf

Text Generation • 4B • Updated Apr 20 • 1.94k • 11

Novaciano/Ultimate-RPG.System-3.2-1B-Q4_K_M-GGUF

1B • Updated 5 days ago • 188 • 3

prithivMLmods/Qwen3.5-9B-MTP-GGUF

Image-Text-to-Text • 9B • Updated about 21 hours ago • 3.26k • 3

prithivMLmods/Qwen3.5-4B-MTP-GGUF

Image-Text-to-Text • 4B • Updated about 21 hours ago • 3.48k • 3

TouchNight/Qwen2.5-14B_Uncencored-Q4_K_M-GGUF

Text Generation • 15B • Updated Sep 19, 2024 • 197 • 3

ggml-org/Qwen3-Reranker-0.6B-Q8_0-GGUF

Text Ranking • 0.6B • Updated Oct 3, 2025 • 33.1k • 20

Youssofal/Qwen3.6-35B-A3B-Abliterated-Heretic-GGUF

Text Generation • 35B • Updated Apr 16 • 10.6k • 28

prism-ml/Ternary-Bonsai-1.7B-gguf

Text Generation • 2B • Updated Apr 20 • 3.3k • 17

kenonix/Darwin-9B-KOREA-Q4_K_M-GGUF

Text Generation • 9B • Updated 18 days ago • 472 • 8

kenonix/Darwin-9B-KOREA-Q8_0-GGUF

Text Generation • 9B • Updated 18 days ago • 83 • 8

spiritbuun/Nemotron-Labs-Diffusion-14B-Q8_0-GGUF

Text Generation • 14B • Updated 12 days ago • 1.57k • 8

k0valik/Qwen3.6-27B-Omnimerge-v4-IQ4_XS-12.76GiB-GGUF

Text Generation • 27B • Updated 11 days ago • 16.7k • 2

fraQtl/Qwen3.6-35B-A3B-Hi-Fi-GGUF

Text Generation • 35B • Updated 2 days ago • 574 • 2

Surpem/Supertron2.1-0.6B-GGUF

Text Generation • 0.6B • Updated 6 days ago • 215 • 2

prithivMLmods/Qwen3.6-27B-MTP-GGUF

Image-Text-to-Text • 27B • Updated about 21 hours ago • 4.24k • 2

prithivMLmods/Qwen3.6-35B-A3B-MTP-GGUF

Image-Text-to-Text • 36B • Updated about 21 hours ago • 2.28k • 2

noxinc/Llama-3-portuguese-Tom-cat-8b-instruct-Q4_K_M-GGUF-PTBR

Text Generation • 8B • Updated May 7, 2024 • 70 • 1

v8karlo/UNCENSORED-Wukong-Phi-3-Instruct-Ablated-Q4_K_M-GGUF

4B • Updated Jun 6, 2024 • 312 • 5

zhezhe/gemma-2-9b-it-Q4_K_M-GGUF

Text Generation • 9B • Updated Jul 8, 2024 • 1.02k • 8

YorkieOH10/Meta-Llama-3.1-8B-Instruct-Q8_0-GGUF

Text Generation • 8B • Updated Jul 23, 2024 • 3.41k • 10

smcleod/Qwen2.5-Coder-7B-Instruct-Q8_0-GGUF

Text Generation • 8B • Updated Sep 19, 2024 • 404 • 6