Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

217

Base only

Active filters: llama.cpp, Qwen/Qwen3-8B

Qwen/Qwen3-8B-GGUF

Text Generation • 8B • Updated May 21, 2025 • 377k • 274

ISTA-DASLab/Qwen3-8B-GGUF-GSQ

Text Generation • 8B • Updated May 18 • 167 • 4

pro2rus/qwen3_8B_doni_junk_store_chat

Text Generation • 8B • Updated 4 days ago • 369 • 1

chenhaodev/qwen3-8b-drug-reviewer-gguf

8B • Updated 3 days ago • 157 • 1

chenhaodev/tcm-constitution-qwen3-8b-gguf

8B • Updated 1 day ago • 153 • 1

bartowski/Qwen_Qwen3-8B-GGUF

Text Generation • 8B • Updated Apr 28, 2025 • 40.6k • 38

lmstudio-community/Qwen3-8B-GGUF

Text Generation • 8B • Updated Apr 29, 2025 • 47.3k • 12

second-state/Qwen3-8B-GGUF

8B • Updated May 1, 2025 • 849 • 8

gaianet/Qwen3-8B-GGUF

8B • Updated May 1, 2025 • 506

unsloth/Qwen3-8B-GGUF

Text Generation • 8B • Updated Jun 8, 2025 • 78.6k • 150

MaziyarPanahi/Qwen3-8B-GGUF

Text Generation • 8B • Updated Apr 28, 2025 • 254k • 11

ggml-org/Qwen3-8B-GGUF

Text Generation • 8B • Updated Jul 28 • 1.77k • 7

NikolayKozloff/Qwen3-8B-Q8_0-GGUF

Text Generation • 8B • Updated Apr 28, 2025 • 290 • 1

merterbak/Qwen3-8B-GGUF

Text Generation • 8B • Updated Apr 28, 2025 • 267 • 1

unsloth/Qwen3-8B-128K-GGUF

Text Generation • 8B • Updated May 25, 2025 • 6.02k • 28

tensorblock/Qwen_Qwen3-8B-GGUF

Text Generation • 8B • Updated Jan 27 • 292 • 2

Aldaris/Qwen3-8B-Q4_K_M-GGUF

Text Generation • 8B • Updated Apr 29, 2025 • 8.65k • 5

charlesthefool/Qwen3-8B-Q4_K_M-GGUF

Text Generation • 8B • Updated Apr 29, 2025 • 138

Antigma/Qwen3-8B-GGUF

Text Generation • 8B • Updated May 29, 2025 • 276

miku552/Qwen3-8B-Q4_K_M-GGUF

Text Generation • 8B • Updated Apr 29, 2025 • 68

miku552/Qwen3-8B-IQ4_NL-GGUF

Text Generation • 8B • Updated Apr 29, 2025 • 85

Kondara/Qwen3-8B-Q4_K_M-GGUF

Text Generation • 8B • Updated Apr 29, 2025 • 33

devmasa/Qwen3-8B-Q8_0-GGUF

Text Generation • 8B • Updated Apr 29, 2025 • 22 • 1

devmasa/Qwen3-8B-Q6_K-GGUF

Text Generation • 8B • Updated Apr 29, 2025 • 262

DevQuasar/Qwen.Qwen3-8B-GGUF

Text Generation • 8B • Updated May 4, 2025 • 218 • 1

Sovenok-Hacker/Qwen3-8B-Q4_0-GGUF

Text Generation • 8B • Updated Apr 29, 2025 • 51

itlwas/Qwen3-8B-Q4_K_M-GGUF

Text Generation • 8B • Updated Apr 29, 2025 • 71

mradermacher/Qwen3-8B-GGUF

8B • Updated Apr 29, 2025 • 8.2k • 1

mradermacher/Qwen3-8B-i1-GGUF

8B • Updated Apr 29, 2025 • 922 • 3

LouiSeHU/Qwen3-8B-Q8_0-GGUF

Text Generation • 8B • Updated Apr 29, 2025 • 27