Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

AI-MO/NuminaMath-CoT

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

606

Base only

Active filters: AI-MO/NuminaMath-CoT

matrixportalx/YuLan-Mini-Q8_0-GGUF

Text Generation • 2B • Updated Dec 31, 2024 • 6

dphn/Dolphin3.0-Qwen2.5-1.5B

2B • Updated Jan 5, 2025 • 375 • 12

dphn/Dolphin3.0-Qwen2.5-3b

3B • Updated Jan 5, 2025 • 974 • 33

QuantFactory/YuLan-Mini-GGUF

Text Generation • 2B • Updated Jan 3, 2025 • 338 • 2

itlwas/YuLan-Mini-Q4_K_M-GGUF

Text Generation • 2B • Updated Jan 4, 2025 • 16

itlwas/Dolphin3.0-Llama3.2-1B-Q4_K_M-GGUF

1B • Updated Jan 5, 2025 • 147

itlwas/Dolphin3.0-Llama3.2-3B-Q4_K_M-GGUF

3B • Updated Jan 5, 2025 • 924 • 1

itlwas/Dolphin3.0-Qwen2.5-0.5B-Q4_K_M-GGUF

0.5B • Updated Jan 5, 2025 • 188

itlwas/Dolphin3.0-Qwen2.5-1.5B-Q4_K_M-GGUF

2B • Updated Jan 5, 2025 • 269

itlwas/Dolphin3.0-Qwen2.5-3b-Q4_K_M-GGUF

3B • Updated Jan 5, 2025 • 878

bartowski/Dolphin3.0-Llama3.1-8B-GGUF

Text Generation • 8B • Updated Jan 5, 2025 • 13.1k • 25

itlwas/Dolphin3.0-Llama3.1-8B-Q4_K_M-GGUF

8B • Updated Jan 5, 2025 • 809 • 2

IntelligentEstate/Fast-Dolphin_QwenStar-1.5B-Q8-GGUF

2B • Updated Jan 6, 2025 • 45

IntelligentEstate/Dolphin3.0-QwenStar-3b-iQ4_K_M

3B • Updated Jan 6, 2025 • 23

IntelligentEstate/Dolphin3.0_QwenStar-3B-Q8-GGUF

3B • Updated Jan 6, 2025 • 10

bartowski/Dolphin3.0-Llama3.1-8B-exl2

Text Generation • Updated Jan 5, 2025 • 3

bartowski/Dolphin3.0-Llama3.2-1B-GGUF

Text Generation • 1B • Updated Jan 5, 2025 • 4.01k • 11

bartowski/Dolphin3.0-Llama3.2-3B-GGUF

Text Generation • 3B • Updated Jan 5, 2025 • 10.4k • 34

bartowski/Dolphin3.0-Qwen2.5-0.5B-GGUF

Text Generation • 0.5B • Updated Jan 5, 2025 • 1.25k • 5

bartowski/Dolphin3.0-Qwen2.5-1.5B-GGUF

Text Generation • 2B • Updated Jan 5, 2025 • 17.5k • 2

bartowski/Dolphin3.0-Qwen2.5-3b-GGUF

Text Generation • 3B • Updated Jan 5, 2025 • 6.39k • 21

QuantFactory/Dolphin3.0-Qwen2.5-3b-GGUF

3B • Updated Jan 5, 2025 • 747 • 3

mlx-community/Dolphin3.0-Llama3.1-8B-4bit

1B • Updated Jan 5, 2025 • 216

mlx-community/Dolphin3.0-Llama3.1-8B-8bit

2B • Updated Jan 5, 2025 • 169

mlx-community/Dolphin3.0-Llama3.1-8B-bf16

8B • Updated Jan 5, 2025 • 39

jncraton/Dolphin3.0-Llama3.2-1B-ct2-int8

Updated Jan 5, 2025 • 9

jncraton/Dolphin3.0-Llama3.2-3B-ct2-int8

Updated Jan 5, 2025 • 6

jncraton/Dolphin3.0-Llama3.1-8B-ct2-int8

Updated Jan 5, 2025 • 7

Abc7347/Dolphin3.0-Llama3.2-3B-Q4_K_M-GGUF

3B • Updated Jan 6, 2025 • 31

NeoChen1024/Dolphin3.0-Llama3.1-8B-W8A8

8B • Updated Apr 18, 2025 • 14