Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

13

Base only

Active filters: llama31

roleplaiapp/Dolphin3.0-Llama3.1-8B-Q2_K-GGUF

Text Generation • 8B • Updated Feb 2, 2025 • 21

roleplaiapp/Dolphin3.0-Llama3.1-8B-Q6_K-GGUF

Text Generation • 8B • Updated Feb 2, 2025 • 156 • 1

roleplaiapp/Dolphin3.0-Llama3.1-8B-Q8_0-GGUF

Text Generation • 8B • Updated Feb 2, 2025 • 42

roleplaiapp/Dolphin3.0-Llama3.1-8B-Q3_K_L-GGUF

Text Generation • 8B • Updated Feb 2, 2025 • 5

roleplaiapp/Dolphin3.0-Llama3.1-8B-Q3_K_M-GGUF

Text Generation • 8B • Updated Feb 2, 2025 • 26

roleplaiapp/Dolphin3.0-Llama3.1-8B-Q3_K_S-GGUF

Text Generation • 8B • Updated Feb 2, 2025 • 12

roleplaiapp/Dolphin3.0-Llama3.1-8B-Q4_K_M-GGUF

Text Generation • 8B • Updated Feb 2, 2025 • 50

roleplaiapp/Dolphin3.0-Llama3.1-8B-Q4_K_S-GGUF

Text Generation • 8B • Updated Feb 2, 2025 • 35

roleplaiapp/Dolphin3.0-Llama3.1-8B-Q5_K_M-GGUF

Text Generation • 8B • Updated Feb 2, 2025 • 96

roleplaiapp/Dolphin3.0-Llama3.1-8B-Q5_K_S-GGUF

Text Generation • 8B • Updated Feb 2, 2025 • 4

AlekseyCalvin/Lyrical_Llama31_8B_ru2en_SFT

Text Generation • 8B • Updated May 16 • 6

AlekseyCalvin/Lyrical_Llama31_8B_ru2en_bnb_4bit

Text Generation • 8B • Updated May 16 • 4

AlekseyCalvin/Lyrical_Llama31_8B_ru2en_SFT-mlx-3Bit

Text Generation • 1B • Updated May 16 • 24