Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

634

Base only

Active filters: gguf-my-lora

ggml-org/LoRA-Llama-3-Instruct-abliteration-8B-F16-GGUF

88.1M • Updated Nov 1, 2024 • 87 • 1

bunnycore/LLama-3.2-1B-General-lora_model-F16-GGUF

11.3M • Updated Nov 1, 2024 • 16 • 1

bunnycore/Qwen2.5-7B-Exp2-lora_model-Q8_0-GGUF

40.4M • Updated Nov 3, 2024 • 17 • 1

Leejy0-0/Llama-3.2-3b-lora_model-F16-GGUF

24.3M • Updated Nov 4, 2024 • 3

PragmaticPete/llama3.2inst-F32-GGUF

Text Generation • 90.2M • Updated Nov 4, 2024 • 14

NikolayKozloff/Phi-3-medium-4k-instruct-sq-LORA-F16-GGUF

Text Generation • 65.5M • Updated Nov 5, 2024 • 6 • 1

NikolayKozloff/Phi-3-medium-4k-instruct-sq-LORA-F32-GGUF

Text Generation • 65.5M • Updated Nov 5, 2024 • 9 • 1

NikolayKozloff/Phi-3-medium-4k-instruct-sq-LORA-Q8_0-GGUF

Text Generation • 65.5M • Updated Nov 5, 2024 • 6 • 1

NikolayKozloff/Phi-3-mini-4k-instruct-sq-LORA-F32-GGUF

Text Generation • 29.9M • Updated Nov 5, 2024 • 7 • 1

NikolayKozloff/Phi-3-mini-4k-instruct-sq-LORA-F16-GGUF

Text Generation • 29.9M • Updated Nov 5, 2024 • 23 • 1

NikolayKozloff/Phi-3-mini-4k-instruct-sq-LORA-Q8_0-GGUF

Text Generation • 29.9M • Updated Nov 5, 2024 • 16 • 1

dimvasilk/Llama-3-Instruct-abliteration-LoRA-8B-F16-GGUF

88.1M • Updated Nov 11, 2024 • 11

Mortido/saiga_mistral_7b_lora-F16-GGUF

Text Generation • 13.6M • Updated Nov 11, 2024 • 16

Mortido/saiga_mistral_7b_lora-F32-GGUF

Text Generation • 13.6M • Updated Nov 11, 2024 • 14

Mortido/saiga_mistral_7b_lora-Q8_0-GGUF

Text Generation • 13.6M • Updated Nov 11, 2024 • 22

shafire/AgentZero-F16-GGUF

Text Generation • 54M • Updated Jun 12, 2025 • 17

shafire/AgentZero-Q8_0-GGUF

Text Generation • 54M • Updated Jun 12, 2025 • 31

JackeyLai/Qwen2.5-3B-instruct-lora-F16-GGUF

15M • Updated Nov 12, 2024 • 13

shafire/talktoai-F16-GGUF

Text Generation • 41.9M • Updated Jun 12, 2025 • 7

kenonix/koalpaca-polyglot-12.8b-bills-Q8_0-GGUF

6.55M • Updated Nov 14, 2024 • 8

Tymkolt/dragoman-F16-GGUF

Text Generation • 0.7B • Updated Nov 15, 2024 • 20

beomi/KoAlpaca-RealQA-Solar-Ko-Recovery-11B-Q8_0-GGUF

Text Generation • 62.9M • Updated Nov 25, 2024 • 11

beomi/KoAlpaca-RealQA-Solar-Ko-Recovery-11B-LoRA-ChatML-Q8_0-GGUF

62.9M • Updated Nov 26, 2024 • 6 • 1

beomi/KoAlpaca-RealQA-Solar-Ko-Recovery-11B-LoRA-ChatML-F16-GGUF

62.9M • Updated Nov 26, 2024 • 8

OMH5/241127-testdata1-F16-GGUF

27.3M • Updated Nov 28, 2024 • 1

OMH5/241127-testdata1-Q8_0-GGUF

27.3M • Updated Nov 28, 2024 • 1

eltorio/Llama-3.2-3B-appreciation-F16-GGUF

24.3M • Updated Dec 2, 2024 • 22 • 3

dysen/Llama-3-Instruct-abliteration-LoRA-8B-F16-GGUF

88.1M • Updated Nov 28, 2024 • 5

leondlotter/BrainGPT-7B-v0.1-F16-GGUF

17.9M • Updated Nov 29, 2024 • 5

vkimbris/Vikhr-Llama-3.2-1B-Instruct-Summary-Adapter-Q8_0-GGUF

852k • Updated Nov 29, 2024 • 5