Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

17

Base only

Active filters: magnitude

magnitudedev/Qwen3.8-27B-DSpark-GGUF

1B • Updated 17 days ago • 5.04k • 9

plawanrath/phi-3.5-mini-instruct-magnitude-s10-pia

Text Generation • 4B • Updated May 12 • 10

plawanrath/phi-3.5-mini-instruct-magnitude-s30-pia

Text Generation • 4B • Updated May 12 • 10 • 1

plawanrath/phi-3.5-mini-instruct-magnitude-s50-pia

Text Generation • 4B • Updated May 12 • 16 • 1

plawanrath/phi-3.5-mini-instruct-magnitude-s70-pia

Text Generation • 4B • Updated May 12 • 10

plawanrath/mistral-7b-instruct-v0.3-magnitude-s10-pia

Text Generation • 7B • Updated May 12 • 8

plawanrath/mistral-7b-instruct-v0.3-magnitude-s30-pia

Text Generation • 7B • Updated May 12 • 8

plawanrath/mistral-7b-instruct-v0.3-magnitude-s50-pia

Text Generation • 7B • Updated May 12 • 5

plawanrath/mistral-7b-instruct-v0.3-magnitude-s70-pia

Text Generation • 7B • Updated May 12 • 10

plawanrath/gemma-2-9b-it-magnitude-s10-pia

Text Generation • 9B • Updated May 12 • 8

plawanrath/gemma-2-9b-it-magnitude-s30-pia

Text Generation • 9B • Updated May 12 • 10

plawanrath/gemma-2-9b-it-magnitude-s50-pia

Text Generation • 9B • Updated May 12 • 9

plawanrath/gemma-2-9b-it-magnitude-s70-pia

Text Generation • 9B • Updated May 12 • 10

magnitudedev/Qwen3.6-35B-A3B-DFlash-GGUF

0.4B • Updated 18 days ago • 598

magnitudedev/Qwen3.6-27B-DFlash-GGUF

2B • Updated 18 days ago • 354

magnitudedev/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-NVFP4-DSpark-GGUF

0.6B • Updated 16 days ago • 371

magnitudedev/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-NVFP4-DFlash-GGUF

0.8B • Updated 16 days ago • 496