Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,313

Base only

Active filters: autoround

LeaderboardModel1/gemma-4-E2B-it-qat-q4_0-unquantized-AutoRound-W4A16-RTN

Text Generation • 3B • Updated Jul 17 • 100

omshunyaom13/qwen3.6-27b-autoround-int4-mm-fable

Text Generation • 6B • Updated Jul 18 • 27

antonyMox/Qwen3.6-27B-abliterated-AutoRound-INT4-MTP

Text Generation • 6B • Updated Jul 20 • 537 • 1

antonyMox/Qwen3.6-27B-AutoRound-INT4-wide-MTP

Text Generation • 11B • Updated Jul 20 • 22

groxaxo/hivemind-32b-preview-AutoRound-AWQ-4bit

Text Generation • 2B • Updated 3 days ago • 27

Minachist/Qwen3.6-27B-INT8-Autoround-V2

Image-Text-to-Text • 9B • Updated 26 days ago • 2.26k • 7

aiakg/gemma-4-26B-A4B-it-AutoRound-W4A16-RTN

Text Generation • 1B • Updated Jul 21 • 267

LeaderboardModel1/Qwen2.5-7B-AutoRound-W4A16-RTN

Text Generation • 1B • Updated Jul 22 • 7

LeaderboardModel1/Qwen3-8B-AutoRound-W4A16-RTN

Text Generation • 1B • Updated Jul 23 • 8

LeaderboardModel1/Qwen3.6-27B-Architect-Polaris2-Fable-B-F451-AutoRound-W4A16-Tuning

Text Generation • 6B • Updated 30 days ago • 340 • 1

LeaderboardModel1/Tess-4-35B-A3B-AutoRound-W4A16-RTN

Text Generation • 1B • Updated 29 days ago • 27

DoktorMincs/Qwen3.6-27B-Architect-Polaris2-Fable-B-F451-W4A16-AutoRound

28B • Updated 28 days ago • 122

simaai/LFM2-VL-1.6B-Autoround-Safetensors

Image-Text-to-Text • 2B • Updated 28 days ago • 28

simaai/LFM2-VL-3B-Autoround-Safetensors

Image-Text-to-Text • 3B • Updated 28 days ago • 23

simaai/LFM2-VL-450M-Autoround-Safetensors

Image-Text-to-Text • 0.5B • Updated 28 days ago • 24

simaai/LFM2.5-VL-1.6B-Autoround-Safetensors

Image-Text-to-Text • 2B • Updated 28 days ago • 29

simaai/LFM2.5-VL-450M-Autoround-Safetensors

Image-Text-to-Text • 0.5B • Updated 28 days ago • 35

simaai/Qwen3-VL-4B-Instruct-Autoround-Safetensors

Image-Text-to-Text • 5B • Updated 28 days ago • 32

DoktorMincs/Qwen3.6-27B-Fable-Fusion-711-Uncensored-Heretic-NM-DAU-MTP-W4A16-AutoRound

28B • Updated 28 days ago • 6.32k • 2

LeaderboardModel1/Escarda-86M-Base-AutoRound-W4A16-RTN

Text Generation • 91.2M • Updated 27 days ago • 32

LeaderboardModel1/Qwen3.5-4B-AutoRound-MXFP4-RTN

Text Generation • 5B • Updated 26 days ago • 25

LeaderboardModel1/Qwen3.6-27B-Fable-Fusion-711-Uncensored-Heretic-NM-DAU-MTP-AutoRound-W4A16-Tuning

Text Generation • 6B • Updated 25 days ago • 478 • 3

LeaderboardModel1/Fara1.5-4B-AutoRound-W4A16-RTN

Text Generation • 1B • Updated 22 days ago • 20

LeaderboardModel1/HARC-Qwen2.5-7B-Instruct-AutoRound-W4A16-RTN

Text Generation • 1B • Updated 22 days ago • 16

Kris2017/Phi-3.5-MoE-instruct-W4A16-AutoRound

Text Generation • 6B • Updated 21 days ago • 22

Kris2017/Qwen3-30B-A3B-Instruct-2507-W4A16-AutoRound

Text Generation • 0.6B • Updated 21 days ago • 20

Kris2017/Qwen3-Next-80B-A3B-Instruct-W4A16-AutoRound

Text Generation • 11B • Updated 21 days ago • 22

Kris2017/Qwen3-Next-80B-A3B-Instruct-W2A16-AutoRound-derived

Text Generation • 11B • Updated 21 days ago • 24

Pilcothink/Qwen3.5-9B-MixedInt4-AutoRound

Image-Text-to-Text • 4B • Updated 19 days ago • 315

fbaldassarri/meta-llama_Llama-3.2-3B-auto_round-int4-gs64-asym

Text Generation • 0.8B • Updated 16 days ago • 20