Inference Providers
Active filters: Int4
AXERA-TECH/DeepSeek-R1-Distill-Qwen-1.5B-GPTQ-Int4
Updated • 24
• 1
AXERA-TECH/DeepSeek-R1-Distill-Qwen-7B-GPTQ-Int4
Updated • 21
• 1
AXERA-TECH/Qwen2.5-1.5B-Instruct-GPTQ-Int4
Text Generation • Updated • 122
AXERA-TECH/Qwen2.5-3B-Instruct-GPTQ-Int4
AXERA-TECH/Qwen2.5-0.5B-Instruct-GPTQ-Int4
Text Generation • Updated • 16
AXERA-TECH/Qwen2.5-7B-Instruct-GPTQ-Int4
JunHowie/Qwen3-0.6B-GPTQ-Int4
Text Generation • 0.6B • Updated • 795
• 1
JunHowie/Qwen3-1.7B-GPTQ-Int4
Text Generation • 2B • Updated • 59
• 1
JunHowie/Qwen3-32B-GPTQ-Int4
Text Generation • 33B • Updated • 893
• 4
JunHowie/Qwen3-30B-A3B-GPTQ-Int4
Text Generation • 5B • Updated • 22
• 1
JunHowie/Qwen3-14B-GPTQ-Int4
Text Generation • 15B • Updated • 2.39k
• 4
JunHowie/Qwen3-8B-GPTQ-Int4
Text Generation • 8B • Updated • 1.23k
• 4
JunHowie/Qwen3-4B-GPTQ-Int4
Text Generation • 4B • Updated • 238
• 2
JunHowie/Qwen3-4B-Instruct-2507-GPTQ-Int4
Text Generation • 4B • Updated • 819
• 4
JunHowie/Qwen3-4B-Thinking-2507-GPTQ-Int4
Text Generation • 4B • Updated • 31
• 1
JunHowie/Qwen3-30B-A3B-Instruct-2507-GPTQ-Int4
Text Generation • 31B • Updated • 706
JunHowie/Qwen3-30B-A3B-Thinking-2507-GPTQ-Int4
Text Generation • 31B • Updated • 75
JunHowie/Qwen2-7B-Instruct-GPTQ-Int4
Text Generation • 8B • Updated • 8
JunHowie/Seed-OSS-36B-Instruct-GPTQ-Int4
Text Generation • 36B • Updated • 8
QuantTrio/KAT-Dev-GPTQ-Int4
Text Generation • 33B • Updated • 21
• 1
QuantTrio/Kimi-Dev-72B-GPTQ-Int4
Text Generation • 73B • Updated • 37
• 2
AXERA-TECH/Qwen3-VL-2B-Instruct-GPTQ-Int4
Image-Text-to-Text • Updated • 41
• 1
AXERA-TECH/Qwen3-VL-4B-Instruct-GPTQ-Int4
Image-Text-to-Text • Updated • 26
AXERA-TECH/Qwen3-VL-8B-Instruct-GPTQ-Int4
Image-Text-to-Text • Updated • 10
• 1
AXERA-TECH/Qwen3-VL-2B-Instruct-GPTQ-Int4-AX630C
Image-Text-to-Text • Updated • 12
AXERA-TECH/Qwen3-VL-2B-Instruct-GPTQ-Int4-AX630C-P256-CTX384
Image-Text-to-Text • Updated • 9
AXERA-TECH/Qwen3-VL-2B-Instruct-GPTQ-Int4-AX630C-P320-CTX448
Image-Text-to-Text • Updated • 14
AXERA-TECH/Qwen3-1.7B-GPTQ-Int4
Text Generation • Updated • 14
AXERA-TECH/Xiaomi-MiMo-VL-Miloco-7B-AX650-GPTQ-Int4
Image-Text-to-Text • Updated • 5
AXERA-TECH/Qwen2.5-VL-3B-Instruct-GPTQ-Int4
Image-Text-to-Text • Updated • 6