inference-optimization/Qwen3.5-9B-quantized.w4a16
Image-Text-to-Text • 9B • Updated • 27
Inference Optimization
community
AI & ML interests
None defined yet.
Recent Activity
View all activity
inference-optimization/Qwen3-30B-A3B-Instruct-2507-7-bits-mode-noise-per-tensor
26B • Updated • 16
inference-optimization/Qwen3-30B-A3B-Instruct-2507-7-bits-mode-hybrid-per-tensor
27B • Updated • 13
inference-optimization/Qwen3-30B-A3B-Instruct-2507-7-bits-mode-heuristic-per-tensor
27B • Updated • 15
inference-optimization/Qwen3-30B-A3B-Instruct-2507-6.5-bits-mode-noise-per-tensor
25B • Updated • 15
inference-optimization/Qwen3-30B-A3B-Instruct-2507-6.5-bits-mode-hybrid-per-tensor
25B • Updated • 15
inference-optimization/Qwen3-30B-A3B-Instruct-2507-6.5-bits-mode-heuristic-per-tensor
25B • Updated • 16
inference-optimization/Qwen3-30B-A3B-Instruct-2507-6-bits-mode-noise-per-tensor
23B • Updated • 16
inference-optimization/Qwen3-30B-A3B-Instruct-2507-6-bits-mode-hybrid-per-tensor
23B • Updated • 16
inference-optimization/Qwen3-30B-A3B-Instruct-2507-6-bits-mode-heuristic-per-tensor
23B • Updated • 14
inference-optimization/Qwen3-30B-A3B-Instruct-2507-5.5-bits-mode-noise-per-tensor
21B • Updated • 17
inference-optimization/Qwen3-30B-A3B-Instruct-2507-5.5-bits-mode-hybrid-per-tensor
21B • Updated • 16
inference-optimization/Qwen3-30B-A3B-Instruct-2507-5.5-bits-mode-heuristic-per-tensor
21B • Updated • 18
inference-optimization/Qwen3-30B-A3B-Instruct-2507-5-bits-mode-noise-per-tensor
19B • Updated • 17
inference-optimization/Qwen3-30B-A3B-Instruct-2507-5-bits-mode-hybrid-per-tensor
19B • Updated • 15
inference-optimization/Qwen3-30B-A3B-Instruct-2507-5-bits-mode-heuristic-per-tensor
19B • Updated • 17
inference-optimization/Qwen3.6-35B-A3B-NVFP4
Updated • 17
inference-optimization/Qwen3-30B-A3B-7-bits-mode-noise-per-tensor
27B • Updated • 20
inference-optimization/Qwen3-30B-A3B-7-bits-mode-hybrid-per-tensor
27B • Updated • 26
inference-optimization/Qwen3-30B-A3B-7-bits-mode-heuristic-per-tensor
27B • Updated • 21
inference-optimization/Qwen3-30B-A3B-6.5-bits-mode-noise-per-tensor
25B • Updated • 19
inference-optimization/Qwen3-30B-A3B-6.5-bits-mode-hybrid-per-tensor
25B • Updated • 19
inference-optimization/Qwen3-30B-A3B-6.5-bits-mode-heuristic-per-tensor
25B • Updated • 23
inference-optimization/Qwen3-30B-A3B-6-bits-mode-noise-per-tensor
23B • Updated • 19
inference-optimization/Qwen3-30B-A3B-6-bits-mode-hybrid-per-tensor
23B • Updated • 27
inference-optimization/Qwen3-30B-A3B-6-bits-mode-heuristic-per-tensor
23B • Updated • 21
inference-optimization/Qwen3-30B-A3B-5.5-bits-mode-noise-per-tensor
21B • Updated • 21
inference-optimization/Qwen3-30B-A3B-5.5-bits-mode-hybrid-per-tensor
21B • Updated • 22
inference-optimization/Qwen3-30B-A3B-5.5-bits-mode-heuristic-per-tensor
21B • Updated • 17
inference-optimization/Qwen3-30B-A3B-5-bits-mode-noise-per-tensor
19B • Updated • 20