inference-optimization/Qwen3-30B-A3B-5-bits-mode-hybrid-per-tensor
19B • Updated • 49
Inference Optimization
community
AI & ML interests
None defined yet.
Recent Activity
View all activity
inference-optimization/Qwen3-30B-A3B-5-bits-mode-heuristic-per-tensor
19B • Updated • 63
inference-optimization/Qwen3-8B-7-bits-mode-noise-per-tensor
6B • Updated • 77
inference-optimization/Qwen3-8B-7-bits-mode-hybrid-per-tensor
7B • Updated • 88
inference-optimization/Qwen3-8B-7-bits-mode-heuristic-per-tensor
7B • Updated • 94
inference-optimization/Qwen3-8B-6.5-bits-mode-noise-per-tensor
6B • Updated • 68
inference-optimization/Qwen3-8B-6.5-bits-mode-hybrid-per-tensor
7B • Updated • 63
inference-optimization/Qwen3-8B-6.5-bits-mode-heuristic-per-tensor
7B • Updated • 74
inference-optimization/Qwen3-8B-6-bits-mode-noise-per-tensor
6B • Updated • 65
inference-optimization/Qwen3-8B-6-bits-mode-hybrid-per-tensor
6B • Updated • 65
inference-optimization/Qwen3-8B-6-bits-mode-heuristic-per-tensor
6B • Updated • 68
inference-optimization/Qwen3-8B-5.5-bits-mode-noise-per-tensor
6B • Updated • 66
inference-optimization/Qwen3-8B-5.5-bits-mode-hybrid-per-tensor
6B • Updated • 66
inference-optimization/Qwen3-8B-5.5-bits-mode-heuristic-per-tensor
6B • Updated • 68
inference-optimization/Qwen3-8B-5-bits-mode-noise-per-tensor
6B • Updated • 64
inference-optimization/Qwen3-8B-5-bits-mode-hybrid-per-tensor
6B • Updated • 71
inference-optimization/Qwen3-8B-5-bits-mode-heuristic-per-tensor
6B • Updated • 67
inference-optimization/Llama-3.1-8B-Instruct-7-bits-mode-noise-per-tensor
7B • Updated • 55
inference-optimization/Llama-3.1-8B-Instruct-7-bits-mode-hybrid-per-tensor
7B • Updated • 52
inference-optimization/Llama-3.1-8B-Instruct-7-bits-mode-heuristic-per-tensor
7B • Updated • 58
inference-optimization/Llama-3.1-8B-Instruct-6.5-bits-mode-noise-per-tensor
7B • Updated • 51
inference-optimization/Llama-3.1-8B-Instruct-6.5-bits-mode-hybrid-per-tensor
7B • Updated • 66
inference-optimization/Llama-3.1-8B-Instruct-6.5-bits-mode-heuristic-per-tensor
7B • Updated • 55
inference-optimization/Llama-3.1-8B-Instruct-6-bits-mode-noise-per-tensor
6B • Updated • 62
inference-optimization/Llama-3.1-8B-Instruct-6-bits-mode-hybrid-per-tensor
6B • Updated • 64
inference-optimization/Llama-3.1-8B-Instruct-6-bits-mode-heuristic-per-tensor
6B • Updated • 70
inference-optimization/Llama-3.1-8B-Instruct-5.5-bits-mode-noise-per-tensor
6B • Updated • 52
inference-optimization/Llama-3.1-8B-Instruct-5.5-bits-mode-hybrid-per-tensor
6B • Updated • 59
inference-optimization/Llama-3.1-8B-Instruct-5.5-bits-mode-heuristic-per-tensor
6B • Updated • 53
inference-optimization/Llama-3.1-8B-Instruct-5-bits-mode-noise-per-tensor
5B • Updated • 46