inference-optimization/Qwen3-30B-A3B-5-bits-mode-noise-per-tensor
19B • Updated • 20
Inference Optimization
community
AI & ML interests
None defined yet.
Recent Activity
View all activity
inference-optimization/Qwen3-30B-A3B-5-bits-mode-hybrid-per-tensor
19B • Updated • 20
inference-optimization/Qwen3-30B-A3B-5-bits-mode-heuristic-per-tensor
19B • Updated • 37
inference-optimization/Qwen3-8B-7-bits-mode-noise-per-tensor
6B • Updated • 22
inference-optimization/Qwen3-8B-7-bits-mode-hybrid-per-tensor
7B • Updated • 22
inference-optimization/Qwen3-8B-7-bits-mode-heuristic-per-tensor
7B • Updated • 21
inference-optimization/Qwen3-8B-6.5-bits-mode-noise-per-tensor
6B • Updated • 22
inference-optimization/Qwen3-8B-6.5-bits-mode-hybrid-per-tensor
7B • Updated • 19
inference-optimization/Qwen3-8B-6.5-bits-mode-heuristic-per-tensor
7B • Updated • 21
inference-optimization/Qwen3-8B-6-bits-mode-noise-per-tensor
6B • Updated • 22
inference-optimization/Qwen3-8B-6-bits-mode-hybrid-per-tensor
6B • Updated • 20
inference-optimization/Qwen3-8B-6-bits-mode-heuristic-per-tensor
6B • Updated • 24
inference-optimization/Qwen3-8B-5.5-bits-mode-noise-per-tensor
6B • Updated • 24
inference-optimization/Qwen3-8B-5.5-bits-mode-hybrid-per-tensor
6B • Updated • 21
inference-optimization/Qwen3-8B-5.5-bits-mode-heuristic-per-tensor
6B • Updated • 21
inference-optimization/Qwen3-8B-5-bits-mode-noise-per-tensor
6B • Updated • 21
inference-optimization/Qwen3-8B-5-bits-mode-hybrid-per-tensor
6B • Updated • 27
inference-optimization/Qwen3-8B-5-bits-mode-heuristic-per-tensor
6B • Updated • 22
inference-optimization/Llama-3.1-8B-Instruct-7-bits-mode-noise-per-tensor
7B • Updated • 23
inference-optimization/Llama-3.1-8B-Instruct-7-bits-mode-hybrid-per-tensor
7B • Updated • 21
inference-optimization/Llama-3.1-8B-Instruct-7-bits-mode-heuristic-per-tensor
7B • Updated • 28
inference-optimization/Llama-3.1-8B-Instruct-6.5-bits-mode-noise-per-tensor
7B • Updated • 20
inference-optimization/Llama-3.1-8B-Instruct-6.5-bits-mode-hybrid-per-tensor
7B • Updated • 34
inference-optimization/Llama-3.1-8B-Instruct-6.5-bits-mode-heuristic-per-tensor
7B • Updated • 26
inference-optimization/Llama-3.1-8B-Instruct-6-bits-mode-noise-per-tensor
6B • Updated • 32
inference-optimization/Llama-3.1-8B-Instruct-6-bits-mode-hybrid-per-tensor
6B • Updated • 33
inference-optimization/Llama-3.1-8B-Instruct-6-bits-mode-heuristic-per-tensor
6B • Updated • 41
inference-optimization/Llama-3.1-8B-Instruct-5.5-bits-mode-noise-per-tensor
6B • Updated • 23
inference-optimization/Llama-3.1-8B-Instruct-5.5-bits-mode-hybrid-per-tensor
6B • Updated • 28
inference-optimization/Llama-3.1-8B-Instruct-5.5-bits-mode-heuristic-per-tensor
6B • Updated • 23