inference-optimization/Llama-3.2-1B-Instruct-5-bits-mode-hybrid-per-tensor
1B • Updated • 39
Inference Optimization
community
AI & ML interests
None defined yet.
Recent Activity
View all activity
inference-optimization/Llama-3.2-1B-Instruct-5-bits-mode-heuristic-per-tensor
1B • Updated • 35
inference-optimization/Meta-Llama-3-8B-Instruct-spinquantR1R2R4-w4a16-gptq
2B • Updated • 74
inference-optimization/Meta-Llama-3-8B-Instruct-spinquantR1R2R4-w4a16-qmod
2B • Updated • 20
inference-optimization/Meta-Llama-3-8B-Instruct-spinquantR1R2R4-nvfp4-qmod
5B • Updated • 21
inference-optimization/Meta-Llama-3-8B-Instruct-spinquantR1R2R4-nvfp4-gptq
5B • Updated • 22
inference-optimization/Llama-3.1-8B-Instruct-quip-w4a16-gptq
2B • Updated • 20
inference-optimization/Llama-3.1-8B-Instruct-quip-w4a16-qmod
2B • Updated • 21
inference-optimization/Llama-3.1-8B-Instruct-quip-nvfp4-qmod
5B • Updated • 17
inference-optimization/Llama-3.1-8B-Instruct-quip-nvfp4-gptq
5B • Updated • 17
inference-optimization/Meta-Llama-3-8B-Instruct-W4A16_actorder_group
2B • Updated • 20
inference-optimization/llama3-8b-sharegpt-5k-gen
Updated
inference-optimization/Llama-3.2-3B-Instruct-NVFP4
2B • Updated • 319
inference-optimization/Llama-3.2-3B-Instruct-FP8-Dynamic
3B • Updated • 25
inference-optimization/Llama-3.2-3B-Instruct-FP8-Block
3B • Updated • 4
inference-optimization/Llama-3.2-1B-Instruct-NVFP4
0.8B • Updated • 32
inference-optimization/Llama-3.2-1B-Instruct-FP8-Dynamic
1B • Updated • 27
inference-optimization/Llama-3.2-1B-Instruct-FP8-Block
1B • Updated • 5
inference-optimization/Qwen3-30B-A3B_5.5_bits_mode_heuristic
22B • Updated • 2
inference-optimization/Qwen3-30B-A3B_7.0_bits_mode_heuristic
27B • Updated • 3
inference-optimization/Qwen3-30B-A3B_7.0_bits_mode_noise
27B • Updated • 2
inference-optimization/Qwen3-30B-A3B_7.0_bits_mode_hybrid
25B • Updated • 1
inference-optimization/Qwen3-30B-A3B_6.5_bits_mode_heuristic
25B • Updated • 1
inference-optimization/Qwen3-30B-A3B_6.5_bits_mode_noise
25B • Updated • 5
inference-optimization/Qwen3-30B-A3B_6.5_bits_mode_hybrid
24B • Updated • 4
inference-optimization/Qwen3-30B-A3B_6.0_bits_mode_heuristic
23B • Updated • 1
inference-optimization/Qwen3-30B-A3B_6.0_bits_mode_noise
24B • Updated • 2
inference-optimization/gpt-oss-120b-from-qwen235b-then-self-ckpt5-speculator.eagle3
0.9B • Updated • 3
inference-optimization/Qwen3-30B-A3B_6.0_bits_mode_hybrid
23B • Updated • 2
inference-optimization/Qwen3-30B-A3B_5.5_bits_mode_noise
22B • Updated • 1 • 1