nm-testing/tinyllama-one-shot-dynamic-test
Text Generation
• 1B • Updated • 7
nm-testing/tinyllama-one-shot-static-quant-test-compressed
Text Generation
• 1B • Updated • 30
nm-testing/asym-w8w8-int8-static-per-tensor-tiny-llama
1B • Updated • 8.2k
nm-testing/tinyllama-oneshot-w8a8-channel-dynamic-token-v2-asym
1B • Updated • 53
nm-testing/OLMoE-1B-7B-0924-Instruct-FP8
7B • Updated • 393
nm-testing/DeepSeek-Coder-V2-Lite-Instruct-W8A8
16B • Updated • 11
nm-testing/tinyllama-w8a8-compressed
1B • Updated • 1.16k
nm-testing/tinyllama-w4a16-compressed
1B • Updated • 1.72k
nm-testing/tinyllama-fp8-dynamic-compressed
1B • Updated • 764
nm-testing/SmolLM-360M-Instruct-quantized.w4a16
0.4B • Updated • 3
nm-testing/SmolLM-135M-Instruct-quantized.w4a16
Text Generation
• 0.2B • Updated • 137
nm-testing/Mixtral-8x7B-Instruct-v0.1-W4A16-channel-quantized
47B • Updated • 7
nm-testing/Meta-Llama-3-8B-Instruct-fp8-compressed
8B • Updated • 6
nm-testing/Phi-3-mini-128k-instruct-FP8
4B • Updated • 1.08k
nm-testing/Mixtral-8x7B-Instruct-v0.1-FP8-quantized
47B • Updated • 7
nm-testing/Mixtral-8x7B-Instruct-v0.1-W8A16-quantized
47B • Updated • 6
nm-testing/Mixtral-8x7B-Instruct-v0.1-W4A16-quantized
47B • Updated • 264
nm-testing/tinyllama-oneshot-w8a8-dynamic-token-v2-asym
Text Generation
• 1B • Updated • 82
nm-testing/Qwen2-1.5B-Instruct-FP8W8
Text Generation
• 2B • Updated • 7.6k
nm-testing/Meta-Llama-3-8B-Instruct-W4A16-ACTORDER-compressed-tensors-test
Text Generation
• 8B • Updated • 14
nm-testing/Meta-llama3-8b-Instruct-quant-FP8
Text Generation
• 8B • Updated • 5
nm-testing/Meta-llama3-8b-Instruct-SmoothQuant-Fp8
Text Generation
• 8B • Updated • 11
nm-testing/Meta-Llama-3-8B-Instruct-nonuniform-test
Text Generation
• 8B • Updated • 37k
Text Generation
• 8B • Updated • 6
nm-testing/Meta-Llama-3-8B-Instruct-Non-Uniform-compressed-tensors
Text Generation
• 8B • Updated • 6
nm-testing/Meta-Llama-3-8B-Instruct-W8A8-FP8-Channelwise-compressed-tensors
Text Generation
• 8B • Updated • 20
• 2
nm-testing/Meta-Llama-3-8B-Instruct-FP8-K-V
Text Generation
• 8B • Updated • 8
nm-testing/Qwen2-0.5B-Instruct
Text Generation
• 0.6B • Updated • 8
nm-testing/Meta-Llama-3-8B-Instruct-W4A16-compressed-tensors-test
Text Generation
• 8B • Updated • 76
nm-testing/Meta-Llama-3-8B-FP8-compressed-tensors-test-bos
Text Generation
• 8B • Updated • 9