Instructions to use unsloth/Qwen3.8-27B-NVFP4 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Local Apps Settings
- Unsloth Desktop
Update README.md
Browse files
README.md
CHANGED
|
@@ -7,7 +7,7 @@ tags:
|
|
| 7 |
---
|
| 8 |
|
| 9 |
> [!Note]
|
| 10 |
-
> This quant ONLY works in vLLM and **
|
| 11 |
|
| 12 |
|
| 13 |
# Read our How to [Run Qwen3.8-27B Guide!](https://unsloth.ai/docs/models/qwen3.8)
|
|
|
|
| 7 |
---
|
| 8 |
|
| 9 |
> [!Note]
|
| 10 |
+
> This quant ONLY works in vLLM and SGLang **MAIN**. The `lm_head` is quantized to FP8 so use the **MAIN version** of SGLang.
|
| 11 |
|
| 12 |
|
| 13 |
# Read our How to [Run Qwen3.8-27B Guide!](https://unsloth.ai/docs/models/qwen3.8)
|