Post
192
Wrote this up because it still feels backwards. Acceptance dropped, tok/s went up.
Full draft head: 66.7% / 117.1 tok/s. Trimmed: 63.6% / 121.7. Later remeasure +5.1% on a Pro 6000, +6.4% on a 5090 laptop. Full head still accepts more. Loses anyway.
Not my idea. FR-Spec. I just wired it for the native MTP head.
https://huggingface.co/blog/Avifenesh/masked-mtp-drafts
Avifenesh/Qwen3.8-27B-NVFP4-MTP-GGUF
Full draft head: 66.7% / 117.1 tok/s. Trimmed: 63.6% / 121.7. Later remeasure +5.1% on a Pro 6000, +6.4% on a 5090 laptop. Full head still accepts more. Loses anyway.
Not my idea. FR-Spec. I just wired it for the native MTP head.
https://huggingface.co/blog/Avifenesh/masked-mtp-drafts
Avifenesh/Qwen3.8-27B-NVFP4-MTP-GGUF