Qwopus3.6-27B-v2 MLX bf16

Full bf16 MLX reference of Jackrong/Qwopus3.6-27B-v2. No quantization โ€” the original weights repacked into MLX format.

This is the master copy. Smaller quantized variants (4-bit, 6-bit, 8-bit, 3-bit, plus group-size sweeps) will be derived from the same source.

Use

pip install mlx-lm
mlx_lm.generate --model zaydiscold/Qwopus3.6-27B-v2-MLX-bf16 \
  --prompt "Explain quantum entanglement" --max-tokens 200 --temp 0.8

Author's temperature recommendation: 0.75โ€“1.0.

Conversion

python -m mlx_lm convert --hf-path Jackrong/Qwopus3.6-27B-v2 --mlx-path ./output

Credits


Mix brought by the NOTORIOUS MLX.

Downloads last month
13
Safetensors
Model size
27B params
Tensor type
BF16
ยท
MLX
Hardware compatibility
Log In to add your hardware

Quantized

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for zaydiscold/Qwopus3.6-27B-v2-MLX-bf16

Finetuned
(7)
this model

Collection including zaydiscold/Qwopus3.6-27B-v2-MLX-bf16