5.21 GB

Ctrl+K

1 contributor

History: 4 commits

czl

Link the new -outq2 line (lm_head at 2-bit, measured quality-neutral)

7daa5ef verified about 1 month ago

clm_mlx
Add 4bit MLX encoder (group size 32, affine, weights at root) about 1 month ago
heads
Add 4bit MLX encoder (group size 32, affine, weights at root) about 1 month ago
.gitattributes

101 Bytes
Add 4bit MLX encoder (group size 32, affine, weights at root) about 1 month ago
LICENSE

11.4 kB
Add 4bit MLX encoder (group size 32, affine, weights at root) about 1 month ago
README.md

8.8 kB
Link the new -outq2 line (lm_head at 2-bit, measured quality-neutral) about 1 month ago
chat_template.jinja

4.17 kB
Add 4bit MLX encoder (group size 32, affine, weights at root) about 1 month ago
clm_mlx.json

804 Bytes
Add 4bit MLX encoder (group size 32, affine, weights at root) about 1 month ago
config.json

70.6 kB
Add 4bit MLX encoder (group size 32, affine, weights at root) about 1 month ago
generation_config.json

239 Bytes
Add 4bit MLX encoder (group size 32, affine, weights at root) about 1 month ago
model.safetensors

5.12 GB
xet

Add 4bit MLX encoder (group size 32, affine, weights at root) about 1 month ago
model.safetensors.index.json

64.1 kB
Add 4bit MLX encoder (group size 32, affine, weights at root) about 1 month ago
parity.json

158 kB
Add 4bit MLX encoder (group size 32, affine, weights at root) about 1 month ago
quantization.json

2.57 kB
Add 4bit MLX encoder (group size 32, affine, weights at root) about 1 month ago
tokenizer.json

11.4 MB
xet

Add 4bit MLX encoder (group size 32, affine, weights at root) about 1 month ago
tokenizer_config.json

729 Bytes
Add 4bit MLX encoder (group size 32, affine, weights at root) about 1 month ago