README.md

metadata

license: apache-2.0
base_model: mistralai/Ministral-3-3B-Instruct-2512-BF16
base_model_relation: quantized
quantized_by: UnstableLlama
tags:
  - exl3

>> mistralai/Ministral-3-3B-Instruct-2512

[QUANTS BY :: UNSTABLELLAMA]

// REPO

EXL3 quantizations of mistralai's Ministral-3-3b-Instruct-2512-BF16.

Quantized with exllamav3 0.0.18.

// QUANTS

[BRANCH]	[GiB]	[K/L_DIV]	[PPL]
2.10bpw	2.55	0.41369604	13.0952024
3.00bpw	2.87	0.15391978	10.63269147
3.15bpw	2.92	0.11824867	10.43570384
4.00bpw	3.23	0.03741831	9.83061761
6.00bpw	3.93	0.00459656	9.55857195
bf16	x	0	x

// DOWNLOAD

Use HF-CLI to pull specific branches to your local machine:

huggingface-cli download UnstableLlama/Ministral-3-3B-Instruct-2512-exl3 --revision "3.00bpw" --local-dir ./