Standardize GGUF model card structure
Browse filesAlign front matter, quantization tables, validation wording, benchmark wording, and support layout with Model_card.md.
README.md
CHANGED
|
@@ -1,6 +1,7 @@
|
|
| 1 |
---
|
| 2 |
license: apache-2.0
|
| 3 |
base_model: XHToken/Spark-X2.5-1.7B
|
|
|
|
| 4 |
library_name: llama.cpp
|
| 5 |
pipeline_tag: text-generation
|
| 6 |
tags:
|
|
@@ -27,20 +28,20 @@ Thank you for supporting this work.
|
|
| 27 |
|
| 28 |
## Files
|
| 29 |
|
| 30 |
-
| Quantization |
|
| 31 |
-
|---|---:|---:|---|
|
| 32 |
-
| Q8_0 | 1.70
|
| 33 |
-
| Q6_K | 1.31
|
| 34 |
-
| Q5_K_M | 1.17
|
| 35 |
-
| Q4_K_M | 1.03
|
| 36 |
-
| Q3_K_M | 0.87
|
| 37 |
-
| Q2_K | 0.74
|
| 38 |
-
| IQ2_XS | 0.61
|
| 39 |
-
| IQ1_M | 0.54
|
| 40 |
-
| Q1_0 | 0.40
|
| 41 |
-
|
| 42 |
-
The
|
| 43 |
-
|
| 44 |
|
| 45 |
Q1/Q2 and the IQ variants can lose instruction following, reasoning, and
|
| 46 |
tool-call reliability. Validate the chosen file on the workload that matters
|
|
|
|
| 1 |
---
|
| 2 |
license: apache-2.0
|
| 3 |
base_model: XHToken/Spark-X2.5-1.7B
|
| 4 |
+
base_model_relation: quantized
|
| 5 |
library_name: llama.cpp
|
| 6 |
pipeline_tag: text-generation
|
| 7 |
tags:
|
|
|
|
| 28 |
|
| 29 |
## Files
|
| 30 |
|
| 31 |
+
| Quantization | File size (GiB) | A10M generation token/s | Validation | Recommendation / Notes |
|
| 32 |
+
|---|---:|---:|---|---|
|
| 33 |
+
| Q8_0 | 1.70 | 175.54 | Load/generate pass | High quality. |
|
| 34 |
+
| Q6_K | 1.31 | 199.07 | Load/generate pass | High quality. |
|
| 35 |
+
| Q5_K_M | 1.17 | 223.04 | Load/generate pass | Daily use. |
|
| 36 |
+
| Q4_K_M | 1.03 | 241.87 | Load/generate pass | Recommended default. |
|
| 37 |
+
| Q3_K_M | 0.87 | 203.60 | Load/generate pass | Lower-memory profile. |
|
| 38 |
+
| Q2_K | 0.74 | 231.70 | Load/generate pass | Aggressive low-memory profile. |
|
| 39 |
+
| IQ2_XS | 0.61 | 245.03 | Load/generate pass | Experimental. |
|
| 40 |
+
| IQ1_M | 0.54 | 252.02 | Load/generate pass | Experimental. |
|
| 41 |
+
| Q1_0 | 0.40 | 336.65 | Load/generate pass | Experimental / legacy minimum-memory option. |
|
| 42 |
+
|
| 43 |
+
The A10M generation figures were measured with single-stream `llama-bench` on
|
| 44 |
+
an NVIDIA A10M.
|
| 45 |
|
| 46 |
Q1/Q2 and the IQ variants can lose instruction following, reasoning, and
|
| 47 |
tool-call reliability. Validate the chosen file on the workload that matters
|