ngquocvinh commited on
Commit
e2d0592
·
verified ·
1 Parent(s): ff4a438

Standardize GGUF model card structure

Browse files

Align front matter, quantization tables, validation wording, benchmark wording, and support layout with Model_card.md.

Files changed (1) hide show
  1. README.md +15 -14
README.md CHANGED
@@ -1,6 +1,7 @@
1
  ---
2
  license: apache-2.0
3
  base_model: XHToken/Spark-X2.5-1.7B
 
4
  library_name: llama.cpp
5
  pipeline_tag: text-generation
6
  tags:
@@ -27,20 +28,20 @@ Thank you for supporting this work.
27
 
28
  ## Files
29
 
30
- | Quantization | Size | A10M generation | Recommendation |
31
- |---|---:|---:|---|
32
- | Q8_0 | 1.70 GiB | 175.54 tok/s | High quality |
33
- | Q6_K | 1.31 GiB | 199.07 tok/s | High quality |
34
- | Q5_K_M | 1.17 GiB | 223.04 tok/s | Daily use |
35
- | Q4_K_M | 1.03 GiB | 241.87 tok/s | Recommended default |
36
- | Q3_K_M | 0.87 GiB | 203.60 tok/s | Lower memory |
37
- | Q2_K | 0.74 GiB | 231.70 tok/s | Aggressive |
38
- | IQ2_XS | 0.61 GiB | 245.03 tok/s | Experimental |
39
- | IQ1_M | 0.54 GiB | 252.02 tok/s | Experimental |
40
- | Q1_0 | 0.40 GiB | 336.65 tok/s | Experimental / legacy |
41
-
42
- The speed figures are single-stream `llama-bench` readings on one NVIDIA
43
- A10M. They are not quality scores or universal hardware benchmarks.
44
 
45
  Q1/Q2 and the IQ variants can lose instruction following, reasoning, and
46
  tool-call reliability. Validate the chosen file on the workload that matters
 
1
  ---
2
  license: apache-2.0
3
  base_model: XHToken/Spark-X2.5-1.7B
4
+ base_model_relation: quantized
5
  library_name: llama.cpp
6
  pipeline_tag: text-generation
7
  tags:
 
28
 
29
  ## Files
30
 
31
+ | Quantization | File size (GiB) | A10M generation token/s | Validation | Recommendation / Notes |
32
+ |---|---:|---:|---|---|
33
+ | Q8_0 | 1.70 | 175.54 | Load/generate pass | High quality. |
34
+ | Q6_K | 1.31 | 199.07 | Load/generate pass | High quality. |
35
+ | Q5_K_M | 1.17 | 223.04 | Load/generate pass | Daily use. |
36
+ | Q4_K_M | 1.03 | 241.87 | Load/generate pass | Recommended default. |
37
+ | Q3_K_M | 0.87 | 203.60 | Load/generate pass | Lower-memory profile. |
38
+ | Q2_K | 0.74 | 231.70 | Load/generate pass | Aggressive low-memory profile. |
39
+ | IQ2_XS | 0.61 | 245.03 | Load/generate pass | Experimental. |
40
+ | IQ1_M | 0.54 | 252.02 | Load/generate pass | Experimental. |
41
+ | Q1_0 | 0.40 | 336.65 | Load/generate pass | Experimental / legacy minimum-memory option. |
42
+
43
+ The A10M generation figures were measured with single-stream `llama-bench` on
44
+ an NVIDIA A10M.
45
 
46
  Q1/Q2 and the IQ variants can lose instruction following, reasoning, and
47
  tool-call reliability. Validate the chosen file on the workload that matters