═══ Q8_0 ═══
| model                          |       size |     params | backend    | ngl |            test |                  t/s |
| ------------------------------ | ---------: | ---------: | ---------- | --: | --------------: | -------------------: |
| spark2_5 ?B Q8_0               |   4.07 GiB |     4.11 B | Vulkan     |  99 |           pp512 |      2039.45 ± 11.89 |
| spark2_5 ?B Q8_0               |   4.07 GiB |     4.11 B | Vulkan     |  99 |           tg128 |         69.49 ± 0.11 |

build: 4a3635c32 (10514)
═══ Q6_K ═══
| model                          |       size |     params | backend    | ngl |            test |                  t/s |
| ------------------------------ | ---------: | ---------: | ---------- | --: | --------------: | -------------------: |
| spark2_5 ?B Q6_K               |   3.14 GiB |     4.11 B | Vulkan     |  99 |           pp512 |       1843.87 ± 5.20 |
| spark2_5 ?B Q6_K               |   3.14 GiB |     4.11 B | Vulkan     |  99 |           tg128 |         70.48 ± 0.02 |

build: 4a3635c32 (10514)
═══ Q5_K_M ═══
| model                          |       size |     params | backend    | ngl |            test |                  t/s |
| ------------------------------ | ---------: | ---------: | ---------- | --: | --------------: | -------------------: |
| spark2_5 ?B Q5_K - Medium      |   2.77 GiB |     4.11 B | Vulkan     |  99 |           pp512 |       1949.32 ± 9.95 |
| spark2_5 ?B Q5_K - Medium      |   2.77 GiB |     4.11 B | Vulkan     |  99 |           tg128 |         79.81 ± 0.64 |

build: 4a3635c32 (10514)
═══ Q4_K_M ═══
| model                          |       size |     params | backend    | ngl |            test |                  t/s |
| ------------------------------ | ---------: | ---------: | ---------- | --: | --------------: | -------------------: |
| spark2_5 ?B Q4_K - Medium      |   2.42 GiB |     4.11 B | Vulkan     |  99 |           pp512 |       2003.62 ± 1.34 |
| spark2_5 ?B Q4_K - Medium      |   2.42 GiB |     4.11 B | Vulkan     |  99 |           tg128 |         93.31 ± 0.53 |

build: 4a3635c32 (10514)
═══ IQ4_NL ═══
| model                          |       size |     params | backend    | ngl |            test |                  t/s |
| ------------------------------ | ---------: | ---------: | ---------- | --: | --------------: | -------------------: |
| spark2_5 ?B IQ4_NL - 4.5 bpw   |   2.30 GiB |     4.11 B | Vulkan     |  99 |           pp512 |       2079.09 ± 2.51 |
| spark2_5 ?B IQ4_NL - 4.5 bpw   |   2.30 GiB |     4.11 B | Vulkan     |  99 |           tg128 |         53.87 ± 0.04 |

build: 4a3635c32 (10514)
═══ Q3_K_M ═══
| model                          |       size |     params | backend    | ngl |            test |                  t/s |
| ------------------------------ | ---------: | ---------: | ---------- | --: | --------------: | -------------------: |
| spark2_5 ?B Q3_K - Medium      |   2.01 GiB |     4.11 B | Vulkan     |  99 |           pp512 |      1893.78 ± 41.34 |
| spark2_5 ?B Q3_K - Medium      |   2.01 GiB |     4.11 B | Vulkan     |  99 |           tg128 |         95.29 ± 0.10 |

build: 4a3635c32 (10514)
═══ IQ3_M ═══
| model                          |       size |     params | backend    | ngl |            test |                  t/s |
| ------------------------------ | ---------: | ---------: | ---------- | --: | --------------: | -------------------: |
| spark2_5 ?B IQ3_S mix - 3.66 bpw |   1.90 GiB |     4.11 B | Vulkan     |  99 |           pp512 |       1969.10 ± 7.31 |
| spark2_5 ?B IQ3_S mix - 3.66 bpw |   1.90 GiB |     4.11 B | Vulkan     |  99 |           tg128 |         76.39 ± 0.48 |

build: 4a3635c32 (10514)
═══ IQ2_M ═══
| model                          |       size |     params | backend    | ngl |            test |                  t/s |
| ------------------------------ | ---------: | ---------: | ---------- | --: | --------------: | -------------------: |
| spark2_5 ?B IQ2_M - 2.7 bpw    |   1.52 GiB |     4.11 B | Vulkan     |  99 |           pp512 |       2047.56 ± 7.56 |
| spark2_5 ?B IQ2_M - 2.7 bpw    |   1.52 GiB |     4.11 B | Vulkan     |  99 |           tg128 |         46.36 ± 0.01 |

build: 4a3635c32 (10514)