DreamFoundries commited on
Commit
ee1877e
·
verified ·
1 Parent(s): bc55c64

Upload README.md

Browse files
Files changed (1) hide show
  1. README.md +50 -0
README.md ADDED
@@ -0,0 +1,50 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: mlx
3
+ base_model: Jiunsong/supergemma4-26b-abliterated-multimodal
4
+ license: gemma
5
+ pipeline_tag: text-generation
6
+ tags:
7
+ - mlx
8
+ - mlx-lm
9
+ - quantized
10
+ - 4-bit
11
+ - base_model:Jiunsong/supergemma4-26b-abliterated-multimodal
12
+ ---
13
+
14
+ # supergemma4-26b-abliterated-multimodal MLX 4-bit
15
+
16
+ This repository contains an MLX-LM conversion of [Jiunsong/supergemma4-26b-abliterated-multimodal](https://huggingface.co/Jiunsong/supergemma4-26b-abliterated-multimodal).
17
+
18
+ ## Conversion Details
19
+
20
+ - Original model: `Jiunsong/supergemma4-26b-abliterated-multimodal`
21
+ - Model family: SuperGemma4
22
+ - Source model type: `gemma4`
23
+ - Model size: 25,805,936,206 parameters
24
+ - Quantization: MLX-LM affine quantization
25
+ - Bits: 4-bit
26
+ - Group size: 64
27
+ - Local MLX folder size at upload time: 13.26 GiB
28
+ - Local safetensors weight size at upload time: 13.22 GiB
29
+
30
+ This Gemma conversion follows the MLX-LM Gemma 4 shared-KV topology and uses non-strict checkpoint loading so extra HF tensors outside that topology are discarded during conversion.
31
+
32
+ For mlx-swift compatibility, `per_layer_model_projection` was left unquantized while the rest of the eligible linear layers were quantized.
33
+
34
+ For oMLX / mlx-swift chat-template compatibility, the published MLX package uses a simplified Gemma 4 chat template based on the `<|turn>role\n...<turn|>` format. The original upstream `chat_template.jinja` is preserved as `chat_template.original.jinja`.
35
+
36
+ Abliteration credit: the abliterated source model was published by [Jiunsong](https://huggingface.co/Jiunsong). This repository only provides the MLX conversion and quantization.
37
+
38
+ ## Usage
39
+
40
+ ```bash
41
+ mlx_lm.generate --model DreamFoundries/supergemma4-26b-abliterated-multimodal-4bit --prompt "Hello" --max-tokens 64
42
+ ```
43
+
44
+ ## Benchmarks
45
+
46
+ No comparative benchmarks have been run yet. The repository does not currently provide quality, speed, memory, or benchmark comparisons against the original weights or other quantizations.
47
+
48
+ ## License
49
+
50
+ This is a converted/quantized derivative of the original model. Please refer to the original model repository for the upstream license and usage terms: https://huggingface.co/Jiunsong/supergemma4-26b-abliterated-multimodal