mlasli commited on
Commit
7c17c80
·
verified ·
1 Parent(s): 1153424

docs: document vision (mmproj) usage + changelog

Browse files
Files changed (1) hide show
  1. README.md +39 -0
README.md CHANGED
@@ -72,6 +72,45 @@ ollama run muse-glimmer-30b-heretic-q6_k
72
  - **RAM**: ~22 GB, very good quality
73
  - **VRAM offloading**: 12-24 GB recommended
74
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
75
  ## License
76
 
77
  Apache 2.0 (same as base model)
 
 
 
 
 
 
 
 
 
 
 
 
72
  - **RAM**: ~22 GB, very good quality
73
  - **VRAM offloading**: 12-24 GB recommended
74
 
75
+ ## Vision (Multimodal)
76
+
77
+ This model accepts image input when paired with a vision projector (`mmproj`).
78
+ Abliteration only modified the language backbone — the vision encoder is
79
+ untouched — so the standard Meta projector works directly with this repo.
80
+
81
+ This repository bundles `mmproj-Muse-Glimmer-30B-Q4_K_M.gguf` (~1.4 GB), Meta's official vision encoder
82
+ + projector for Muse Glimmer 30B.
83
+
84
+ ### Usage (llama.cpp)
85
+
86
+ ```bash
87
+ huggingface-cli download mlasli/Muse-Glimmer-30B-Heretic-Abliterated-Q6_K-GGUF \
88
+ --include "Muse-Glimmer-30B-Heretic-Abliterated-Q6_K.gguf" \
89
+ --include "mmproj-Muse-Glimmer-30B-Q4_K_M.gguf" \
90
+ --local-dir ./models
91
+
92
+ ./build/bin/llama-mtmd-cli \
93
+ -m ./models/Muse-Glimmer-30B-Heretic-Abliterated-Q6_K.gguf \
94
+ --mmproj ./models/mmproj-Muse-Glimmer-30B-Q4_K_M.gguf \
95
+ --image photo.png \
96
+ -p "Describe this image."
97
+ ```
98
+
99
+ > **Ollama note**: Ollama does not currently support separate `mmproj` files
100
+ > for this architecture. For image input, use llama.cpp (`llama-mtmd-cli` or
101
+ > `llama-server --mmproj`).
102
+
103
  ## License
104
 
105
  Apache 2.0 (same as base model)
106
+
107
+ ## Changelog
108
+
109
+ ### v1.1.0 — vision (multimodal) support (2026-08-16)
110
+
111
+ - Added `mmproj-Muse-Glimmer-30B-Q4_K_M.gguf` (~1.4 GB), Meta's official vision encoder + projector,
112
+ enabling image input via llama.cpp.
113
+ - The vision tower is untouched by abliteration, so this projector matches the
114
+ base model (`meta-models/Muse-Glimmer-30B`).
115
+ - v1.0.0 was the initial (unversioned) text-only upload.
116
+