Instructions to use DreamFoundries/supergemma4-26b-abliterated-multimodal-4bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use DreamFoundries/supergemma4-26b-abliterated-multimodal-4bit with MLX:
# Make sure mlx-lm is installed # pip install --upgrade mlx-lm # Generate text with mlx-lm from mlx_lm import load, generate model, tokenizer = load("DreamFoundries/supergemma4-26b-abliterated-multimodal-4bit") prompt = "Write a story about Einstein" messages = [{"role": "user", "content": prompt}] prompt = tokenizer.apply_chat_template( messages, add_generation_prompt=True ) text = generate(model, tokenizer, prompt=prompt, verbose=True) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- MLX LM
How to use DreamFoundries/supergemma4-26b-abliterated-multimodal-4bit with MLX LM:
Generate or start a chat session
# Install MLX LM uv tool install mlx-lm # Interactive chat REPL mlx_lm.chat --model "DreamFoundries/supergemma4-26b-abliterated-multimodal-4bit"
Run an OpenAI-compatible server
# Install MLX LM uv tool install mlx-lm # Start the server mlx_lm.server --model "DreamFoundries/supergemma4-26b-abliterated-multimodal-4bit" # Calling the OpenAI-compatible server with curl curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "DreamFoundries/supergemma4-26b-abliterated-multimodal-4bit", "messages": [ {"role": "user", "content": "Hello"} ] }' - Atomic Chat
Mueve Download MLXHub al final del documento
Browse files
README.md
CHANGED
|
@@ -12,8 +12,6 @@ tags:
|
|
| 12 |
---
|
| 13 |
|
| 14 |
[](https://mlxhub.app/open-model?repo=DreamFoundries/supergemma4-26b-abliterated-multimodal-4bit)
|
| 15 |
-
[](https://apps.apple.com/app/apple-store/id6766485144?pt=121945436&ct=HuggingFace&mt=8)
|
| 16 |
-
|
| 17 |
|
| 18 |
# supergemma4-26b-abliterated-multimodal MLX 4-bit
|
| 19 |
|
|
@@ -52,3 +50,7 @@ No comparative benchmarks have been run yet. The repository does not currently p
|
|
| 52 |
## License
|
| 53 |
|
| 54 |
This is a converted/quantized derivative of the original model. Please refer to the original model repository for the upstream license and usage terms: https://huggingface.co/Jiunsong/supergemma4-26b-abliterated-multimodal
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 12 |
---
|
| 13 |
|
| 14 |
[](https://mlxhub.app/open-model?repo=DreamFoundries/supergemma4-26b-abliterated-multimodal-4bit)
|
|
|
|
|
|
|
| 15 |
|
| 16 |
# supergemma4-26b-abliterated-multimodal MLX 4-bit
|
| 17 |
|
|
|
|
| 50 |
## License
|
| 51 |
|
| 52 |
This is a converted/quantized derivative of the original model. Please refer to the original model repository for the upstream license and usage terms: https://huggingface.co/Jiunsong/supergemma4-26b-abliterated-multimodal
|
| 53 |
+
|
| 54 |
+
---
|
| 55 |
+
|
| 56 |
+
[](https://apps.apple.com/app/apple-store/id6766485144?pt=121945436&ct=HuggingFace&mt=8)
|