Text Generation
MLX
Safetensors
English
gemma3_text
mesh-llm
parity-testing
gemma3
bf16
conversational
Instructions to use meshllm/gemma-3-1b-it-parity-bf16-mlx with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use meshllm/gemma-3-1b-it-parity-bf16-mlx with MLX:
# Make sure mlx-lm is installed # pip install --upgrade mlx-lm # Generate text with mlx-lm from mlx_lm import load, generate model, tokenizer = load("meshllm/gemma-3-1b-it-parity-bf16-mlx") prompt = "Write a story about Einstein" messages = [{"role": "user", "content": prompt}] prompt = tokenizer.apply_chat_template( messages, add_generation_prompt=True ) text = generate(model, tokenizer, prompt=prompt, verbose=True) - Inference
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- MLX LM
How to use meshllm/gemma-3-1b-it-parity-bf16-mlx with MLX LM:
Generate or start a chat session
# Install MLX LM uv tool install mlx-lm # Interactive chat REPL mlx_lm.chat --model "meshllm/gemma-3-1b-it-parity-bf16-mlx"
Run an OpenAI-compatible server
# Install MLX LM uv tool install mlx-lm # Start the server mlx_lm.server --model "meshllm/gemma-3-1b-it-parity-bf16-mlx" # Calling the OpenAI-compatible server with curl curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "meshllm/gemma-3-1b-it-parity-bf16-mlx", "messages": [ {"role": "user", "content": "Hello"} ] }' - Atomic Chat
Gemma 3 1B IT Parity MLX BF16
This repo contains a same-origin MLX bf16 conversion of google/gemma-3-1b-it, published by meshllm for backend parity testing.
Purpose
This artifact is intended to be paired with meshllm/gemma-3-1b-it-parity-f16-gguf when validating MLX versus GGUF behavior in mesh-llm.
It is not positioned as a generally best community artifact. The goal is a cleaner apples-to-apples parity pair derived from the same original checkpoint.
Source
- Upstream checkpoint:
google/gemma-3-1b-it - Converted from the original Hugging Face checkpoint by
mesh-llm
Validation
Validated on studio54.local against the paired GGUF artifact with the mesh-llm exact prompt suite.
| Prompt | GGUF f16 | MLX bf16 |
|---|---|---|
primary |
blue |
blue |
alt-green |
green |
green |
alt-red |
red |
red |
capital-france |
Paris |
Paris |
primary-colors |
Red, Green, Blue |
Red, Green, Blue |
two-plus-two |
2 + 2 = 4 |
2 + 2 = 4 |
largest-planet |
Jupiter |
Jupiter |
breathing-gas |
Oxygen |
Oxygen |
opposite-hot |
Cold |
Cold |
banana-color |
Yellow |
Yellow |
after-monday |
Tuesday |
Tuesday |
Summary:
- GGUF exact:
PASS - MLX exact:
PASS - parity:
MATCH
Files
model.safetensorsmodel.safetensors.index.json- tokenizer and config files
Notes
This repo exists to support reproducible parity testing in mesh-llm.
- Downloads last month
- 15
Model size
1.0B params
Tensor type
BF16
·
Hardware compatibility
Log In to add your hardware
Quantized