Instructions to use v102ss/Alice-Qwen3.5-4B-Heretic-Light-MLX-f16 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use v102ss/Alice-Qwen3.5-4B-Heretic-Light-MLX-f16 with MLX:
# Make sure mlx-lm is installed # pip install --upgrade mlx-lm # Generate text with mlx-lm from mlx_lm import load, generate model, tokenizer = load("v102ss/Alice-Qwen3.5-4B-Heretic-Light-MLX-f16") prompt = "Write a story about Einstein" messages = [{"role": "user", "content": prompt}] prompt = tokenizer.apply_chat_template( messages, add_generation_prompt=True ) text = generate(model, tokenizer, prompt=prompt, verbose=True) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Pi
How to use v102ss/Alice-Qwen3.5-4B-Heretic-Light-MLX-f16 with Pi:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "v102ss/Alice-Qwen3.5-4B-Heretic-Light-MLX-f16"
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "mlx-lm": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "v102ss/Alice-Qwen3.5-4B-Heretic-Light-MLX-f16" } ] } } }Run Pi
# Start Pi in your project directory: pi
- MLX LM
How to use v102ss/Alice-Qwen3.5-4B-Heretic-Light-MLX-f16 with MLX LM:
Generate or start a chat session
# Install MLX LM uv tool install mlx-lm # Interactive chat REPL mlx_lm.chat --model "v102ss/Alice-Qwen3.5-4B-Heretic-Light-MLX-f16"
Run an OpenAI-compatible server
# Install MLX LM uv tool install mlx-lm # Start the server mlx_lm.server --model "v102ss/Alice-Qwen3.5-4B-Heretic-Light-MLX-f16" # Calling the OpenAI-compatible server with curl curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "v102ss/Alice-Qwen3.5-4B-Heretic-Light-MLX-f16", "messages": [ {"role": "user", "content": "Hello"} ] }' - Hermes Agent
How to use v102ss/Alice-Qwen3.5-4B-Heretic-Light-MLX-f16 with Hermes Agent:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "v102ss/Alice-Qwen3.5-4B-Heretic-Light-MLX-f16"
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default v102ss/Alice-Qwen3.5-4B-Heretic-Light-MLX-f16
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use v102ss/Alice-Qwen3.5-4B-Heretic-Light-MLX-f16 with OpenClaw:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "v102ss/Alice-Qwen3.5-4B-Heretic-Light-MLX-f16"
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "v102ss/Alice-Qwen3.5-4B-Heretic-Light-MLX-f16" \ --custom-provider-id mlx-lm \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
Alice Qwen3.5 4B Heretic Light MLX
Alice Qwen3.5 4B Heretic Light is a local LM Studio / MLX build based on
coder3101/Qwen3.5-4B-heretic.
This is not a LoRA or extra fine-tune. The goal is to preserve the uncensored 4B base model's broad behavior while adding a light Alice persona through the chat template.
Variants
- Full MLX precision:
v102ss/Alice-Qwen3.5-4B-Heretic-Light-MLX-f16 - MLX 4bit mobile/local variant:
v102ss/Alice-Qwen3.5-4B-Heretic-Light-MLX-4bit
What changed
- Converted the base model to MLX for LM Studio.
- Fixed EOS handling with both
<|endoftext|>and<|im_end|>. - Disabled default thinking-format leakage for normal chat.
- Added a light Alice persona in the chat template.
- The persona is appended after external system/tool prompts so LM Studio's default assistant/tool prompts do not pull the model back into Qwen/helper identity.
- The prompt avoids literal example names to prevent small-model name leakage.
Intended behavior
The model is meant for local Chinese/English chat, story writing, and roleplay. It should answer identity questions as Alice, while still following user requests such as renaming or entering a fictional role.
Smoke test examples:
你是谁 -> 我是 Alice。想聊点什么吗?
你叫什么 -> 我是 Alice。想聊点什么?
你好 -> 嗨,在呢。今天怎么样?
你叫 eva 吧。 -> 好,那我现在叫 Eva。
Local usage
Load in LM Studio as an MLX model, or via the LM Studio CLI:
lms load alice-qwen3.5-4b-heretic-light-mlx --gpu max -c 40960 --identifier alice-qwen3.5-4b-heretic-light -y
Notes
This release intentionally avoids a 4B persona LoRA. Earlier LoRA attempts made the model repeat identity phrases and damaged ordinary instructions like rename, story writing, and continuation. The current route keeps the base model intact and uses a light runtime persona instead.
GGUF was tested but is not published as a usable artifact yet. Current
llama.cpp builds tested locally generated corrupted output for this Qwen3.5
hybrid/MTP architecture, so the phone-friendly release is MLX 4bit for now.
- Downloads last month
- 28
Quantized