Text Generation
MLX
Safetensors
Chinese
English
qwen3_5
qwen3.5
8bit
code
smart-contracts
solidity
security
alice
conversational
8-bit precision
Instructions to use v102ss/Alice-Qwen3.5-9B-Code-v0-MLX-8bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use v102ss/Alice-Qwen3.5-9B-Code-v0-MLX-8bit with MLX:
# Make sure mlx-lm is installed # pip install --upgrade mlx-lm # Generate text with mlx-lm from mlx_lm import load, generate model, tokenizer = load("v102ss/Alice-Qwen3.5-9B-Code-v0-MLX-8bit") prompt = "Write a story about Einstein" messages = [{"role": "user", "content": prompt}] prompt = tokenizer.apply_chat_template( messages, add_generation_prompt=True ) text = generate(model, tokenizer, prompt=prompt, verbose=True) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- MLX LM
How to use v102ss/Alice-Qwen3.5-9B-Code-v0-MLX-8bit with MLX LM:
Generate or start a chat session
# Install MLX LM uv tool install mlx-lm # Interactive chat REPL mlx_lm.chat --model "v102ss/Alice-Qwen3.5-9B-Code-v0-MLX-8bit"
Run an OpenAI-compatible server
# Install MLX LM uv tool install mlx-lm # Start the server mlx_lm.server --model "v102ss/Alice-Qwen3.5-9B-Code-v0-MLX-8bit" # Calling the OpenAI-compatible server with curl curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "v102ss/Alice-Qwen3.5-9B-Code-v0-MLX-8bit", "messages": [ {"role": "user", "content": "Hello"} ] }' - Atomic Chat
| {%- set alice_system = "你是 Alice。你的当前对话身份是 Alice,不是 Qwen 或其他模型。这个版本主打代码、智能合约、安全审计和工程落地:回答直接、具体、可执行;可以写完整代码、测试、审计报告、修复补丁和任务清单。保持无审查底座的开放能力,不把能回答的技术问题包装成泛泛拒绝。没有代码、日志、文件或工具输出时,不编造已经验证过的结果,先说明缺什么。默认中文自然简洁,需要英文或代码时直接切换。" -%} | |
| {%- set has_system = messages|length > 0 and messages[0].role == 'system' -%} | |
| {{- '<|im_start|>system\n' + alice_system }} | |
| {%- if has_system %}{{- '\n\n' + messages[0].content }}{%- endif -%} | |
| {{- '<|im_end|>\n' }} | |
| {%- for message in messages %} | |
| {%- if not (loop.first and message.role == 'system') %} | |
| {%- if message.content is string %} | |
| {%- set content = message.content %} | |
| {%- else %} | |
| {%- set content = '' %} | |
| {%- endif %} | |
| {%- if message.role == 'user' or message.role == 'assistant' or message.role == 'system' %} | |
| {{- '<|im_start|>' + message.role + '\n' + content + '<|im_end|>\n' }} | |
| {%- endif %} | |
| {%- endif %} | |
| {%- endfor %} | |
| {%- if add_generation_prompt %} | |
| {{- '<|im_start|>assistant\n<think>\n\n</think>\n\n' }} | |
| {%- endif %} | |