iMatrix-aware MLX-native mixed precision quantizations of Qwen/Qwen-AgentWorld-35B-A3B
🤝 Open to Collab
Matt
Basher17
AI & ML interests
Uploading high-quality MLX quantizations of models I use.
Recent Activity
liked a model about 23 hours ago
domyn/Domyn-Edge-SFT new activity 1 day ago
Aleph-Alpha/Kolibri-1:Can someone produce a oQ4e quant? reacted to gianlucamazza's post with 🔥 1 day ago
GGUF models from xllama's catalogue, my independent research project for local LLM inference on an Xbox Series S. Each note gives the measured figures or test status, with model, quant and setup. For example, LFM2.5-350M (QAD Q4_0, Dev Mode, llama.cpp CPU) decodes at 101.6 tok/s. Source for every number: xllama's model matrix. Not affiliated with Microsoft.
https://huggingface.co/collections/gianlucamazza/xllama-models-measured-on-xbox-series-s-6aca0b32275cbe99dbf02d89Organizations
models 24
Basher17/Swift-1.5-Qwen3.8-27b-oQ6e-mtp
28B • Updated • 92
Basher17/Qwen-AgentWorld-35B-A3B-oQ4e
Text Generation • 35B • Updated • 24
Basher17/Qwen-AgentWorld-35B-A3B-oQ6e
Text Generation • 35B • Updated • 10
Basher17/Qwen3.6-35B-A3B-oQ4e-mtp
Image-Text-to-Text • 36B • Updated • 23
Basher17/Qwen3.6-35B-A3B-oQ6e-mtp
Image-Text-to-Text • 36B • Updated • 30 • 1
Basher17/Agents-A1-oQ4e
Text Generation • 35B • Updated • 19 • 1
Basher17/Agents-A1-oQ6e
Text Generation • 35B • Updated • 16 • 1
Basher17/Ornith-1.0-35B-oQ4e
Text Generation • 35B • Updated • 13
Basher17/Ornith-1.0-35B-oQ6e
Text Generation • 35B • Updated • 16
Basher17/Qwen3.6-27B-oQ4e-mtp
Image-Text-to-Text • 28B • Updated • 16
datasets 0
None public yet