--- base_model: Qwen/QwQ-32B license: apache-2.0 license_link: https://huggingface.co/Qwen/QWQ-32B/blob/main/LICENSE model_creator: Qwen model_name: QwQ-32B quantized_by: Second State Inc. language: - en pipeline_tag: text-generation tags: - chat --- # QwQ-32B-GGUF ## Original Model [Qwen/QwQ-32B](https://huggingface.co/Qwen/QwQ-32B) ## Run with Gaianet **Prompt template** prompt template: `chatml` **Context size** chat_ctx_size: `128000` **Run with GaiaNet** - Quick start: https://docs.gaianet.ai/node-guide/quick-start - Customize your node: https://docs.gaianet.ai/node-guide/customize *Quantized with llama.cpp b4831*