Instructions to use DavidAU/Qwen3.8-27B-Cold-Fusion-GAIN-V1.1 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use DavidAU/Qwen3.8-27B-Cold-Fusion-GAIN-V1.1 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("image-text-to-text", model="DavidAU/Qwen3.8-27B-Cold-Fusion-GAIN-V1.1") messages = [ { "role": "user", "content": [ {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"}, {"type": "text", "text": "What animal is on the candy?"} ] }, ] pipe(text=messages)# pip install -U transformers accelerate # Load model directly from transformers import AutoProcessor, AutoModelForMultimodalLM processor = AutoProcessor.from_pretrained("DavidAU/Qwen3.8-27B-Cold-Fusion-GAIN-V1.1") model = AutoModelForMultimodalLM.from_pretrained("DavidAU/Qwen3.8-27B-Cold-Fusion-GAIN-V1.1", device_map="auto") messages = [ { "role": "user", "content": [ {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"}, {"type": "text", "text": "What animal is on the candy?"} ] }, ] inputs = processor.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=256) print(processor.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Inference
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use DavidAU/Qwen3.8-27B-Cold-Fusion-GAIN-V1.1 with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "DavidAU/Qwen3.8-27B-Cold-Fusion-GAIN-V1.1" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "DavidAU/Qwen3.8-27B-Cold-Fusion-GAIN-V1.1", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }'Use Docker
docker model run hf.co/DavidAU/Qwen3.8-27B-Cold-Fusion-GAIN-V1.1
- SGLang
How to use DavidAU/Qwen3.8-27B-Cold-Fusion-GAIN-V1.1 with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "DavidAU/Qwen3.8-27B-Cold-Fusion-GAIN-V1.1" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "DavidAU/Qwen3.8-27B-Cold-Fusion-GAIN-V1.1", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "DavidAU/Qwen3.8-27B-Cold-Fusion-GAIN-V1.1" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "DavidAU/Qwen3.8-27B-Cold-Fusion-GAIN-V1.1", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }' - Unsloth Desktop
- Docker Model Runner
How to use DavidAU/Qwen3.8-27B-Cold-Fusion-GAIN-V1.1 with Docker Model Runner:
docker model run hf.co/DavidAU/Qwen3.8-27B-Cold-Fusion-GAIN-V1.1
Date & Code
Hi, I follow u for months and I see u do a lot for like roleplay, but will that model be good for coding too ? Do u have a approximation of the date the model will be ready ?
You do a f*cking amazing work thx a lot !
Hey ;
Thank you so much ;
Model will release in GGUF first; then source.
Release is based on performance eval and changes to the model.
At least a few days at this point, as hardware/testing is a bottleneck atm and eval of "non-tuned" vs "tuned" is getting special attn.
Really impressive to see how quickly Qwen 3.8 27B Cold Fusion / GAIN is progressing. I’m preparing a local AI setup with an RTX 3090 24GB and 128GB RAM, and Fable Fusion 711 was already one of my main candidates. I’m now following this 3.8 version very closely. Thank you for sharing the development process and your test results so openly with the community. I’m especially looking forward to the GGUF release.
3.6 27B Fable Fusion 711 turned out to be really a step up from the stock unsloth 3.6 27B quants.
Can’t wait to see what’s possible with 3.8!
Love to see you guys pushing the boundaries of the open weight frontier.
Hey all:
GGUFS released:
https://huggingface.co/DavidAU/Qwen3.8-27B-Cold-Fusion-GAIN-V1.1-NM-DAU-NEO-MAX-MTP-GGUF
Source released too;
Thank you for your patience and support.