Instructions to use VextLabsinc/juwel-garnet with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use VextLabsinc/juwel-garnet with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="VextLabsinc/juwel-garnet")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# pip install -U transformers accelerate
# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("VextLabsinc/juwel-garnet")
model = AutoModelForCausalLM.from_pretrained("VextLabsinc/juwel-garnet", device_map="auto")
messages = [
    {"role": "user", "content": "Who are you?"},
]
inputs = tokenizer.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=256)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use VextLabsinc/juwel-garnet with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "VextLabsinc/juwel-garnet"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "VextLabsinc/juwel-garnet",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/VextLabsinc/juwel-garnet

SGLang

How to use VextLabsinc/juwel-garnet with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "VextLabsinc/juwel-garnet" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "VextLabsinc/juwel-garnet",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "VextLabsinc/juwel-garnet" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "VextLabsinc/juwel-garnet",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use VextLabsinc/juwel-garnet with Docker Model Runner:
```
docker model run hf.co/VextLabsinc/juwel-garnet
```

JUWEL Garnet

Release status: MIRRORED_STRUCTURAL_PASS. Every mirrored object matched the pinned public-R2 inventory, was SHA-256 hashed, and passed Hugging Face readback. Safetensors shards also matched the published index at header/tensor/offset level.

This repository contains public model weights mirrored from Vext Labs' already-public Cloudflare R2 release at https://pub-a6ae0476e46849f98f1746a61dc4c106.r2.dev/juwel-garnet. It is not JUWEL's own-weights flagship Theta, and this card makes no SOTA, production-safety, or benchmark claim.

Artifact-derived specification

Architecture: Qwen3NextForCausalLM
Geometry: 79,674,391,296 total parameters; BF16; 48 layers; hidden size 2,048; 16 attention heads / 2 KV heads; 512 experts with 10 selected per token; 262,144-token configured context; vocabulary 151,936
Package: 32 safetensors shards; 74,391 indexed tensors; 159,348,782,592 tensor bytes
Lineage: Qwen3-Next architecture family. The recovered release metadata does not bind an exact upstream revision; no endorsement by Qwen is implied.

The exact source inventory and file hashes are recorded in mirror-receipts/8a709d9a3601cc0b568118ffdc442112c45eab29c2465219d711bdb5fbbac025.json.

Loading

from transformers import AutoModelForCausalLM

repo = "VextLabsinc/juwel-garnet"
model = AutoModelForCausalLM.from_pretrained(repo, torch_dtype="auto", device_map="auto")

These are large BF16 artifacts. Use hardware and sharding appropriate to the package size.

Verification and limitations

The release receipt proves source inventory binding, full-file SHA-256, safetensors structural consistency, and destination byte readback. It does not prove full GPU inference, output quality, training-data provenance, safety behavior, or production fitness. Capability evaluation is pending. Review the exact configuration and receipt before use.

License

Apache License 2.0. The complete license text is in LICENSE. “Qwen” describes architecture lineage only and does not imply upstream endorsement. This repository includes no additional field-of-use restriction; Apache-2.0 governs the mirrored files. This is an Apache-licensed open-weight release, not a claim that the package satisfies the OSI Open Source AI Definition, which also considers training-data information and modification materials.

Downloads last month: 31

Safetensors

Model size

80B params

Tensor type

BF16