Qwen3-0.6B-Base

Qwen3 0.6B base causal LM, exported for loom.cpp.

This is a loom.cpp export: a single self-describing GGUF that carries its own graph topologies, tokenizer (if any) and driver script, produced by loom-exporter.

Original model

Exported from Qwen/Qwen3-0.6B-Base. Weights are unmodified; this repo packages the same parameters into loom.cpp's GGUF format.

License

apache-2.0, inherited from the base model above.

Language(s)

(none tagged upstream)

pre-trained on 119 languages and dialects; upstream publishes no per-language tag list

Usage

Run it with loom-py -- loom-py-rt on PyPI:

pip install -U "loom-py-rt[hub]"
import loom

model = loom.Model.from_pretrained("loom-ai-org/qwen3-0.6b-base-loom")
print(model.text2text.infer("The capital of France is", max_new_tokens=14))

The layer underneath

The call above is the high-level door: one per task, named for the modality pair it maps between, with the windowing, sampling and assembly this model needs already applied. Under it, model.infer(...) passes your arguments straight to the driver this GGUF embeds -- which is where you go for a knob the door does not name.

model.driver_source prints that driver, including a header comment documenting every argument it accepts for this model, and is the authority on it. See loom-py for the API and loom.cpp for what the engine does between the two.

Files

  • qwen3-0.6b-base.gguf -- the model, exported with loom-exporter.
Downloads last month
309
GGUF
Model size
0.6B params
Architecture
loom-qwen3
Hardware compatibility
Log In to add your hardware

We're not able to determine the quantization variants.

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for loom-ai-org/qwen3-0.6b-base-loom

Quantized
(81)
this model

Collection including loom-ai-org/qwen3-0.6b-base-loom