Image-Text-to-Text
Transformers
Safetensors
qwen3_5
onejev
system-one
decision-model
calibration
multimodal
gui-agent
video
conversational
Instructions to use OmniJev/OneJev1.6-9B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use OmniJev/OneJev1.6-9B with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("image-text-to-text", model="OmniJev/OneJev1.6-9B") messages = [ { "role": "user", "content": [ {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"}, {"type": "text", "text": "What animal is on the candy?"} ] }, ] pipe(text=messages)# pip install -U transformers accelerate # Load model directly from transformers import AutoProcessor, AutoModelForMultimodalLM processor = AutoProcessor.from_pretrained("OmniJev/OneJev1.6-9B") model = AutoModelForMultimodalLM.from_pretrained("OmniJev/OneJev1.6-9B", device_map="auto") messages = [ { "role": "user", "content": [ {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"}, {"type": "text", "text": "What animal is on the candy?"} ] }, ] inputs = processor.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=256) print(processor.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use OmniJev/OneJev1.6-9B with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "OmniJev/OneJev1.6-9B" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "OmniJev/OneJev1.6-9B", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }'Use Docker
docker model run hf.co/OmniJev/OneJev1.6-9B
- SGLang
How to use OmniJev/OneJev1.6-9B with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "OmniJev/OneJev1.6-9B" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "OmniJev/OneJev1.6-9B", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "OmniJev/OneJev1.6-9B" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "OmniJev/OneJev1.6-9B", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }' - Docker Model Runner
How to use OmniJev/OneJev1.6-9B with Docker Model Runner:
docker model run hf.co/OmniJev/OneJev1.6-9B
File size: 5,385 Bytes
ddd0fae e7c0118 ddd0fae e7c0118 ddd0fae e7c0118 ddd0fae e7c0118 89f1365 ddd0fae | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 | ---
license: apache-2.0
base_model: Qwen/Qwen3.5-9B
library_name: transformers
pipeline_tag: image-text-to-text
tags: [onejev, system-one, decision-model, calibration, multimodal, gui-agent, video]
---
<p align="center">
<picture>
<source media="(prefers-color-scheme: dark)" srcset="assets/banner-dark.svg">
<img alt="OneJev1.6-9B, a Multimodal System One Decision Model" src="assets/banner.svg" width="100%">
</picture>
</p>
<p align="center">
<a href="https://huggingface.co/OmniJev"><img alt="Hugging Face" src="https://img.shields.io/badge/Hugging_Face-OmniJev-FFD21E?style=flat-square&logo=huggingface&logoColor=black"></a>
<a href="https://github.com/OmniJev/OneJev"><img alt="GitHub" src="https://img.shields.io/badge/GitHub-OmniJev%2FOneJev-181717?style=flat-square&logo=github&logoColor=white"></a>
<a href="https://omnijev.github.io/OneJev/"><img alt="Website" src="https://img.shields.io/badge/Website-OneJev-0A84FF?style=flat-square&logo=googlechrome&logoColor=white"></a>
<a href="https://github.com/OmniJev/OneJev/blob/main/LICENSE"><img alt="License" src="https://img.shields.io/badge/License-Apache_2.0-D22128?style=flat-square&logo=apache&logoColor=white"></a>
</p>
OneJev1.6-9B is the 9B model of OneJev 1.6, a multimodal System One decision model. Give it a screenshot, a photo, a video or plain text along with a few typed questions, and it returns a calibrated probability for every option in a single forward pass. It is a full fine-tune of [Qwen/Qwen3.5-9B](https://huggingface.co/Qwen/Qwen3.5-9B) on about 440,000 questions drawn from real agent runs, videos, images and the training splits of public decision datasets.
## Decision Index
On the public part of [Decision Index 0.3](https://huggingface.co/spaces/multimodalart/jev-decision-index) (37 benchmarks, 140,178 requests, run and scored with the board's own kit), OneJev1.6-9B scores 65.31, up from 59.03 for OneJev1.5-9B. That is sixth of the 172 models on the board, and the five models above it all have 26B parameters or more. It has the best score in four of the five areas among the five models below.
<p align="center">
<picture>
<source media="(prefers-color-scheme: dark)" srcset="assets/di-class-table-dark.svg">
<img alt="Decision Index public part, table: OneJev1.6-9B 65.31 against Nace.AI Drex v1.5 58.08, vLLM-SR d3-flash (9B) 57.79, Standard One 8B SH (v4) 57.40, Bespoke Nimble 9B v3 57.19, overall and in each of the five areas; best value in each row in magenta, second best in light pink" src="assets/di-class-table.svg" width="100%">
</picture>
</p>
The four other models are the highest-scoring models of 6B to 12B parameters on the board.
It also scores above 52 of the 57 models of 25B to 36B parameters on the board.
<p align="center">
<picture>
<source media="(prefers-color-scheme: dark)" srcset="assets/di-larger-dark.svg">
<img alt="Decision Index public part: OneJev1.6-9B 65.3 at 9.4B parameters against Torchcast Decision 65.1, Amos 1 Large 64.9, Decider 31B 64.3, linne-oak 1.0 63.9, span-02 26B-A4B 63.6, Matilda Jev v1.5 63.5 at 26B to 33B" src="assets/di-larger.svg" width="100%">
</picture>
</p>
Other models' scores are their public-part scores on the board on 16 October 2026.
## Results
<p align="center">
<picture>
<source media="(prefers-color-scheme: dark)" srcset="assets/results-dark.svg">
<img alt="Results table: OneJev1.6-9B against Jev 1.13, Jev-Omni 12B and Qwen3.8-27B thinking; best score in each row in magenta, second best in light pink" src="assets/results.svg" width="100%">
</picture>
</p>
Accuracy in percent. The OneJev test set holds questions of the training kinds that no model saw in training. Jev 1.13's scores are its published ones, and it reads text only.
## Quick start
```bash
uv venv -p 3.12 && source .venv/bin/activate
uv pip install flide torchvision
flide serve --model OmniJev/OneJev1.6-9B
```
In another terminal, run this example with your own `screenshot.png`:
```bash
IMG=$(base64 -w0 screenshot.png)
curl http://localhost:8000/v1/systemone -H "Content-Type: application/json" -d @- <<EOF
{
"state": {"task": "Pay the open invoice from ACME", "screen": "<image:1>"},
"media": [{"type": "image", "data": "data:image/png;base64,$IMG"}],
"questions": {
"done": {"type": "noul", "instructions": "The invoice has been paid"},
"next": {"type": "choice", "instructions": "What should the agent do next?",
"criteria": {"click": "click an element", "type": "type text", "scroll": "scroll", "stop": "stop"}},
"progress": {"type": "score", "instructions": "How far along is the task?",
"criteria": ["not started", "halfway", "almost done", "done"]}
}
}
EOF
```
`answers.done.noul` is the probability of yes, `answers.next.probabilities` gives one probability per option and `answers.progress.score` is the expected level.
[Flide](https://github.com/OmniJev/Flide) ([paper](https://arxiv.org/abs/2610.42148)) serves TypeSafe's System One API plus a `media` field for images and video. More examples are on [GitHub](https://github.com/OmniJev/OneJev).
## Citation
```bibtex
@misc{onejev2026,
title = {{OneJev}: A Multimodal System One Decision Model},
author = {{OmniJev Team}},
year = {2026},
howpublished = {\url{https://github.com/OmniJev/OneJev}}
}
```
## License
Apache 2.0
|