Instructions to use Dassem/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-endangered_gregarious_wolf with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use Dassem/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-endangered_gregarious_wolf with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="Dassem/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-endangered_gregarious_wolf")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("Dassem/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-endangered_gregarious_wolf")
model = AutoModelForCausalLM.from_pretrained("Dassem/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-endangered_gregarious_wolf", device_map="auto")
messages = [
    {"role": "user", "content": "Who are you?"},
]
inputs = tokenizer.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Inference
Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use Dassem/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-endangered_gregarious_wolf with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "Dassem/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-endangered_gregarious_wolf"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Dassem/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-endangered_gregarious_wolf",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/Dassem/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-endangered_gregarious_wolf

SGLang

How to use Dassem/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-endangered_gregarious_wolf with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "Dassem/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-endangered_gregarious_wolf" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Dassem/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-endangered_gregarious_wolf",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "Dassem/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-endangered_gregarious_wolf" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Dassem/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-endangered_gregarious_wolf",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use Dassem/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-endangered_gregarious_wolf with Docker Model Runner:
```
docker model run hf.co/Dassem/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-endangered_gregarious_wolf
```

Dassem commited on Apr 26, 2025

Commit

8eb1974

verified ·

1 Parent(s): 3de2e34

End of training

Browse files

Files changed (4) hide show

all_results.json +4 -4
model.safetensors +1 -1
train_results.json +4 -4
trainer_state.json +103 -103

all_results.json CHANGED Viewed

@@ -1,8 +1,8 @@
 {
     "total_flos": 0.0,
-    "train_loss": 2.1981075406074522e-06,
-    "train_runtime": 238.9914,
     "train_samples": 28,
-    "train_samples_per_second": 1.339,
-    "train_steps_per_second": 0.084
 }

 {
     "total_flos": 0.0,
+    "train_loss": 0.00033479593694210055,
+    "train_runtime": 231.6976,
     "train_samples": 28,
+    "train_samples_per_second": 1.381,
+    "train_steps_per_second": 0.086
 }

model.safetensors CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:2dd358a1b01bbe068a2fff10d8b6c4eb8f3f3048c80d6d6c748abf5de51c54dc
 size 1976163472

 version https://git-lfs.github.com/spec/v1
+oid sha256:14fe754ffe1ecbffe7d98aae66dff6e7c9c593717225aa953f6e93197632ec59
 size 1976163472

train_results.json CHANGED Viewed

@@ -1,8 +1,8 @@
 {
     "total_flos": 0.0,
-    "train_loss": 2.1981075406074522e-06,
-    "train_runtime": 238.9914,
     "train_samples": 28,
-    "train_samples_per_second": 1.339,
-    "train_steps_per_second": 0.084
 }

 {
     "total_flos": 0.0,
+    "train_loss": 0.00033479593694210055,
+    "train_runtime": 231.6976,
     "train_samples": 28,
+    "train_samples_per_second": 1.381,
+    "train_steps_per_second": 0.086
 }

trainer_state.json CHANGED Viewed

@@ -10,203 +10,203 @@
   "is_world_process_zero": true,
   "log_history": [
     {
-      "completion_length": 404.71875,
       "epoch": 0.5714285714285714,
-      "grad_norm": 6.518460273742676,
       "kl": 0.0,
       "learning_rate": 5e-07,
       "loss": -0.0,
-      "reward": 0.5893436572514474,
-      "reward_std": 0.5874896345194429,
-      "rewards/concensus_correctness_reward_func": 0.0,
-      "rewards/consensus_reward_func": 0.0,
       "rewards/cumulative_reward_2": 0.0,
-      "rewards/final_correctness_reward_func": 0.0625,
-      "rewards/question_recreation_reward_func": 0.36315615847706795,
-      "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
-      "rewards/xmlcount_reward_func": 0.16368748992681503,
       "step": 2
     },
     {
-      "completion_length": 407.625,
       "epoch": 1.0,
-      "grad_norm": 2.0946500301361084,
-      "kl": 0.0010950821839893858,
       "learning_rate": 4.864543104251586e-07,
       "loss": 0.0,
-      "reward": 1.126553826034069,
-      "reward_std": 1.2074061188225944,
-      "rewards/concensus_correctness_reward_func": 0.08008333543936412,
-      "rewards/consensus_reward_func": 0.16666666666666666,
       "rewards/cumulative_reward_2": 0.0,
       "rewards/final_correctness_reward_func": 0.3333333333333333,
-      "rewards/question_recreation_reward_func": 0.43688717236121494,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
-      "rewards/xmlcount_reward_func": 0.10958333810170491,
       "step": 4
     },
     {
-      "completion_length": 353.03125,
       "epoch": 1.5714285714285714,
-      "grad_norm": 4.787725925445557,
-      "kl": 0.001183775435492862,
       "learning_rate": 4.472851273490984e-07,
       "loss": 0.0,
-      "reward": 0.6702903280965984,
-      "reward_std": 1.044001815840602,
-      "rewards/concensus_correctness_reward_func": 0.015687499195337296,
-      "rewards/consensus_reward_func": 0.0625,
       "rewards/cumulative_reward_2": 0.0,
-      "rewards/final_correctness_reward_func": 0.1875,
-      "rewards/question_recreation_reward_func": 0.43188407085835934,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
-      "rewards/xmlcount_reward_func": -0.027281240094453096,
       "step": 6
     },
     {
-      "completion_length": 357.3333333333333,
       "epoch": 2.0,
-      "grad_norm": 2.877178192138672,
-      "kl": 0.001542089506983757,
       "learning_rate": 3.867370395306068e-07,
-      "loss": 0.0,
-      "reward": 1.1698723242928584,
-      "reward_std": 0.694885604083538,
-      "rewards/concensus_correctness_reward_func": 0.05900000035762787,
-      "rewards/consensus_reward_func": 0.25,
       "rewards/cumulative_reward_2": 0.0,
-      "rewards/final_correctness_reward_func": 0.0,
-      "rewards/question_recreation_reward_func": 0.4612890009302646,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
-      "rewards/xmlcount_reward_func": 0.39958332665264606,
       "step": 8
     },
     {
-      "completion_length": 378.25,
       "epoch": 2.571428571428571,
-      "grad_norm": 5.456356525421143,
-      "kl": 0.001907730347738834,
       "learning_rate": 3.1137137178519977e-07,
       "loss": 0.0,
-      "reward": 0.8588828789070249,
-      "reward_std": 0.554644065501634,
       "rewards/concensus_correctness_reward_func": 0.0,
       "rewards/consensus_reward_func": 0.0,
       "rewards/cumulative_reward_2": 0.0,
-      "rewards/final_correctness_reward_func": 0.25,
-      "rewards/question_recreation_reward_func": 0.3871328839159105,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
-      "rewards/xmlcount_reward_func": 0.2217499972321093,
       "step": 10
     },
     {
-      "completion_length": 397.6666666666667,
       "epoch": 3.0,
-      "grad_norm": 51.970638275146484,
-      "kl": 0.004510083332813035,
       "learning_rate": 2.2935516363191693e-07,
       "loss": 0.0,
-      "reward": 1.7957529959579308,
-      "reward_std": 1.9038519627647474,
-      "rewards/concensus_correctness_reward_func": 0.8333333333333334,
       "rewards/consensus_reward_func": 0.08333333333333333,
       "rewards/cumulative_reward_2": 0.0,
-      "rewards/final_correctness_reward_func": 0.16666666666666666,
-      "rewards/question_recreation_reward_func": 0.3622947046533227,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
-      "rewards/xmlcount_reward_func": 0.35012500003601116,
       "step": 12
     },
     {
-      "completion_length": 360.625,
       "epoch": 3.571428571428571,
-      "grad_norm": 6.127416610717773,
-      "kl": 0.007428915887430776,
       "learning_rate": 1.4957614383675767e-07,
-      "loss": 0.0,
-      "reward": 0.6956972822081298,
-      "reward_std": 0.6463675515260547,
-      "rewards/concensus_correctness_reward_func": 0.019625000655651093,
-      "rewards/consensus_reward_func": 0.0,
       "rewards/cumulative_reward_2": 0.0,
-      "rewards/final_correctness_reward_func": 0.1875,
-      "rewards/question_recreation_reward_func": 0.2906347719253972,
-      "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
-      "rewards/xmlcount_reward_func": 0.19793749693781137,
       "step": 14
     },
     {
-      "completion_length": 325.875,
       "epoch": 4.0,
-      "grad_norm": 2.830848217010498,
-      "kl": 0.0024977490635743984,
       "learning_rate": 8.067960709356478e-08,
-      "loss": 0.0,
-      "reward": 0.9994646807511648,
-      "reward_std": 0.5539894571217397,
-      "rewards/concensus_correctness_reward_func": 0.0,
-      "rewards/consensus_reward_func": 0.0,
       "rewards/cumulative_reward_2": 0.0,
       "rewards/final_correctness_reward_func": 0.16666666666666666,
-      "rewards/question_recreation_reward_func": 0.49063134379684925,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
-      "rewards/xmlcount_reward_func": 0.3421666646997134,
       "step": 16
     },
     {
-      "completion_length": 389.375,
       "epoch": 4.571428571428571,
-      "grad_norm": 46.40272903442383,
-      "kl": 0.002609318049508147,
       "learning_rate": 3.013156219837776e-08,
       "loss": 0.0,
-      "reward": 0.7612904570996761,
-      "reward_std": 0.6570868473500013,
-      "rewards/concensus_correctness_reward_func": 0.0,
       "rewards/consensus_reward_func": 0.0,
       "rewards/cumulative_reward_2": 0.0,
-      "rewards/final_correctness_reward_func": 0.0625,
-      "rewards/question_recreation_reward_func": 0.40422794860205613,
-      "rewards/soft_format_reward_func": 0.015625,
       "rewards/strict_format_reward_func": 0.0,
-      "rewards/xmlcount_reward_func": 0.27893750346265733,
       "step": 18
     },
     {
-      "completion_length": 353.0833333333333,
       "epoch": 5.0,
-      "grad_norm": 3.3550920486450195,
-      "kl": 0.0025782804586924613,
       "learning_rate": 3.4096741493194193e-09,
       "loss": 0.0,
-      "reward": 0.9136903683344523,
-      "reward_std": 0.38803071280320484,
-      "rewards/concensus_correctness_reward_func": 0.09016666809717815,
-      "rewards/consensus_reward_func": 0.0,
       "rewards/cumulative_reward_2": 0.0,
-      "rewards/final_correctness_reward_func": 0.0,
-      "rewards/question_recreation_reward_func": 0.39931537583470345,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
-      "rewards/xmlcount_reward_func": 0.4242083382171889,
       "step": 20
     },
     {
       "epoch": 5.0,
       "step": 20,
       "total_flos": 0.0,
-      "train_loss": 2.1981075406074522e-06,
-      "train_runtime": 238.9914,
-      "train_samples_per_second": 1.339,
-      "train_steps_per_second": 0.084
     }
   ],
   "logging_steps": 2,

   "is_world_process_zero": true,
   "log_history": [
     {
+      "completion_length": 312.40625,
       "epoch": 0.5714285714285714,
+      "grad_norm": 13.505131721496582,
       "kl": 0.0,
       "learning_rate": 5e-07,
       "loss": -0.0,
+      "reward": 1.4825244834646583,
+      "reward_std": 1.5035337428562343,
+      "rewards/concensus_correctness_reward_func": 0.6848125020042062,
+      "rewards/consensus_reward_func": 0.1875,
       "rewards/cumulative_reward_2": 0.0,
+      "rewards/final_correctness_reward_func": 0.125,
+      "rewards/question_recreation_reward_func": 0.38836816092953086,
+      "rewards/soft_format_reward_func": 0.015625,
       "rewards/strict_format_reward_func": 0.0,
+      "rewards/xmlcount_reward_func": 0.08121874323114753,
       "step": 2
     },
     {
+      "completion_length": 303.1666666666667,
       "epoch": 1.0,
+      "grad_norm": 76.14510345458984,
+      "kl": 0.0053147453484901535,
       "learning_rate": 4.864543104251586e-07,
       "loss": 0.0,
+      "reward": 1.8458619471639395,
+      "reward_std": 1.9819986671985437,
+      "rewards/concensus_correctness_reward_func": 0.8993333329757055,
+      "rewards/consensus_reward_func": 0.08333333333333333,
       "rewards/cumulative_reward_2": 0.0,
       "rewards/final_correctness_reward_func": 0.3333333333333333,
+      "rewards/question_recreation_reward_func": 0.3266536171237628,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
+      "rewards/xmlcount_reward_func": 0.2032083303978046,
       "step": 4
     },
     {
+      "completion_length": 293.90625,
       "epoch": 1.5714285714285714,
+      "grad_norm": 7.156302452087402,
+      "kl": 0.0018608839673106559,
       "learning_rate": 4.472851273490984e-07,
       "loss": 0.0,
+      "reward": 1.6626192443072796,
+      "reward_std": 1.4888756088912487,
+      "rewards/concensus_correctness_reward_func": 0.625,
+      "rewards/consensus_reward_func": 0.0,
       "rewards/cumulative_reward_2": 0.0,
+      "rewards/final_correctness_reward_func": 0.375,
+      "rewards/question_recreation_reward_func": 0.40493173035793006,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
+      "rewards/xmlcount_reward_func": 0.25768749974668026,
       "step": 6
     },
     {
+      "completion_length": 304.8333333333333,
       "epoch": 2.0,
+      "grad_norm": 96.20777893066406,
+      "kl": 0.17756431548817395,
       "learning_rate": 3.867370395306068e-07,
+      "loss": 0.0001,
+      "reward": 1.7442942617926747,
+      "reward_std": 1.4252724965723853,
+      "rewards/concensus_correctness_reward_func": 0.8689166655143102,
+      "rewards/consensus_reward_func": 0.0,
       "rewards/cumulative_reward_2": 0.0,
+      "rewards/final_correctness_reward_func": 0.08333333333333333,
+      "rewards/question_recreation_reward_func": 0.45383593199464184,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
+      "rewards/xmlcount_reward_func": 0.33820833700398606,
       "step": 8
     },
     {
+      "completion_length": 369.4375,
       "epoch": 2.571428571428571,
+      "grad_norm": 15.73390007019043,
+      "kl": 0.003028066232218407,
       "learning_rate": 3.1137137178519977e-07,
       "loss": 0.0,
+      "reward": 0.8973449682816863,
+      "reward_std": 0.8838894446380436,
       "rewards/concensus_correctness_reward_func": 0.0,
       "rewards/consensus_reward_func": 0.0,
       "rewards/cumulative_reward_2": 0.0,
+      "rewards/final_correctness_reward_func": 0.1875,
+      "rewards/question_recreation_reward_func": 0.47600120957940817,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
+      "rewards/xmlcount_reward_func": 0.23384374706074595,
       "step": 10
     },
     {
+      "completion_length": 412.75,
       "epoch": 3.0,
+      "grad_norm": 3.276512861251831,
+      "kl": 0.027834800983934354,
       "learning_rate": 2.2935516363191693e-07,
       "loss": 0.0,
+      "reward": 1.8517329891522725,
+      "reward_std": 2.5816012457944453,
+      "rewards/concensus_correctness_reward_func": 0.8993333329757055,
       "rewards/consensus_reward_func": 0.08333333333333333,
       "rewards/cumulative_reward_2": 0.0,
+      "rewards/final_correctness_reward_func": 0.25,
+      "rewards/question_recreation_reward_func": 0.5054829766352972,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
+      "rewards/xmlcount_reward_func": 0.113583334411184,
       "step": 12
     },
     {
+      "completion_length": 373.6875,
       "epoch": 3.571428571428571,
+      "grad_norm": 4.333131790161133,
+      "kl": 3.056828159293218,
       "learning_rate": 1.4957614383675767e-07,
+      "loss": 0.0031,
+      "reward": 3.1586281210184097,
+      "reward_std": 1.7590059327194467,
+      "rewards/concensus_correctness_reward_func": 1.9511874988675117,
+      "rewards/consensus_reward_func": 0.0625,
       "rewards/cumulative_reward_2": 0.0,
+      "rewards/final_correctness_reward_func": 0.375,
+      "rewards/question_recreation_reward_func": 0.43300307262688875,
+      "rewards/soft_format_reward_func": 0.015625,
       "rewards/strict_format_reward_func": 0.0,
+      "rewards/xmlcount_reward_func": 0.32131249764643144,
       "step": 14
     },
     {
+      "completion_length": 322.5416666666667,
       "epoch": 4.0,
+      "grad_norm": 2.229954481124878,
+      "kl": 0.1650886904390063,
       "learning_rate": 8.067960709356478e-08,
+      "loss": 0.0001,
+      "reward": 1.9369121423029962,
+      "reward_std": 1.7912628925793495,
+      "rewards/concensus_correctness_reward_func": 0.8906666661302248,
+      "rewards/consensus_reward_func": 0.08333333333333333,
       "rewards/cumulative_reward_2": 0.0,
       "rewards/final_correctness_reward_func": 0.16666666666666666,
+      "rewards/question_recreation_reward_func": 0.5202871684644682,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
+      "rewards/xmlcount_reward_func": 0.2759583319226901,
       "step": 16
     },
     {
+      "completion_length": 483.3125,
       "epoch": 4.571428571428571,
+      "grad_norm": 5.827852725982666,
+      "kl": 0.0023508332451456226,
       "learning_rate": 3.013156219837776e-08,
       "loss": 0.0,
+      "reward": 1.3025248600170016,
+      "reward_std": 1.6268547814106569,
+      "rewards/concensus_correctness_reward_func": 0.625,
       "rewards/consensus_reward_func": 0.0,
       "rewards/cumulative_reward_2": 0.0,
+      "rewards/final_correctness_reward_func": 0.25,
+      "rewards/question_recreation_reward_func": 0.3717748762574047,
+      "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
+      "rewards/xmlcount_reward_func": 0.055750004947185516,
       "step": 18
     },
     {
+      "completion_length": 423.75,
       "epoch": 5.0,
+      "grad_norm": 2.8185977935791016,
+      "kl": 0.002667344728251919,
       "learning_rate": 3.4096741493194193e-09,
       "loss": 0.0,
+      "reward": 1.0038322967787583,
+      "reward_std": 1.1184356560309727,
+      "rewards/concensus_correctness_reward_func": 0.06658333539962769,
+      "rewards/consensus_reward_func": 0.16666666666666666,
       "rewards/cumulative_reward_2": 0.0,
+      "rewards/final_correctness_reward_func": 0.16666666666666666,
+      "rewards/question_recreation_reward_func": 0.4765822980552912,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
+      "rewards/xmlcount_reward_func": 0.12733332812786102,
       "step": 20
     },
     {
       "epoch": 5.0,
       "step": 20,
       "total_flos": 0.0,
+      "train_loss": 0.00033479593694210055,
+      "train_runtime": 231.6976,
+      "train_samples_per_second": 1.381,
+      "train_steps_per_second": 0.086
     }
   ],
   "logging_steps": 2,