Instructions to use Dassem/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-endangered_gregarious_wolf with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use Dassem/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-endangered_gregarious_wolf with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="Dassem/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-endangered_gregarious_wolf")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("Dassem/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-endangered_gregarious_wolf")
model = AutoModelForCausalLM.from_pretrained("Dassem/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-endangered_gregarious_wolf", device_map="auto")
messages = [
    {"role": "user", "content": "Who are you?"},
]
inputs = tokenizer.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Inference
Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use Dassem/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-endangered_gregarious_wolf with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "Dassem/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-endangered_gregarious_wolf"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Dassem/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-endangered_gregarious_wolf",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/Dassem/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-endangered_gregarious_wolf

SGLang

How to use Dassem/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-endangered_gregarious_wolf with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "Dassem/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-endangered_gregarious_wolf" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Dassem/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-endangered_gregarious_wolf",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "Dassem/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-endangered_gregarious_wolf" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Dassem/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-endangered_gregarious_wolf",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use Dassem/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-endangered_gregarious_wolf with Docker Model Runner:
```
docker model run hf.co/Dassem/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-endangered_gregarious_wolf
```

Dassem commited on May 3, 2025

Commit

0d79234

verified ·

1 Parent(s): 4a95d29

End of training

Browse files

Files changed (4) hide show

all_results.json +4 -4
model.safetensors +1 -1
train_results.json +4 -4
trainer_state.json +118 -118

all_results.json CHANGED Viewed

@@ -1,8 +1,8 @@
 {
     "total_flos": 0.0,
-    "train_loss": 16.613859914429487,
-    "train_runtime": 122.1144,
     "train_samples": 28,
-    "train_samples_per_second": 2.62,
-    "train_steps_per_second": 0.164
 }

 {
     "total_flos": 0.0,
+    "train_loss": 4.810982779075857,
+    "train_runtime": 118.2668,
     "train_samples": 28,
+    "train_samples_per_second": 2.706,
+    "train_steps_per_second": 0.169
 }

model.safetensors CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:4c2d76f456ad84e985e5d185808b71a2d4ccfc7804a4c97ba2760ea4feab8d52
 size 1976163472

 version https://git-lfs.github.com/spec/v1
+oid sha256:936626fafba54fc103e5c9443244533562e0a98e3dc7ce8a83dff4f8a97f9673
 size 1976163472

train_results.json CHANGED Viewed

@@ -1,8 +1,8 @@
 {
     "total_flos": 0.0,
-    "train_loss": 16.613859914429487,
-    "train_runtime": 122.1144,
     "train_samples": 28,
-    "train_samples_per_second": 2.62,
-    "train_steps_per_second": 0.164
 }

 {
     "total_flos": 0.0,
+    "train_loss": 4.810982779075857,
+    "train_runtime": 118.2668,
     "train_samples": 28,
+    "train_samples_per_second": 2.706,
+    "train_steps_per_second": 0.169
 }

trainer_state.json CHANGED Viewed

@@ -10,203 +10,203 @@
   "is_world_process_zero": true,
   "log_history": [
     {
-      "completion_length": 213.375,
       "epoch": 0.5714285714285714,
-      "grad_norm": 83.38453674316406,
       "kl": 0.0,
       "learning_rate": 5e-07,
       "loss": 0.0,
-      "reward": 3.2702511064708233,
-      "reward_std": 1.6299662222154438,
-      "rewards/concensus_correctness_reward_func": 0.7398749957792461,
-      "rewards/consensus_reward_func": 0.875,
       "rewards/cumulative_reward_2": 0.0,
-      "rewards/final_correctness_reward_func": 0.125,
-      "rewards/question_recreation_reward_func": 0.6164698153734207,
       "rewards/soft_format_reward_func": 0.0,
-      "rewards/strict_format_reward_func": 0.15625,
-      "rewards/xmlcount_reward_func": 0.7576562501490116,
       "step": 2
     },
     {
-      "completion_length": 212.29166666666666,
       "epoch": 1.0,
-      "grad_norm": 27.329761505126953,
-      "kl": 4.687201510183513,
       "learning_rate": 4.864543104251586e-07,
-      "loss": 0.0035,
-      "reward": 4.18427599966526,
-      "reward_std": 1.0136302523314953,
-      "rewards/concensus_correctness_reward_func": 1.2149999936421711,
-      "rewards/consensus_reward_func": 1.1666666666666667,
       "rewards/cumulative_reward_2": 0.0,
       "rewards/final_correctness_reward_func": 0.0,
-      "rewards/question_recreation_reward_func": 0.737317735950152,
       "rewards/soft_format_reward_func": 0.0,
-      "rewards/strict_format_reward_func": 0.20833333333333334,
-      "rewards/xmlcount_reward_func": 0.8569583396116892,
       "step": 4
     },
     {
-      "completion_length": 160.25,
       "epoch": 1.5714285714285714,
-      "grad_norm": 201885.9375,
-      "kl": 2192.0195257472806,
       "learning_rate": 4.472851273490984e-07,
-      "loss": 2.192,
-      "reward": 5.087710991501808,
-      "reward_std": 0.8815780063159764,
-      "rewards/concensus_correctness_reward_func": 1.46518749371171,
-      "rewards/consensus_reward_func": 1.375,
       "rewards/cumulative_reward_2": 0.0,
-      "rewards/final_correctness_reward_func": 0.0625,
-      "rewards/question_recreation_reward_func": 0.802617306355387,
       "rewards/soft_format_reward_func": 0.0,
-      "rewards/strict_format_reward_func": 0.296875,
-      "rewards/xmlcount_reward_func": 1.0855312533676624,
       "step": 6
     },
     {
-      "completion_length": 195.54166666666666,
       "epoch": 2.0,
-      "grad_norm": 50.0317268371582,
-      "kl": 3.5268452602128186,
       "learning_rate": 3.867370395306068e-07,
-      "loss": 0.0026,
-      "reward": 4.593563541769981,
-      "reward_std": 0.8916728589683771,
-      "rewards/concensus_correctness_reward_func": 1.0393333329508703,
-      "rewards/consensus_reward_func": 1.3333333333333333,
       "rewards/cumulative_reward_2": 0.0,
-      "rewards/final_correctness_reward_func": 0.08333333333333333,
-      "rewards/question_recreation_reward_func": 0.7292718101137629,
       "rewards/soft_format_reward_func": 0.0,
-      "rewards/strict_format_reward_func": 0.2916666666666667,
-      "rewards/xmlcount_reward_func": 1.116625001033147,
       "step": 8
     },
     {
-      "completion_length": 204.53125,
       "epoch": 2.571428571428571,
-      "grad_norm": 160836.5625,
-      "kl": 5804.151155915111,
       "learning_rate": 3.1137137178519977e-07,
-      "loss": 5.8042,
-      "reward": 4.655729368329048,
-      "reward_std": 1.402610547374934,
-      "rewards/concensus_correctness_reward_func": 1.261187493801117,
-      "rewards/consensus_reward_func": 1.25,
       "rewards/cumulative_reward_2": 0.0,
-      "rewards/final_correctness_reward_func": 0.0,
-      "rewards/question_recreation_reward_func": 0.826385635882616,
       "rewards/soft_format_reward_func": 0.0,
-      "rewards/strict_format_reward_func": 0.25,
-      "rewards/xmlcount_reward_func": 1.068156249821186,
       "step": 10
     },
     {
-      "completion_length": 177.75,
       "epoch": 3.0,
-      "grad_norm": 39.7148551940918,
-      "kl": 194981.97983492477,
       "learning_rate": 2.2935516363191693e-07,
-      "loss": 146.2365,
-      "reward": 4.766051749388377,
-      "reward_std": 1.4179468097475667,
-      "rewards/concensus_correctness_reward_func": 1.2784999950478475,
-      "rewards/consensus_reward_func": 1.3333333333333333,
       "rewards/cumulative_reward_2": 0.0,
       "rewards/final_correctness_reward_func": 0.0,
-      "rewards/question_recreation_reward_func": 0.7705100451906522,
       "rewards/soft_format_reward_func": 0.0,
-      "rewards/strict_format_reward_func": 0.2708333333333333,
-      "rewards/xmlcount_reward_func": 1.1128749946753185,
       "step": 12
     },
     {
-      "completion_length": 189.9375,
       "epoch": 3.571428571428571,
-      "grad_norm": 3572.9052734375,
-      "kl": 128.10682729631662,
       "learning_rate": 1.4957614383675767e-07,
-      "loss": 0.1281,
-      "reward": 4.833401307463646,
-      "reward_std": 1.2682143065612763,
-      "rewards/concensus_correctness_reward_func": 1.1926249926909804,
-      "rewards/consensus_reward_func": 1.375,
       "rewards/cumulative_reward_2": 0.0,
-      "rewards/final_correctness_reward_func": 0.125,
-      "rewards/question_recreation_reward_func": 0.8134013433009386,
       "rewards/soft_format_reward_func": 0.0,
-      "rewards/strict_format_reward_func": 0.265625,
-      "rewards/xmlcount_reward_func": 1.0617499984800816,
       "step": 14
     },
     {
-      "completion_length": 178.08333333333334,
       "epoch": 4.0,
-      "grad_norm": 2833.846435546875,
-      "kl": 56.623517076174416,
       "learning_rate": 8.067960709356478e-08,
-      "loss": 0.0425,
-      "reward": 4.591517438491185,
-      "reward_std": 0.6986274433632692,
-      "rewards/concensus_correctness_reward_func": 1.2420833359162013,
-      "rewards/consensus_reward_func": 1.3333333333333333,
       "rewards/cumulative_reward_2": 0.0,
-      "rewards/final_correctness_reward_func": 0.0,
-      "rewards/question_recreation_reward_func": 0.7223091561657687,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.2916666666666667,
-      "rewards/xmlcount_reward_func": 1.0021250049273174,
       "step": 16
     },
     {
-      "completion_length": 184.53125,
       "epoch": 4.571428571428571,
-      "grad_norm": 21946.189453125,
-      "kl": 613.7210371047258,
       "learning_rate": 3.013156219837776e-08,
-      "loss": 0.6137,
-      "reward": 4.742913171648979,
-      "reward_std": 1.4003411061130464,
-      "rewards/concensus_correctness_reward_func": 1.2864374886266887,
-      "rewards/consensus_reward_func": 1.375,
       "rewards/cumulative_reward_2": 0.0,
-      "rewards/final_correctness_reward_func": 0.0625,
-      "rewards/question_recreation_reward_func": 0.6600068942643702,
       "rewards/soft_format_reward_func": 0.0,
-      "rewards/strict_format_reward_func": 0.265625,
-      "rewards/xmlcount_reward_func": 1.0933437496423721,
       "step": 18
     },
     {
-      "completion_length": 174.625,
       "epoch": 5.0,
-      "grad_norm": 47.249473571777344,
-      "kl": 14820.684090688825,
       "learning_rate": 3.4096741493194193e-09,
-      "loss": 11.1155,
-      "reward": 4.722067733605702,
-      "reward_std": 0.8547916903917212,
-      "rewards/concensus_correctness_reward_func": 1.3415833363930385,
-      "rewards/consensus_reward_func": 1.3333333333333333,
       "rewards/cumulative_reward_2": 0.0,
-      "rewards/final_correctness_reward_func": 0.0,
-      "rewards/question_recreation_reward_func": 0.8041510308782259,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.22916666666666666,
-      "rewards/xmlcount_reward_func": 1.0138333414991696,
       "step": 20
     },
     {
       "epoch": 5.0,
       "step": 20,
       "total_flos": 0.0,
-      "train_loss": 16.613859914429487,
-      "train_runtime": 122.1144,
-      "train_samples_per_second": 2.62,
-      "train_steps_per_second": 0.164
     }
   ],
   "logging_steps": 2,

   "is_world_process_zero": true,
   "log_history": [
     {
+      "completion_length": 221.59375,
       "epoch": 0.5714285714285714,
+      "grad_norm": 60.60015106201172,
       "kl": 0.0,
       "learning_rate": 5e-07,
       "loss": 0.0,
+      "reward": 3.4653576016426086,
+      "reward_std": 0.8209123063861625,
+      "rewards/concensus_correctness_reward_func": 0.7468749945983291,
+      "rewards/consensus_reward_func": 1.0625,
       "rewards/cumulative_reward_2": 0.0,
+      "rewards/final_correctness_reward_func": 0.0625,
+      "rewards/question_recreation_reward_func": 0.654263935983181,
       "rewards/soft_format_reward_func": 0.0,
+      "rewards/strict_format_reward_func": 0.125,
+      "rewards/xmlcount_reward_func": 0.8142187604680657,
       "step": 2
     },
     {
+      "completion_length": 165.20833333333334,
       "epoch": 1.0,
+      "grad_norm": 150909.671875,
+      "kl": 5585.012409599808,
       "learning_rate": 4.864543104251586e-07,
+      "loss": 4.1888,
+      "reward": 4.646159549554189,
+      "reward_std": 1.7369201476685703,
+      "rewards/concensus_correctness_reward_func": 1.6091666668653488,
+      "rewards/consensus_reward_func": 1.3333333333333333,
       "rewards/cumulative_reward_2": 0.0,
       "rewards/final_correctness_reward_func": 0.0,
+      "rewards/question_recreation_reward_func": 0.5225345126042763,
       "rewards/soft_format_reward_func": 0.0,
+      "rewards/strict_format_reward_func": 0.16666666666666666,
+      "rewards/xmlcount_reward_func": 1.0144583334525425,
       "step": 4
     },
     {
+      "completion_length": 178.1875,
       "epoch": 1.5714285714285714,
+      "grad_norm": 33501.27734375,
+      "kl": 14449.912984883413,
       "learning_rate": 4.472851273490984e-07,
+      "loss": 14.4499,
+      "reward": 5.632774636149406,
+      "reward_std": 0.9981047324836254,
+      "rewards/concensus_correctness_reward_func": 1.7074375040829182,
+      "rewards/consensus_reward_func": 1.4375,
       "rewards/cumulative_reward_2": 0.0,
+      "rewards/final_correctness_reward_func": 0.125,
+      "rewards/question_recreation_reward_func": 0.921055871527642,
       "rewards/soft_format_reward_func": 0.0,
+      "rewards/strict_format_reward_func": 0.3125,
+      "rewards/xmlcount_reward_func": 1.1292812526226044,
       "step": 6
     },
     {
+      "completion_length": 180.75,
       "epoch": 2.0,
+      "grad_norm": 35.281227111816406,
+      "kl": 170.07763784006238,
       "learning_rate": 3.867370395306068e-07,
+      "loss": 0.1276,
+      "reward": 4.981932123502095,
+      "reward_std": 0.7679674559306781,
+      "rewards/concensus_correctness_reward_func": 1.2675833149502675,
+      "rewards/consensus_reward_func": 1.5833333333333333,
       "rewards/cumulative_reward_2": 0.0,
+      "rewards/final_correctness_reward_func": 0.0,
+      "rewards/question_recreation_reward_func": 0.787265474597613,
       "rewards/soft_format_reward_func": 0.0,
+      "rewards/strict_format_reward_func": 0.25,
+      "rewards/xmlcount_reward_func": 1.09375,
       "step": 8
     },
     {
+      "completion_length": 161.96875,
       "epoch": 2.571428571428571,
+      "grad_norm": 9011.3623046875,
+      "kl": 28157.17834121408,
       "learning_rate": 3.1137137178519977e-07,
+      "loss": 28.1572,
+      "reward": 4.997823455370963,
+      "reward_std": 0.4187893490015995,
+      "rewards/concensus_correctness_reward_func": 1.4683750048279762,
+      "rewards/consensus_reward_func": 1.125,
       "rewards/cumulative_reward_2": 0.0,
+      "rewards/final_correctness_reward_func": 0.3125,
+      "rewards/question_recreation_reward_func": 0.7822921997867525,
       "rewards/soft_format_reward_func": 0.0,
+      "rewards/strict_format_reward_func": 0.296875,
+      "rewards/xmlcount_reward_func": 1.0127812502905726,
       "step": 10
     },
     {
+      "completion_length": 157.5,
       "epoch": 3.0,
+      "grad_norm": 4991.70263671875,
+      "kl": 138.71271182348332,
       "learning_rate": 2.2935516363191693e-07,
+      "loss": 0.104,
+      "reward": 5.47919899225235,
+      "reward_std": 0.46974249742925167,
+      "rewards/concensus_correctness_reward_func": 1.6604999899864197,
+      "rewards/consensus_reward_func": 1.75,
       "rewards/cumulative_reward_2": 0.0,
       "rewards/final_correctness_reward_func": 0.0,
+      "rewards/question_recreation_reward_func": 0.7041156962513924,
       "rewards/soft_format_reward_func": 0.0,
+      "rewards/strict_format_reward_func": 0.20833333333333334,
+      "rewards/xmlcount_reward_func": 1.15625,
       "step": 12
     },
     {
+      "completion_length": 180.3125,
       "epoch": 3.571428571428571,
+      "grad_norm": 53.90495300292969,
+      "kl": 796.3256631409749,
       "learning_rate": 1.4957614383675767e-07,
+      "loss": 0.7963,
+      "reward": 5.196396499872208,
+      "reward_std": 0.8098996949993307,
+      "rewards/concensus_correctness_reward_func": 1.4756874996237457,
+      "rewards/consensus_reward_func": 1.5625,
       "rewards/cumulative_reward_2": 0.0,
+      "rewards/final_correctness_reward_func": 0.0,
+      "rewards/question_recreation_reward_func": 0.7931465404108167,
       "rewards/soft_format_reward_func": 0.0,
+      "rewards/strict_format_reward_func": 0.25,
+      "rewards/xmlcount_reward_func": 1.1150625012814999,
       "step": 14
     },
     {
+      "completion_length": 174.83333333333334,
       "epoch": 4.0,
+      "grad_norm": 29.16839027404785,
+      "kl": 1.8292740272978942,
       "learning_rate": 8.067960709356478e-08,
+      "loss": 0.0014,
+      "reward": 5.595823963483174,
+      "reward_std": 1.0394487765928109,
+      "rewards/concensus_correctness_reward_func": 1.6602499932050705,
+      "rewards/consensus_reward_func": 1.5,
       "rewards/cumulative_reward_2": 0.0,
+      "rewards/final_correctness_reward_func": 0.16666666666666666,
+      "rewards/question_recreation_reward_func": 0.8422823200623194,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.2916666666666667,
+      "rewards/xmlcount_reward_func": 1.1349583268165588,
       "step": 16
     },
     {
+      "completion_length": 172.03125,
       "epoch": 4.571428571428571,
+      "grad_norm": 11252.7509765625,
+      "kl": 134.45813744235784,
       "learning_rate": 3.013156219837776e-08,
+      "loss": 0.1345,
+      "reward": 5.485393404960632,
+      "reward_std": 0.7980908276222181,
+      "rewards/concensus_correctness_reward_func": 1.589249990414828,
+      "rewards/consensus_reward_func": 1.6875,
       "rewards/cumulative_reward_2": 0.0,
+      "rewards/final_correctness_reward_func": 0.0,
+      "rewards/question_recreation_reward_func": 0.7450809078291059,
       "rewards/soft_format_reward_func": 0.0,
+      "rewards/strict_format_reward_func": 0.3125,
+      "rewards/xmlcount_reward_func": 1.1510625034570694,
       "step": 18
     },
     {
+      "completion_length": 193.04166666666666,
       "epoch": 5.0,
+      "grad_norm": 30.57774543762207,
+      "kl": 200.24465695520243,
       "learning_rate": 3.4096741493194193e-09,
+      "loss": 0.1502,
+      "reward": 5.304450035095215,
+      "reward_std": 0.765751785133034,
+      "rewards/concensus_correctness_reward_func": 1.5927500029404957,
+      "rewards/consensus_reward_func": 1.4166666666666667,
       "rewards/cumulative_reward_2": 0.0,
+      "rewards/final_correctness_reward_func": 0.25,
+      "rewards/question_recreation_reward_func": 0.7779916717360417,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.22916666666666666,
+      "rewards/xmlcount_reward_func": 1.0378750016291935,
       "step": 20
     },
     {
       "epoch": 5.0,
       "step": 20,
       "total_flos": 0.0,
+      "train_loss": 4.810982779075857,
+      "train_runtime": 118.2668,
+      "train_samples_per_second": 2.706,
+      "train_steps_per_second": 0.169
     }
   ],
   "logging_steps": 2,