Instructions to use Dassem/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-endangered_gregarious_wolf with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use Dassem/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-endangered_gregarious_wolf with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="Dassem/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-endangered_gregarious_wolf")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("Dassem/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-endangered_gregarious_wolf")
model = AutoModelForCausalLM.from_pretrained("Dassem/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-endangered_gregarious_wolf", device_map="auto")
messages = [
    {"role": "user", "content": "Who are you?"},
]
inputs = tokenizer.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Inference
Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use Dassem/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-endangered_gregarious_wolf with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "Dassem/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-endangered_gregarious_wolf"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Dassem/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-endangered_gregarious_wolf",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/Dassem/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-endangered_gregarious_wolf

SGLang

How to use Dassem/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-endangered_gregarious_wolf with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "Dassem/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-endangered_gregarious_wolf" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Dassem/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-endangered_gregarious_wolf",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "Dassem/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-endangered_gregarious_wolf" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Dassem/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-endangered_gregarious_wolf",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use Dassem/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-endangered_gregarious_wolf with Docker Model Runner:
```
docker model run hf.co/Dassem/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-endangered_gregarious_wolf
```

Dassem commited on May 3, 2025

Commit

fc4d2aa

verified ·

1 Parent(s): db7b554

End of training

Browse files

Files changed (4) hide show

all_results.json +4 -4
model.safetensors +1 -1
train_results.json +4 -4
trainer_state.json +113 -113

all_results.json CHANGED Viewed

@@ -1,8 +1,8 @@
 {
     "total_flos": 0.0,
-    "train_loss": 314.82718519624325,
-    "train_runtime": 122.7811,
     "train_samples": 28,
-    "train_samples_per_second": 2.606,
-    "train_steps_per_second": 0.163
 }

 {
     "total_flos": 0.0,
+    "train_loss": 658.4579157842323,
+    "train_runtime": 121.6045,
     "train_samples": 28,
+    "train_samples_per_second": 2.631,
+    "train_steps_per_second": 0.164
 }

model.safetensors CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:a225398eecea8af87eeda2fd5c9ea18f53ac7b32a8cd98f216164aeb7830095c
 size 1976163472

 version https://git-lfs.github.com/spec/v1
+oid sha256:66e544951030db68f4cc94b5e27a4e2e3c58896bbdf2f5b7afb937c12217c92e
 size 1976163472

train_results.json CHANGED Viewed

@@ -1,8 +1,8 @@
 {
     "total_flos": 0.0,
-    "train_loss": 314.82718519624325,
-    "train_runtime": 122.7811,
     "train_samples": 28,
-    "train_samples_per_second": 2.606,
-    "train_steps_per_second": 0.163
 }

 {
     "total_flos": 0.0,
+    "train_loss": 658.4579157842323,
+    "train_runtime": 121.6045,
     "train_samples": 28,
+    "train_samples_per_second": 2.631,
+    "train_steps_per_second": 0.164
 }

trainer_state.json CHANGED Viewed

@@ -10,203 +10,203 @@
   "is_world_process_zero": true,
   "log_history": [
     {
-      "completion_length": 240.4375,
       "epoch": 0.5714285714285714,
-      "grad_norm": 84.11676788330078,
       "kl": 0.0,
       "learning_rate": 5e-07,
-      "loss": -0.0,
-      "reward": 2.757822236046195,
-      "reward_std": 0.7534130048006773,
-      "rewards/concensus_correctness_reward_func": 0.4926249971613288,
-      "rewards/consensus_reward_func": 0.75,
       "rewards/cumulative_reward_2": 0.0,
-      "rewards/final_correctness_reward_func": 0.0,
-      "rewards/question_recreation_reward_func": 0.6096035614609718,
       "rewards/soft_format_reward_func": 0.0,
-      "rewards/strict_format_reward_func": 0.140625,
-      "rewards/xmlcount_reward_func": 0.7649687565863132,
       "step": 2
     },
     {
-      "completion_length": 168.95833333333334,
       "epoch": 1.0,
-      "grad_norm": 42.38279724121094,
-      "kl": 0.18371960458656153,
       "learning_rate": 4.864543104251586e-07,
-      "loss": 0.0001,
-      "reward": 5.343848447004954,
-      "reward_std": 0.526681704679504,
-      "rewards/concensus_correctness_reward_func": 1.5159999976555507,
-      "rewards/consensus_reward_func": 1.5833333333333333,
       "rewards/cumulative_reward_2": 0.0,
       "rewards/final_correctness_reward_func": 0.0,
-      "rewards/question_recreation_reward_func": 0.8387234838058552,
       "rewards/soft_format_reward_func": 0.0,
-      "rewards/strict_format_reward_func": 0.3125,
-      "rewards/xmlcount_reward_func": 1.093291662633419,
       "step": 4
     },
     {
-      "completion_length": 175.1875,
       "epoch": 1.5714285714285714,
-      "grad_norm": 46.851314544677734,
-      "kl": 2.0928112296387553,
       "learning_rate": 4.472851273490984e-07,
-      "loss": 0.0021,
-      "reward": 4.8182075545191765,
-      "reward_std": 0.8651911650958937,
-      "rewards/concensus_correctness_reward_func": 1.346187487244606,
-      "rewards/consensus_reward_func": 1.25,
       "rewards/cumulative_reward_2": 0.0,
       "rewards/final_correctness_reward_func": 0.0,
-      "rewards/question_recreation_reward_func": 0.8358637988567352,
       "rewards/soft_format_reward_func": 0.0,
-      "rewards/strict_format_reward_func": 0.28125,
-      "rewards/xmlcount_reward_func": 1.1049062609672546,
       "step": 6
     },
     {
-      "completion_length": 158.5,
       "epoch": 2.0,
-      "grad_norm": 28.091886520385742,
-      "kl": 6.158096335828304,
       "learning_rate": 3.867370395306068e-07,
-      "loss": 0.0046,
-      "reward": 5.093323191006978,
-      "reward_std": 0.9391660434193909,
-      "rewards/concensus_correctness_reward_func": 1.1949166643122833,
-      "rewards/consensus_reward_func": 1.5833333333333333,
       "rewards/cumulative_reward_2": 0.0,
-      "rewards/final_correctness_reward_func": 0.0,
-      "rewards/question_recreation_reward_func": 0.7993231633057197,
       "rewards/soft_format_reward_func": 0.0,
-      "rewards/strict_format_reward_func": 0.3333333333333333,
-      "rewards/xmlcount_reward_func": 1.182416667540868,
       "step": 8
     },
     {
-      "completion_length": 192.21875,
       "epoch": 2.571428571428571,
-      "grad_norm": 13151.33203125,
-      "kl": 346.6068515526131,
       "learning_rate": 3.1137137178519977e-07,
-      "loss": 0.3466,
-      "reward": 4.898413330316544,
-      "reward_std": 0.911398904863745,
-      "rewards/concensus_correctness_reward_func": 1.269749991595745,
-      "rewards/consensus_reward_func": 1.375,
       "rewards/cumulative_reward_2": 0.0,
-      "rewards/final_correctness_reward_func": 0.0625,
-      "rewards/question_recreation_reward_func": 0.806882037781179,
       "rewards/soft_format_reward_func": 0.0,
-      "rewards/strict_format_reward_func": 0.28125,
-      "rewards/xmlcount_reward_func": 1.1030312478542328,
       "step": 10
     },
     {
-      "completion_length": 181.91666666666666,
       "epoch": 3.0,
-      "grad_norm": 76387.5390625,
-      "kl": 1325.9971063925575,
       "learning_rate": 2.2935516363191693e-07,
-      "loss": 0.9945,
-      "reward": 5.22258738676707,
-      "reward_std": 0.7651490826004496,
-      "rewards/concensus_correctness_reward_func": 1.5083333253860474,
       "rewards/consensus_reward_func": 1.5,
       "rewards/cumulative_reward_2": 0.0,
       "rewards/final_correctness_reward_func": 0.0,
-      "rewards/question_recreation_reward_func": 0.748754121363163,
       "rewards/soft_format_reward_func": 0.0,
-      "rewards/strict_format_reward_func": 0.3541666666666667,
-      "rewards/xmlcount_reward_func": 1.1113333354393642,
       "step": 12
     },
     {
-      "completion_length": 198.21875,
       "epoch": 3.571428571428571,
-      "grad_norm": 72857168.0,
-      "kl": 3131412.746123733,
       "learning_rate": 1.4957614383675767e-07,
-      "loss": 3131.4126,
-      "reward": 5.61964476108551,
-      "reward_std": 0.4274047159415204,
-      "rewards/concensus_correctness_reward_func": 1.6702500050887465,
-      "rewards/consensus_reward_func": 1.75,
       "rewards/cumulative_reward_2": 0.0,
       "rewards/final_correctness_reward_func": 0.0,
-      "rewards/question_recreation_reward_func": 0.8069260399788618,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.28125,
-      "rewards/xmlcount_reward_func": 1.1112187504768372,
       "step": 14
     },
     {
-      "completion_length": 193.5,
       "epoch": 4.0,
-      "grad_norm": 2524.000244140625,
-      "kl": 20652.24733280142,
       "learning_rate": 8.067960709356478e-08,
-      "loss": 15.4892,
-      "reward": 4.769443949063619,
-      "reward_std": 1.2252796487882733,
-      "rewards/concensus_correctness_reward_func": 1.165166641275088,
-      "rewards/consensus_reward_func": 1.25,
       "rewards/cumulative_reward_2": 0.0,
       "rewards/final_correctness_reward_func": 0.08333333333333333,
-      "rewards/question_recreation_reward_func": 0.8773189783096313,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.2708333333333333,
-      "rewards/xmlcount_reward_func": 1.1227916677792866,
       "step": 16
     },
     {
-      "completion_length": 193.21875,
       "epoch": 4.571428571428571,
-      "grad_norm": 56.17420959472656,
-      "kl": 4.121493708342314,
       "learning_rate": 3.013156219837776e-08,
-      "loss": 0.0041,
-      "reward": 5.253860384225845,
-      "reward_std": 0.9104001453088131,
-      "rewards/concensus_correctness_reward_func": 1.4061874966137111,
-      "rewards/consensus_reward_func": 1.625,
       "rewards/cumulative_reward_2": 0.0,
       "rewards/final_correctness_reward_func": 0.0,
-      "rewards/question_recreation_reward_func": 0.717891676351428,
       "rewards/soft_format_reward_func": 0.0,
-      "rewards/strict_format_reward_func": 0.34375,
-      "rewards/xmlcount_reward_func": 1.161031249910593,
       "step": 18
     },
     {
-      "completion_length": 200.08333333333334,
       "epoch": 5.0,
-      "grad_norm": 211.87501525878906,
-      "kl": 23.978767448415358,
       "learning_rate": 3.4096741493194193e-09,
-      "loss": 0.018,
-      "reward": 4.573550532261531,
-      "reward_std": 1.1774705731853221,
-      "rewards/concensus_correctness_reward_func": 1.2656666537125905,
-      "rewards/consensus_reward_func": 1.25,
       "rewards/cumulative_reward_2": 0.0,
       "rewards/final_correctness_reward_func": 0.0,
-      "rewards/question_recreation_reward_func": 0.8153421680132548,
       "rewards/soft_format_reward_func": 0.0,
-      "rewards/strict_format_reward_func": 0.20833333333333334,
-      "rewards/xmlcount_reward_func": 1.0342083324988682,
       "step": 20
     },
     {
       "epoch": 5.0,
       "step": 20,
       "total_flos": 0.0,
-      "train_loss": 314.82718519624325,
-      "train_runtime": 122.7811,
-      "train_samples_per_second": 2.606,
-      "train_steps_per_second": 0.163
     }
   ],
   "logging_steps": 2,

   "is_world_process_zero": true,
   "log_history": [
     {
+      "completion_length": 264.0,
       "epoch": 0.5714285714285714,
+      "grad_norm": 42.08466720581055,
       "kl": 0.0,
       "learning_rate": 5e-07,
+      "loss": 0.0,
+      "reward": 3.3252449985593557,
+      "reward_std": 0.9225419503636658,
+      "rewards/concensus_correctness_reward_func": 0.6287499954923987,
+      "rewards/consensus_reward_func": 0.9375,
       "rewards/cumulative_reward_2": 0.0,
+      "rewards/final_correctness_reward_func": 0.125,
+      "rewards/question_recreation_reward_func": 0.6809324820060283,
       "rewards/soft_format_reward_func": 0.0,
+      "rewards/strict_format_reward_func": 0.15625,
+      "rewards/xmlcount_reward_func": 0.7968125026673079,
       "step": 2
     },
     {
+      "completion_length": 147.83333333333334,
       "epoch": 1.0,
+      "grad_norm": 80.87589263916016,
+      "kl": 24.280827605786424,
       "learning_rate": 4.864543104251586e-07,
+      "loss": 0.0182,
+      "reward": 4.468387395143509,
+      "reward_std": 0.848564498553363,
+      "rewards/concensus_correctness_reward_func": 1.2132500012715657,
+      "rewards/consensus_reward_func": 1.0833333333333333,
       "rewards/cumulative_reward_2": 0.0,
       "rewards/final_correctness_reward_func": 0.0,
+      "rewards/question_recreation_reward_func": 0.8425957933068275,
       "rewards/soft_format_reward_func": 0.0,
+      "rewards/strict_format_reward_func": 0.22916666666666666,
+      "rewards/xmlcount_reward_func": 1.100041667620341,
       "step": 4
     },
     {
+      "completion_length": 177.90625,
       "epoch": 1.5714285714285714,
+      "grad_norm": 680.423095703125,
+      "kl": 18.7979184682481,
       "learning_rate": 4.472851273490984e-07,
+      "loss": 0.0188,
+      "reward": 5.687123700976372,
+      "reward_std": 0.8236297178955283,
+      "rewards/concensus_correctness_reward_func": 1.6261249966919422,
+      "rewards/consensus_reward_func": 1.5625,
       "rewards/cumulative_reward_2": 0.0,
       "rewards/final_correctness_reward_func": 0.0,
+      "rewards/question_recreation_reward_func": 0.8756237160414457,
       "rewards/soft_format_reward_func": 0.0,
+      "rewards/strict_format_reward_func": 0.421875,
+      "rewards/xmlcount_reward_func": 1.201000003144145,
       "step": 6
     },
     {
+      "completion_length": 178.33333333333334,
       "epoch": 2.0,
+      "grad_norm": 47.84727096557617,
+      "kl": 147.27345666475594,
       "learning_rate": 3.867370395306068e-07,
+      "loss": 0.1105,
+      "reward": 4.611601809660594,
+      "reward_std": 1.0027544349431992,
+      "rewards/concensus_correctness_reward_func": 1.1922499972085159,
+      "rewards/consensus_reward_func": 1.4166666666666667,
       "rewards/cumulative_reward_2": 0.0,
+      "rewards/final_correctness_reward_func": 0.08333333333333333,
+      "rewards/question_recreation_reward_func": 0.6693518397708734,
       "rewards/soft_format_reward_func": 0.0,
+      "rewards/strict_format_reward_func": 0.25,
+      "rewards/xmlcount_reward_func": 1.0,
       "step": 8
     },
     {
+      "completion_length": 178.53125,
       "epoch": 2.571428571428571,
+      "grad_norm": 27.147804260253906,
+      "kl": 80.05519216996618,
       "learning_rate": 3.1137137178519977e-07,
+      "loss": 0.0801,
+      "reward": 5.480146124958992,
+      "reward_std": 0.6177240351680666,
+      "rewards/concensus_correctness_reward_func": 1.5245625004172325,
+      "rewards/consensus_reward_func": 1.6875,
       "rewards/cumulative_reward_2": 0.0,
+      "rewards/final_correctness_reward_func": 0.0,
+      "rewards/question_recreation_reward_func": 0.7871148781850934,
       "rewards/soft_format_reward_func": 0.0,
+      "rewards/strict_format_reward_func": 0.328125,
+      "rewards/xmlcount_reward_func": 1.1528437547385693,
       "step": 10
     },
     {
+      "completion_length": 157.33333333333334,
       "epoch": 3.0,
+      "grad_norm": 305884992.0,
+      "kl": 8767130.840889981,
       "learning_rate": 2.2935516363191693e-07,
+      "loss": 6575.3481,
+      "reward": 4.995270060996215,
+      "reward_std": 0.5079277840753397,
+      "rewards/concensus_correctness_reward_func": 1.4502499885857105,
       "rewards/consensus_reward_func": 1.5,
       "rewards/cumulative_reward_2": 0.0,
       "rewards/final_correctness_reward_func": 0.0,
+      "rewards/question_recreation_reward_func": 0.7452701268096765,
       "rewards/soft_format_reward_func": 0.0,
+      "rewards/strict_format_reward_func": 0.25,
+      "rewards/xmlcount_reward_func": 1.0497500002384186,
       "step": 12
     },
     {
+      "completion_length": 178.8125,
       "epoch": 3.571428571428571,
+      "grad_norm": 92443.40625,
+      "kl": 1799.8993375003338,
       "learning_rate": 1.4957614383675767e-07,
+      "loss": 1.7999,
+      "reward": 4.657655701041222,
+      "reward_std": 0.9006728196982294,
+      "rewards/concensus_correctness_reward_func": 1.1327499961480498,
+      "rewards/consensus_reward_func": 1.3125,
       "rewards/cumulative_reward_2": 0.0,
       "rewards/final_correctness_reward_func": 0.0,
+      "rewards/question_recreation_reward_func": 0.8199994191527367,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.28125,
+      "rewards/xmlcount_reward_func": 1.1111562475562096,
       "step": 14
     },
     {
+      "completion_length": 201.04166666666666,
       "epoch": 4.0,
+      "grad_norm": 98.52631378173828,
+      "kl": 3239.482992446671,
       "learning_rate": 8.067960709356478e-08,
+      "loss": 2.4296,
+      "reward": 5.643954157829285,
+      "reward_std": 0.48065901547670364,
+      "rewards/concensus_correctness_reward_func": 1.6312499990065892,
+      "rewards/consensus_reward_func": 1.75,
       "rewards/cumulative_reward_2": 0.0,
       "rewards/final_correctness_reward_func": 0.08333333333333333,
+      "rewards/question_recreation_reward_func": 0.7790376245975494,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.2708333333333333,
+      "rewards/xmlcount_reward_func": 1.12950000166893,
       "step": 16
     },
     {
+      "completion_length": 162.84375,
       "epoch": 4.571428571428571,
+      "grad_norm": 95589.8046875,
+      "kl": 2557.710035777185,
       "learning_rate": 3.013156219837776e-08,
+      "loss": 2.5577,
+      "reward": 4.27200685441494,
+      "reward_std": 1.2461569734205113,
+      "rewards/concensus_correctness_reward_func": 1.1003749994561076,
+      "rewards/consensus_reward_func": 1.3125,
       "rewards/cumulative_reward_2": 0.0,
       "rewards/final_correctness_reward_func": 0.0,
+      "rewards/question_recreation_reward_func": 0.5906943529844284,
       "rewards/soft_format_reward_func": 0.0,
+      "rewards/strict_format_reward_func": 0.234375,
+      "rewards/xmlcount_reward_func": 1.0340625047683716,
       "step": 18
     },
     {
+      "completion_length": 237.625,
       "epoch": 5.0,
+      "grad_norm": 61205.9296875,
+      "kl": 2955.0275300908834,
       "learning_rate": 3.4096741493194193e-09,
+      "loss": 2.2163,
+      "reward": 4.560856252908707,
+      "reward_std": 1.6822008958940085,
+      "rewards/concensus_correctness_reward_func": 1.1926666647195816,
+      "rewards/consensus_reward_func": 1.4166666666666667,
       "rewards/cumulative_reward_2": 0.0,
       "rewards/final_correctness_reward_func": 0.0,
+      "rewards/question_recreation_reward_func": 0.7548146036763986,
       "rewards/soft_format_reward_func": 0.0,
+      "rewards/strict_format_reward_func": 0.3125,
+      "rewards/xmlcount_reward_func": 0.8842083265384039,
       "step": 20
     },
     {
       "epoch": 5.0,
       "step": 20,
       "total_flos": 0.0,
+      "train_loss": 658.4579157842323,
+      "train_runtime": 121.6045,
+      "train_samples_per_second": 2.631,
+      "train_steps_per_second": 0.164
     }
   ],
   "logging_steps": 2,