Instructions to use Dassem/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-endangered_gregarious_wolf with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use Dassem/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-endangered_gregarious_wolf with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="Dassem/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-endangered_gregarious_wolf")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("Dassem/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-endangered_gregarious_wolf")
model = AutoModelForCausalLM.from_pretrained("Dassem/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-endangered_gregarious_wolf", device_map="auto")
messages = [
    {"role": "user", "content": "Who are you?"},
]
inputs = tokenizer.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Inference
Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use Dassem/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-endangered_gregarious_wolf with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "Dassem/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-endangered_gregarious_wolf"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Dassem/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-endangered_gregarious_wolf",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/Dassem/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-endangered_gregarious_wolf

SGLang

How to use Dassem/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-endangered_gregarious_wolf with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "Dassem/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-endangered_gregarious_wolf" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Dassem/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-endangered_gregarious_wolf",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "Dassem/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-endangered_gregarious_wolf" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Dassem/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-endangered_gregarious_wolf",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use Dassem/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-endangered_gregarious_wolf with Docker Model Runner:
```
docker model run hf.co/Dassem/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-endangered_gregarious_wolf
```

Dassem commited on Apr 26, 2025

Commit

05b46d1

verified ·

1 Parent(s): 5d1c235

End of training

Browse files

Files changed (4) hide show

all_results.json +4 -4
model.safetensors +1 -1
train_results.json +4 -4
trainer_state.json +95 -95

all_results.json CHANGED Viewed

@@ -1,8 +1,8 @@
 {
     "total_flos": 0.0,
-    "train_loss": 9.621307253837585e-06,
-    "train_runtime": 259.9081,
     "train_samples": 28,
-    "train_samples_per_second": 1.231,
-    "train_steps_per_second": 0.077
 }

 {
     "total_flos": 0.0,
+    "train_loss": 6.159024360385957e-06,
+    "train_runtime": 251.5233,
     "train_samples": 28,
+    "train_samples_per_second": 1.272,
+    "train_steps_per_second": 0.08
 }

model.safetensors CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:f565c636e9aeca3c1eeaf279f940c0e0fb3140a399ac1a32a336cba58a35bdba
 size 1976163472

 version https://git-lfs.github.com/spec/v1
+oid sha256:b97146029a3d6902a1a99a020dd91f84074e50e4c2982834c2434fc13e9dd12f
 size 1976163472

train_results.json CHANGED Viewed

@@ -1,8 +1,8 @@
 {
     "total_flos": 0.0,
-    "train_loss": 9.621307253837585e-06,
-    "train_runtime": 259.9081,
     "train_samples": 28,
-    "train_samples_per_second": 1.231,
-    "train_steps_per_second": 0.077
 }

 {
     "total_flos": 0.0,
+    "train_loss": 6.159024360385957e-06,
+    "train_runtime": 251.5233,
     "train_samples": 28,
+    "train_samples_per_second": 1.272,
+    "train_steps_per_second": 0.08
 }

trainer_state.json CHANGED Viewed

@@ -10,203 +10,203 @@
   "is_world_process_zero": true,
   "log_history": [
     {
-      "completion_length": 362.09375,
       "epoch": 0.5714285714285714,
-      "grad_norm": 14.412296295166016,
       "kl": 0.0,
       "learning_rate": 5e-07,
-      "loss": 0.0,
-      "reward": 0.3404485130449757,
-      "reward_std": 0.3901447501266375,
-      "rewards/concensus_correctness_reward_func": 0.0,
       "rewards/consensus_reward_func": 0.0625,
       "rewards/cumulative_reward_2": 0.0,
-      "rewards/final_correctness_reward_func": 0.0,
-      "rewards/question_recreation_reward_func": 0.2247297635767609,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
-      "rewards/xmlcount_reward_func": 0.053218753542751074,
       "step": 2
     },
     {
-      "completion_length": 433.25,
       "epoch": 1.0,
-      "grad_norm": 69.4848861694336,
-      "kl": 0.00244874848673741,
       "learning_rate": 4.864543104251586e-07,
       "loss": 0.0,
-      "reward": 0.2414621990174055,
-      "reward_std": 0.6832583195840319,
       "rewards/concensus_correctness_reward_func": 0.0,
       "rewards/consensus_reward_func": 0.0,
       "rewards/cumulative_reward_2": 0.0,
-      "rewards/final_correctness_reward_func": 0.0,
-      "rewards/question_recreation_reward_func": 0.29162884938220185,
       "rewards/soft_format_reward_func": 0.0,
-      "rewards/strict_format_reward_func": 0.020833333333333332,
-      "rewards/xmlcount_reward_func": -0.07099999239047368,
       "step": 4
     },
     {
-      "completion_length": 392.625,
       "epoch": 1.5714285714285714,
-      "grad_norm": 21.58070945739746,
-      "kl": 0.0024698951056052465,
       "learning_rate": 4.472851273490984e-07,
       "loss": 0.0,
-      "reward": 0.2324746486847289,
-      "reward_std": 0.5357207235938404,
-      "rewards/concensus_correctness_reward_func": 0.0,
-      "rewards/consensus_reward_func": 0.0,
       "rewards/cumulative_reward_2": 0.0,
       "rewards/final_correctness_reward_func": 0.0625,
-      "rewards/question_recreation_reward_func": 0.19231839658459648,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
-      "rewards/xmlcount_reward_func": -0.022343751043081284,
       "step": 6
     },
     {
-      "completion_length": 325.625,
       "epoch": 2.0,
-      "grad_norm": 11.49186897277832,
-      "kl": 0.0025589913954415047,
       "learning_rate": 3.867370395306068e-07,
       "loss": 0.0,
-      "reward": 0.6439184316744407,
-      "reward_std": 0.5397129058837891,
-      "rewards/concensus_correctness_reward_func": 0.0,
-      "rewards/consensus_reward_func": 0.0,
       "rewards/cumulative_reward_2": 0.0,
       "rewards/final_correctness_reward_func": 0.08333333333333333,
-      "rewards/question_recreation_reward_func": 0.3004184352854888,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
-      "rewards/xmlcount_reward_func": 0.2601666580885649,
       "step": 8
     },
     {
-      "completion_length": 416.59375,
       "epoch": 2.571428571428571,
-      "grad_norm": 8.94789981842041,
-      "kl": 0.0016893130123207811,
       "learning_rate": 3.1137137178519977e-07,
       "loss": 0.0,
-      "reward": 0.3475042908685282,
-      "reward_std": 0.3113538746983977,
-      "rewards/concensus_correctness_reward_func": 0.05818749964237213,
-      "rewards/consensus_reward_func": 0.0,
       "rewards/cumulative_reward_2": 0.0,
-      "rewards/final_correctness_reward_func": 0.0625,
-      "rewards/question_recreation_reward_func": 0.20494177693035454,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
-      "rewards/xmlcount_reward_func": 0.021874997939448804,
       "step": 10
     },
     {
-      "completion_length": 429.125,
       "epoch": 3.0,
-      "grad_norm": 2.964622735977173,
-      "kl": 0.0019967772241216153,
       "learning_rate": 2.2935516363191693e-07,
       "loss": 0.0,
-      "reward": 0.6546486181517442,
-      "reward_std": 1.091391807422042,
-      "rewards/concensus_correctness_reward_func": 0.03108333299557368,
       "rewards/consensus_reward_func": 0.08333333333333333,
       "rewards/cumulative_reward_2": 0.0,
-      "rewards/final_correctness_reward_func": 0.08333333333333333,
-      "rewards/question_recreation_reward_func": 0.3737736064940691,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
-      "rewards/xmlcount_reward_func": 0.08312500547617674,
       "step": 12
     },
     {
-      "completion_length": 371.03125,
       "epoch": 3.571428571428571,
-      "grad_norm": 74.50118255615234,
-      "kl": 0.017281179178098682,
       "learning_rate": 1.4957614383675767e-07,
       "loss": 0.0,
-      "reward": 1.3337524321395904,
-      "reward_std": 1.3375077265081927,
-      "rewards/concensus_correctness_reward_func": 0.625,
-      "rewards/consensus_reward_func": 0.1875,
       "rewards/cumulative_reward_2": 0.0,
       "rewards/final_correctness_reward_func": 0.125,
-      "rewards/question_recreation_reward_func": 0.37700244621373713,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
-      "rewards/xmlcount_reward_func": 0.01924999919719994,
       "step": 14
     },
     {
-      "completion_length": 442.5416666666667,
       "epoch": 4.0,
-      "grad_norm": 10.510387420654297,
-      "kl": 0.0020015218178741634,
       "learning_rate": 8.067960709356478e-08,
       "loss": 0.0,
-      "reward": 0.5103981997817755,
-      "reward_std": 0.43561570610230166,
       "rewards/concensus_correctness_reward_func": 0.0,
       "rewards/consensus_reward_func": 0.0,
       "rewards/cumulative_reward_2": 0.0,
       "rewards/final_correctness_reward_func": 0.0,
-      "rewards/question_recreation_reward_func": 0.31023154927728075,
-      "rewards/soft_format_reward_func": 0.020833333333333332,
       "rewards/strict_format_reward_func": 0.0,
-      "rewards/xmlcount_reward_func": 0.17933333230515322,
       "step": 16
     },
     {
-      "completion_length": 430.53125,
       "epoch": 4.571428571428571,
-      "grad_norm": 66.9266128540039,
-      "kl": 0.06649112041122862,
       "learning_rate": 3.013156219837776e-08,
-      "loss": 0.0001,
-      "reward": 0.6887526210630313,
-      "reward_std": 0.42437634128145874,
-      "rewards/concensus_correctness_reward_func": 0.18199999630451202,
-      "rewards/consensus_reward_func": 0.0,
       "rewards/cumulative_reward_2": 0.0,
-      "rewards/final_correctness_reward_func": 0.0625,
-      "rewards/question_recreation_reward_func": 0.39440888294484466,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
-      "rewards/xmlcount_reward_func": 0.04984374903142452,
       "step": 18
     },
     {
-      "completion_length": 463.0416666666667,
       "epoch": 5.0,
-      "grad_norm": 3.526484251022339,
-      "kl": 0.001942666174727492,
       "learning_rate": 3.4096741493194193e-09,
       "loss": 0.0,
-      "reward": 0.5547090771918496,
-      "reward_std": 0.50304777516673,
       "rewards/concensus_correctness_reward_func": 0.0,
       "rewards/consensus_reward_func": 0.0,
       "rewards/cumulative_reward_2": 0.0,
-      "rewards/final_correctness_reward_func": 0.08333333333333333,
-      "rewards/question_recreation_reward_func": 0.28120908606797457,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
-      "rewards/xmlcount_reward_func": 0.19016666834553084,
       "step": 20
     },
     {
       "epoch": 5.0,
       "step": 20,
       "total_flos": 0.0,
-      "train_loss": 9.621307253837585e-06,
-      "train_runtime": 259.9081,
-      "train_samples_per_second": 1.231,
-      "train_steps_per_second": 0.077
     }
   ],
   "logging_steps": 2,

   "is_world_process_zero": true,
   "log_history": [
     {
+      "completion_length": 373.3125,
       "epoch": 0.5714285714285714,
+      "grad_norm": 12.721521377563477,
       "kl": 0.0,
       "learning_rate": 5e-07,
+      "loss": -0.0,
+      "reward": 0.6337238922715187,
+      "reward_std": 0.8192780795507133,
+      "rewards/concensus_correctness_reward_func": 0.029625000432133675,
       "rewards/consensus_reward_func": 0.0625,
       "rewards/cumulative_reward_2": 0.0,
+      "rewards/final_correctness_reward_func": 0.125,
+      "rewards/question_recreation_reward_func": 0.3876613983884454,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
+      "rewards/xmlcount_reward_func": 0.02893749810755253,
       "step": 2
     },
     {
+      "completion_length": 413.7916666666667,
       "epoch": 1.0,
+      "grad_norm": 4.761530876159668,
+      "kl": 0.0013436360168270767,
       "learning_rate": 4.864543104251586e-07,
       "loss": 0.0,
+      "reward": 0.39725161405901116,
+      "reward_std": 0.6916197271202691,
       "rewards/concensus_correctness_reward_func": 0.0,
       "rewards/consensus_reward_func": 0.0,
       "rewards/cumulative_reward_2": 0.0,
+      "rewards/final_correctness_reward_func": 0.08333333333333333,
+      "rewards/question_recreation_reward_func": 0.4218766263220459,
       "rewards/soft_format_reward_func": 0.0,
+      "rewards/strict_format_reward_func": 0.0,
+      "rewards/xmlcount_reward_func": -0.10795833294590314,
       "step": 4
     },
     {
+      "completion_length": 402.0625,
       "epoch": 1.5714285714285714,
+      "grad_norm": 7.005701065063477,
+      "kl": 0.0043652126564666105,
       "learning_rate": 4.472851273490984e-07,
       "loss": 0.0,
+      "reward": 0.2650040991138667,
+      "reward_std": 0.9289465721230954,
+      "rewards/concensus_correctness_reward_func": 0.04962500184774399,
+      "rewards/consensus_reward_func": 0.0625,
       "rewards/cumulative_reward_2": 0.0,
       "rewards/final_correctness_reward_func": 0.0625,
+      "rewards/question_recreation_reward_func": 0.3625978466589004,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
+      "rewards/xmlcount_reward_func": -0.2722187456674874,
       "step": 6
     },
     {
+      "completion_length": 389.8333333333333,
       "epoch": 2.0,
+      "grad_norm": 3.693321466445923,
+      "kl": 0.006320482226631914,
       "learning_rate": 3.867370395306068e-07,
       "loss": 0.0,
+      "reward": 0.723500526510179,
+      "reward_std": 0.8114089080142245,
+      "rewards/concensus_correctness_reward_func": 0.09658333162466685,
+      "rewards/consensus_reward_func": 0.08333333333333333,
       "rewards/cumulative_reward_2": 0.0,
       "rewards/final_correctness_reward_func": 0.08333333333333333,
+      "rewards/question_recreation_reward_func": 0.28512553094575804,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
+      "rewards/xmlcount_reward_func": 0.17512500441322723,
       "step": 8
     },
     {
+      "completion_length": 464.78125,
       "epoch": 2.571428571428571,
+      "grad_norm": 8.750946044921875,
+      "kl": 0.010199482705502305,
       "learning_rate": 3.1137137178519977e-07,
       "loss": 0.0,
+      "reward": 0.5925948545336723,
+      "reward_std": 0.616401256644167,
+      "rewards/concensus_correctness_reward_func": 0.059312501922249794,
+      "rewards/consensus_reward_func": 0.125,
       "rewards/cumulative_reward_2": 0.0,
+      "rewards/final_correctness_reward_func": 0.0,
+      "rewards/question_recreation_reward_func": 0.24440734065137804,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
+      "rewards/xmlcount_reward_func": 0.16387499310076237,
       "step": 10
     },
     {
+      "completion_length": 410.5833333333333,
       "epoch": 3.0,
+      "grad_norm": 31.956483840942383,
+      "kl": 0.0073598485566132394,
       "learning_rate": 2.2935516363191693e-07,
       "loss": 0.0,
+      "reward": 1.8726027936985095,
+      "reward_std": 2.093750330619514,
+      "rewards/concensus_correctness_reward_func": 0.9338333308696747,
       "rewards/consensus_reward_func": 0.08333333333333333,
       "rewards/cumulative_reward_2": 0.0,
+      "rewards/final_correctness_reward_func": 0.25,
+      "rewards/question_recreation_reward_func": 0.41693614966546494,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
+      "rewards/xmlcount_reward_func": 0.18850001133978367,
       "step": 12
     },
     {
+      "completion_length": 440.0,
       "epoch": 3.571428571428571,
+      "grad_norm": 5.838773727416992,
+      "kl": 0.010793021618155763,
       "learning_rate": 1.4957614383675767e-07,
       "loss": 0.0,
+      "reward": 0.896556275896728,
+      "reward_std": 0.7366606779396534,
+      "rewards/concensus_correctness_reward_func": 0.0,
+      "rewards/consensus_reward_func": 0.0,
       "rewards/cumulative_reward_2": 0.0,
       "rewards/final_correctness_reward_func": 0.125,
+      "rewards/question_recreation_reward_func": 0.41411877353675663,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
+      "rewards/xmlcount_reward_func": 0.3574374947929755,
       "step": 14
     },
     {
+      "completion_length": 398.75,
       "epoch": 4.0,
+      "grad_norm": 3.0343410968780518,
+      "kl": 0.013043173685825119,
       "learning_rate": 8.067960709356478e-08,
       "loss": 0.0,
+      "reward": 0.4484976716339588,
+      "reward_std": 0.3989091912323299,
       "rewards/concensus_correctness_reward_func": 0.0,
       "rewards/consensus_reward_func": 0.0,
       "rewards/cumulative_reward_2": 0.0,
       "rewards/final_correctness_reward_func": 0.0,
+      "rewards/question_recreation_reward_func": 0.2520393381516139,
+      "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
+      "rewards/xmlcount_reward_func": 0.1964583322405815,
       "step": 16
     },
     {
+      "completion_length": 359.625,
       "epoch": 4.571428571428571,
+      "grad_norm": 13.111617088317871,
+      "kl": 0.00449962646507629,
       "learning_rate": 3.013156219837776e-08,
+      "loss": 0.0,
+      "reward": 0.7339650362264365,
+      "reward_std": 0.5837594727054238,
+      "rewards/concensus_correctness_reward_func": 0.0078125,
+      "rewards/consensus_reward_func": 0.0625,
       "rewards/cumulative_reward_2": 0.0,
+      "rewards/final_correctness_reward_func": 0.125,
+      "rewards/question_recreation_reward_func": 0.3207775351474993,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
+      "rewards/xmlcount_reward_func": 0.21787500017671846,
       "step": 18
     },
     {
+      "completion_length": 328.7916666666667,
       "epoch": 5.0,
+      "grad_norm": 3.9578590393066406,
+      "kl": 0.00812044293464472,
       "learning_rate": 3.4096741493194193e-09,
       "loss": 0.0,
+      "reward": 0.5812163427472115,
+      "reward_std": 0.6513330979893605,
       "rewards/concensus_correctness_reward_func": 0.0,
       "rewards/consensus_reward_func": 0.0,
       "rewards/cumulative_reward_2": 0.0,
+      "rewards/final_correctness_reward_func": 0.0,
+      "rewards/question_recreation_reward_func": 0.5378413231422504,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
+      "rewards/xmlcount_reward_func": 0.0433750090499719,
       "step": 20
     },
     {
       "epoch": 5.0,
       "step": 20,
       "total_flos": 0.0,
+      "train_loss": 6.159024360385957e-06,
+      "train_runtime": 251.5233,
+      "train_samples_per_second": 1.272,
+      "train_steps_per_second": 0.08
     }
   ],
   "logging_steps": 2,