Instructions to use Dassem/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-endangered_gregarious_wolf with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use Dassem/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-endangered_gregarious_wolf with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="Dassem/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-endangered_gregarious_wolf")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("Dassem/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-endangered_gregarious_wolf")
model = AutoModelForCausalLM.from_pretrained("Dassem/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-endangered_gregarious_wolf", device_map="auto")
messages = [
    {"role": "user", "content": "Who are you?"},
]
inputs = tokenizer.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Inference
Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use Dassem/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-endangered_gregarious_wolf with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "Dassem/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-endangered_gregarious_wolf"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Dassem/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-endangered_gregarious_wolf",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/Dassem/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-endangered_gregarious_wolf

SGLang

How to use Dassem/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-endangered_gregarious_wolf with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "Dassem/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-endangered_gregarious_wolf" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Dassem/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-endangered_gregarious_wolf",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "Dassem/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-endangered_gregarious_wolf" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Dassem/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-endangered_gregarious_wolf",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use Dassem/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-endangered_gregarious_wolf with Docker Model Runner:
```
docker model run hf.co/Dassem/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-endangered_gregarious_wolf
```

Dassem commited on Apr 14, 2025

Commit

4bbe497

verified ·

1 Parent(s): 465efed

End of training

Browse files

Files changed (4) hide show

all_results.json +5 -5
model.safetensors +1 -1
train_results.json +5 -5
trainer_state.json +113 -113

all_results.json CHANGED Viewed

@@ -1,8 +1,8 @@
 {
     "total_flos": 0.0,
-    "train_loss": 1.0570138692855835e-05,
-    "train_runtime": 441.8414,
-    "train_samples": 167,
-    "train_samples_per_second": 0.724,
-    "train_steps_per_second": 0.045
 }

 {
     "total_flos": 0.0,
+    "train_loss": 6.368570029735565e-06,
+    "train_runtime": 420.747,
+    "train_samples": 160,
+    "train_samples_per_second": 0.761,
+    "train_steps_per_second": 0.048
 }

model.safetensors CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:e55006339b9622027a87db74506a72e71d6d1dc6856f07eaaa64fda719df64a9
 size 1976163472

 version https://git-lfs.github.com/spec/v1
+oid sha256:0cb01c1e29f73d69b5571593082ee448ce8e393e1f33baca2fc4c73fa7534328
 size 1976163472

train_results.json CHANGED Viewed

@@ -1,8 +1,8 @@
 {
     "total_flos": 0.0,
-    "train_loss": 1.0570138692855835e-05,
-    "train_runtime": 441.8414,
-    "train_samples": 167,
-    "train_samples_per_second": 0.724,
-    "train_steps_per_second": 0.045
 }

 {
     "total_flos": 0.0,
+    "train_loss": 6.368570029735565e-06,
+    "train_runtime": 420.747,
+    "train_samples": 160,
+    "train_samples_per_second": 0.761,
+    "train_steps_per_second": 0.048
 }

trainer_state.json CHANGED Viewed

@@ -2,7 +2,7 @@
   "best_global_step": null,
   "best_metric": null,
   "best_model_checkpoint": null,
-  "epoch": 0.9580838323353293,
   "eval_steps": 500,
   "global_step": 20,
   "is_hyper_param_search": false,
@@ -10,203 +10,203 @@
   "is_world_process_zero": true,
   "log_history": [
     {
-      "completion_length": 415.5,
-      "epoch": 0.09580838323353294,
-      "grad_norm": 6.590324878692627,
       "kl": 0.0,
       "learning_rate": 4.965903258506806e-07,
       "loss": -0.0,
-      "reward": 1.0688641062006354,
-      "reward_std": 1.1941544798319228,
-      "rewards/concensus_correctness_reward_func": 0.12224999815225601,
-      "rewards/consensus_reward_func": 0.0625,
       "rewards/cumulative_reward_2": 0.0,
-      "rewards/final_correctness_reward_func": 0.1875,
-      "rewards/question_recreation_reward_func": 0.4574578560423106,
-      "rewards/soft_format_reward_func": 0.015625,
       "rewards/strict_format_reward_func": 0.0,
-      "rewards/xmlcount_reward_func": 0.22353125549852848,
       "step": 2
     },
     {
-      "completion_length": 498.25,
-      "epoch": 0.19161676646706588,
-      "grad_norm": 6.01630973815918,
-      "kl": 0.001567757119119051,
       "learning_rate": 4.698684378016222e-07,
       "loss": 0.0,
-      "reward": 2.224918434396386,
-      "reward_std": 1.4324875022284687,
-      "rewards/concensus_correctness_reward_func": 0.2709999978542328,
-      "rewards/consensus_reward_func": 0.4375,
       "rewards/cumulative_reward_2": 0.0,
-      "rewards/final_correctness_reward_func": 0.3125,
-      "rewards/question_recreation_reward_func": 0.4363559486810118,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
-      "rewards/xmlcount_reward_func": 0.7675625011324883,
       "step": 4
     },
     {
-      "completion_length": 433.84375,
-      "epoch": 0.2874251497005988,
-      "grad_norm": 5.270197868347168,
-      "kl": 0.002834886672644643,
       "learning_rate": 4.193203929064353e-07,
       "loss": 0.0,
-      "reward": 1.2953151352703571,
-      "reward_std": 1.1406873697414994,
-      "rewards/concensus_correctness_reward_func": 0.2198750004172325,
       "rewards/consensus_reward_func": 0.0625,
       "rewards/cumulative_reward_2": 0.0,
-      "rewards/final_correctness_reward_func": 0.25,
-      "rewards/question_recreation_reward_func": 0.4635963833425194,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
-      "rewards/xmlcount_reward_func": 0.29934376664459705,
       "step": 6
     },
     {
-      "completion_length": 439.25,
-      "epoch": 0.38323353293413176,
-      "grad_norm": 6.982867240905762,
-      "kl": 0.005988622659060638,
       "learning_rate": 3.5042385616324236e-07,
       "loss": 0.0,
-      "reward": 1.1002582432702184,
-      "reward_std": 1.0527176883188076,
-      "rewards/concensus_correctness_reward_func": 0.0,
-      "rewards/consensus_reward_func": 0.125,
       "rewards/cumulative_reward_2": 0.0,
-      "rewards/final_correctness_reward_func": 0.125,
-      "rewards/question_recreation_reward_func": 0.3415082353167236,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
-      "rewards/xmlcount_reward_func": 0.5087499972432852,
       "step": 8
     },
     {
-      "completion_length": 399.6875,
-      "epoch": 0.47904191616766467,
-      "grad_norm": 7.47637939453125,
-      "kl": 0.010276120985508896,
       "learning_rate": 2.706448363680831e-07,
       "loss": 0.0,
-      "reward": 1.1281967461109161,
-      "reward_std": 0.8366913658101112,
-      "rewards/concensus_correctness_reward_func": 0.0,
-      "rewards/consensus_reward_func": 0.0,
       "rewards/cumulative_reward_2": 0.0,
-      "rewards/final_correctness_reward_func": 0.0625,
-      "rewards/question_recreation_reward_func": 0.505665498203598,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
-      "rewards/xmlcount_reward_func": 0.5600312668830156,
       "step": 10
     },
     {
-      "completion_length": 360.78125,
-      "epoch": 0.5748502994011976,
-      "grad_norm": 7.185421466827393,
-      "kl": 0.012268023769138381,
       "learning_rate": 1.886286282148002e-07,
       "loss": 0.0,
-      "reward": 1.6416069380939007,
-      "reward_std": 0.7216553224716336,
-      "rewards/concensus_correctness_reward_func": 0.1198124997317791,
-      "rewards/consensus_reward_func": 0.0625,
       "rewards/cumulative_reward_2": 0.0,
-      "rewards/final_correctness_reward_func": 0.125,
-      "rewards/question_recreation_reward_func": 0.535419441992417,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
-      "rewards/xmlcount_reward_func": 0.7988750115036964,
       "step": 12
     },
     {
-      "completion_length": 330.15625,
-      "epoch": 0.6706586826347305,
-      "grad_norm": 6.425490379333496,
-      "kl": 0.013990229956107214,
       "learning_rate": 1.1326296046939333e-07,
       "loss": 0.0,
-      "reward": 1.746624268591404,
-      "reward_std": 1.062497528269887,
-      "rewards/concensus_correctness_reward_func": 0.06006250157952309,
-      "rewards/consensus_reward_func": 0.125,
       "rewards/cumulative_reward_2": 0.0,
-      "rewards/final_correctness_reward_func": 0.1875,
-      "rewards/question_recreation_reward_func": 0.6079055089503527,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
-      "rewards/xmlcount_reward_func": 0.7661562636494637,
       "step": 14
     },
     {
-      "completion_length": 391.1875,
-      "epoch": 0.7664670658682635,
-      "grad_norm": 5.87337064743042,
-      "kl": 0.018713853613007814,
       "learning_rate": 5.271487265090163e-08,
       "loss": 0.0,
-      "reward": 1.5163673851639032,
-      "reward_std": 1.113012554589659,
-      "rewards/concensus_correctness_reward_func": 0.0,
-      "rewards/consensus_reward_func": 0.0625,
       "rewards/cumulative_reward_2": 0.0,
-      "rewards/final_correctness_reward_func": 0.3125,
-      "rewards/question_recreation_reward_func": 0.5903986161574721,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
-      "rewards/xmlcount_reward_func": 0.5509687503799796,
       "step": 16
     },
     {
-      "completion_length": 407.1875,
-      "epoch": 0.8622754491017964,
-      "grad_norm": 7.867700099945068,
-      "kl": 0.016835772592457943,
       "learning_rate": 1.3545689574841341e-08,
       "loss": 0.0,
-      "reward": 1.6502499654889107,
-      "reward_std": 1.2013066527433693,
-      "rewards/concensus_correctness_reward_func": 0.276249997317791,
       "rewards/consensus_reward_func": 0.125,
       "rewards/cumulative_reward_2": 0.0,
-      "rewards/final_correctness_reward_func": 0.125,
-      "rewards/question_recreation_reward_func": 0.5613436906132847,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
-      "rewards/xmlcount_reward_func": 0.5626562647521496,
       "step": 18
     },
     {
-      "completion_length": 328.3125,
-      "epoch": 0.9580838323353293,
-      "grad_norm": 7.822503089904785,
-      "kl": 0.02378129243152216,
       "learning_rate": 0.0,
       "loss": 0.0,
-      "reward": 1.843751773238182,
-      "reward_std": 1.5181847452768125,
-      "rewards/concensus_correctness_reward_func": 0.17893750220537186,
       "rewards/consensus_reward_func": 0.25,
       "rewards/cumulative_reward_2": 0.0,
-      "rewards/final_correctness_reward_func": 0.4375,
-      "rewards/question_recreation_reward_func": 0.5598454866558313,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
-      "rewards/xmlcount_reward_func": 0.417468786239624,
       "step": 20
     },
     {
-      "epoch": 0.9580838323353293,
       "step": 20,
       "total_flos": 0.0,
-      "train_loss": 1.0570138692855835e-05,
-      "train_runtime": 441.8414,
-      "train_samples_per_second": 0.724,
-      "train_steps_per_second": 0.045
     }
   ],
   "logging_steps": 2,

   "best_global_step": null,
   "best_metric": null,
   "best_model_checkpoint": null,
+  "epoch": 1.0,
   "eval_steps": 500,
   "global_step": 20,
   "is_hyper_param_search": false,
   "is_world_process_zero": true,
   "log_history": [
     {
+      "completion_length": 350.8125,
+      "epoch": 0.1,
+      "grad_norm": 39.23478698730469,
       "kl": 0.0,
       "learning_rate": 4.965903258506806e-07,
       "loss": -0.0,
+      "reward": 1.2133730966597795,
+      "reward_std": 0.5402863117633387,
+      "rewards/concensus_correctness_reward_func": 0.0599374994635582,
+      "rewards/consensus_reward_func": 0.125,
       "rewards/cumulative_reward_2": 0.0,
+      "rewards/final_correctness_reward_func": 0.0,
+      "rewards/question_recreation_reward_func": 0.4502793492283672,
+      "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
+      "rewards/xmlcount_reward_func": 0.5781562521588057,
       "step": 2
     },
     {
+      "completion_length": 278.4375,
+      "epoch": 0.2,
+      "grad_norm": 6.766746997833252,
+      "kl": 0.001203565305331722,
       "learning_rate": 4.698684378016222e-07,
       "loss": 0.0,
+      "reward": 1.6612788662314415,
+      "reward_std": 0.6323463647277094,
+      "rewards/concensus_correctness_reward_func": 0.06006250157952309,
+      "rewards/consensus_reward_func": 0.0625,
       "rewards/cumulative_reward_2": 0.0,
+      "rewards/final_correctness_reward_func": 0.125,
+      "rewards/question_recreation_reward_func": 0.6065601068548858,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
+      "rewards/xmlcount_reward_func": 0.8071562610566616,
       "step": 4
     },
     {
+      "completion_length": 312.84375,
+      "epoch": 0.3,
+      "grad_norm": 7.9881415367126465,
+      "kl": 0.002273020745633403,
       "learning_rate": 4.193203929064353e-07,
       "loss": 0.0,
+      "reward": 1.397591108456254,
+      "reward_std": 0.8458844633860281,
+      "rewards/concensus_correctness_reward_func": 0.05868750065565109,
       "rewards/consensus_reward_func": 0.0625,
       "rewards/cumulative_reward_2": 0.0,
+      "rewards/final_correctness_reward_func": 0.1875,
+      "rewards/question_recreation_reward_func": 0.39743484029895626,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
+      "rewards/xmlcount_reward_func": 0.6914687640964985,
       "step": 6
     },
     {
+      "completion_length": 375.46875,
+      "epoch": 0.4,
+      "grad_norm": 5.538845062255859,
+      "kl": 0.0035255207076261286,
       "learning_rate": 3.5042385616324236e-07,
       "loss": 0.0,
+      "reward": 1.8364141806960106,
+      "reward_std": 0.7308946952689439,
+      "rewards/concensus_correctness_reward_func": 0.1797499991953373,
+      "rewards/consensus_reward_func": 0.3125,
       "rewards/cumulative_reward_2": 0.0,
+      "rewards/final_correctness_reward_func": 0.0,
+      "rewards/question_recreation_reward_func": 0.5836954447440803,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
+      "rewards/xmlcount_reward_func": 0.7604687586426735,
       "step": 8
     },
     {
+      "completion_length": 301.3125,
+      "epoch": 0.5,
+      "grad_norm": 8.966378211975098,
+      "kl": 0.006074020639061928,
       "learning_rate": 2.706448363680831e-07,
       "loss": 0.0,
+      "reward": 1.8557742610573769,
+      "reward_std": 0.673103028557307,
+      "rewards/concensus_correctness_reward_func": 0.05999999865889549,
+      "rewards/consensus_reward_func": 0.0625,
       "rewards/cumulative_reward_2": 0.0,
+      "rewards/final_correctness_reward_func": 0.25,
+      "rewards/question_recreation_reward_func": 0.583211736753583,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
+      "rewards/xmlcount_reward_func": 0.9000625386834145,
       "step": 10
     },
     {
+      "completion_length": 513.09375,
+      "epoch": 0.6,
+      "grad_norm": 5.500680923461914,
+      "kl": 0.0054717185339541174,
       "learning_rate": 1.886286282148002e-07,
       "loss": 0.0,
+      "reward": 1.3633840680122375,
+      "reward_std": 1.3847295328741893,
+      "rewards/concensus_correctness_reward_func": 0.22243749722838402,
+      "rewards/consensus_reward_func": 0.1875,
       "rewards/cumulative_reward_2": 0.0,
+      "rewards/final_correctness_reward_func": 0.1875,
+      "rewards/question_recreation_reward_func": 0.5454153548926115,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
+      "rewards/xmlcount_reward_func": 0.22053123265504837,
       "step": 12
     },
     {
+      "completion_length": 355.75,
+      "epoch": 0.7,
+      "grad_norm": 6.750906944274902,
+      "kl": 0.01095420480123721,
       "learning_rate": 1.1326296046939333e-07,
       "loss": 0.0,
+      "reward": 2.009573094546795,
+      "reward_std": 1.0107755847275257,
+      "rewards/concensus_correctness_reward_func": 0.0,
+      "rewards/consensus_reward_func": 0.1875,
       "rewards/cumulative_reward_2": 0.0,
+      "rewards/final_correctness_reward_func": 0.4375,
+      "rewards/question_recreation_reward_func": 0.5910418333951384,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
+      "rewards/xmlcount_reward_func": 0.7935312613844872,
       "step": 14
     },
     {
+      "completion_length": 387.34375,
+      "epoch": 0.8,
+      "grad_norm": 7.572938919067383,
+      "kl": 0.009205558279063553,
       "learning_rate": 5.271487265090163e-08,
       "loss": 0.0,
+      "reward": 1.7320444360375404,
+      "reward_std": 0.9637731028778944,
+      "rewards/concensus_correctness_reward_func": 0.12006250023841858,
+      "rewards/consensus_reward_func": 0.3125,
       "rewards/cumulative_reward_2": 0.0,
+      "rewards/final_correctness_reward_func": 0.1875,
+      "rewards/question_recreation_reward_func": 0.40157566242851317,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
+      "rewards/xmlcount_reward_func": 0.7104062773287296,
       "step": 16
     },
     {
+      "completion_length": 418.53125,
+      "epoch": 0.9,
+      "grad_norm": 5.404604434967041,
+      "kl": 0.012272321924683638,
       "learning_rate": 1.3545689574841341e-08,
       "loss": 0.0,
+      "reward": 1.2925836332142353,
+      "reward_std": 1.1542230368359014,
+      "rewards/concensus_correctness_reward_func": 0.2397499978542328,
       "rewards/consensus_reward_func": 0.125,
       "rewards/cumulative_reward_2": 0.0,
+      "rewards/final_correctness_reward_func": 0.0,
+      "rewards/question_recreation_reward_func": 0.5634898480493575,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
+      "rewards/xmlcount_reward_func": 0.3643437512218952,
       "step": 18
     },
     {
+      "completion_length": 382.40625,
+      "epoch": 1.0,
+      "grad_norm": 6.85258674621582,
+      "kl": 0.009818575592362322,
       "learning_rate": 0.0,
       "loss": 0.0,
+      "reward": 1.7785236164927483,
+      "reward_std": 1.1780102625489235,
+      "rewards/concensus_correctness_reward_func": 0.0,
       "rewards/consensus_reward_func": 0.25,
       "rewards/cumulative_reward_2": 0.0,
+      "rewards/final_correctness_reward_func": 0.1875,
+      "rewards/question_recreation_reward_func": 0.7126173116266727,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
+      "rewards/xmlcount_reward_func": 0.6284062843769789,
       "step": 20
     },
     {
+      "epoch": 1.0,
       "step": 20,
       "total_flos": 0.0,
+      "train_loss": 6.368570029735565e-06,
+      "train_runtime": 420.747,
+      "train_samples_per_second": 0.761,
+      "train_steps_per_second": 0.048
     }
   ],
   "logging_steps": 2,