Instructions to use hamid1232/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-yapping_giant_lizard with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use hamid1232/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-yapping_giant_lizard with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="hamid1232/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-yapping_giant_lizard")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("hamid1232/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-yapping_giant_lizard")
model = AutoModelForCausalLM.from_pretrained("hamid1232/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-yapping_giant_lizard", device_map="auto")
messages = [
    {"role": "user", "content": "Who are you?"},
]
inputs = tokenizer.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use hamid1232/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-yapping_giant_lizard with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "hamid1232/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-yapping_giant_lizard"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "hamid1232/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-yapping_giant_lizard",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/hamid1232/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-yapping_giant_lizard

SGLang

How to use hamid1232/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-yapping_giant_lizard with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "hamid1232/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-yapping_giant_lizard" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "hamid1232/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-yapping_giant_lizard",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "hamid1232/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-yapping_giant_lizard" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "hamid1232/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-yapping_giant_lizard",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Unsloth Studio

How to use hamid1232/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-yapping_giant_lizard with Unsloth Studio:

Install Unsloth Studio (macOS, Linux, WSL)

curl -fsSL https://unsloth.ai/install.sh | sh
# Run unsloth studio
unsloth studio -H 0.0.0.0 -p 8888
# Then open http://localhost:8888 in your browser
# Search for hamid1232/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-yapping_giant_lizard to start chatting

Install Unsloth Studio (Windows)

irm https://unsloth.ai/install.ps1 | iex
# Run unsloth studio
unsloth studio -H 0.0.0.0 -p 8888
# Then open http://localhost:8888 in your browser
# Search for hamid1232/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-yapping_giant_lizard to start chatting

Using HuggingFace Spaces for Unsloth

# No setup required
# Open https://huggingface.co/spaces/unsloth/studio in your browser
# Search for hamid1232/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-yapping_giant_lizard to start chatting

Load model with FastModel

pip install unsloth
from unsloth import FastModel
model, tokenizer = FastModel.from_pretrained(
    model_name="hamid1232/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-yapping_giant_lizard",
    max_seq_length=2048,
)

Docker Model Runner
How to use hamid1232/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-yapping_giant_lizard with Docker Model Runner:
```
docker model run hf.co/hamid1232/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-yapping_giant_lizard
```

hamid1232 commited on Jun 6, 2025

Commit

0720cda

verified ·

1 Parent(s): 9d68a07

End of training

Browse files

Files changed (4) hide show

adapter_model.safetensors +1 -1
all_results.json +5 -5
train_results.json +5 -5
trainer_state.json +129 -129

adapter_model.safetensors CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:0c98a2b346ac9ea4940de74a5e98c9b1d03de6d1cfa114c27c548ae808ba5b29
 size 35237104

 version https://git-lfs.github.com/spec/v1
+oid sha256:b5004260c114700898854136ae4ba9b98b7f8da001e06b21a6b6f504ca617517
 size 35237104

all_results.json CHANGED Viewed

@@ -1,8 +1,8 @@
 {
     "total_flos": 0.0,
-    "train_loss": 0.00015581278858007864,
-    "train_runtime": 728.6579,
-    "train_samples": 17,
-    "train_samples_per_second": 0.439,
-    "train_steps_per_second": 0.027
 }

 {
     "total_flos": 0.0,
+    "train_loss": 0.00010353847828810103,
+    "train_runtime": 860.6355,
+    "train_samples": 23,
+    "train_samples_per_second": 0.372,
+    "train_steps_per_second": 0.023
 }

train_results.json CHANGED Viewed

@@ -1,8 +1,8 @@
 {
     "total_flos": 0.0,
-    "train_loss": 0.00015581278858007864,
-    "train_runtime": 728.6579,
-    "train_samples": 17,
-    "train_samples_per_second": 0.439,
-    "train_steps_per_second": 0.027
 }

 {
     "total_flos": 0.0,
+    "train_loss": 0.00010353847828810103,
+    "train_runtime": 860.6355,
+    "train_samples": 23,
+    "train_samples_per_second": 0.372,
+    "train_steps_per_second": 0.023
 }

trainer_state.json CHANGED Viewed

@@ -2,7 +2,7 @@
   "best_global_step": null,
   "best_metric": null,
   "best_model_checkpoint": null,
-  "epoch": 4.0,
   "eval_steps": 500,
   "global_step": 20,
   "is_hyper_param_search": false,
@@ -10,209 +10,209 @@
   "is_world_process_zero": true,
   "log_history": [
     {
-      "completion_length": 274.71875,
-      "epoch": 0.47058823529411764,
-      "grad_norm": 3.241546392440796,
-      "kl": 0.15508742071688175,
       "learning_rate": 5e-07,
-      "loss": 0.0002,
-      "reward": 1.6215539574623108,
-      "reward_std": 1.110968180000782,
-      "rewards/concensus_correctness_reward_func": 0.1798749975860119,
-      "rewards/consensus_reward_func": 0.1875,
       "rewards/cumulative_reward_2": 0.0,
-      "rewards/final_correctness_reward_func": 0.0,
-      "rewards/question_recreation_reward_func": 0.5389602072536945,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
-      "rewards/xmlcount_reward_func": 0.7152187526226044,
       "step": 2
     },
     {
-      "completion_length": 266.75,
-      "epoch": 0.9411764705882353,
-      "grad_norm": 3.5105037689208984,
-      "kl": 0.20349964313209057,
       "learning_rate": 4.864543104251586e-07,
       "loss": 0.0002,
-      "reward": 2.2352835088968277,
-      "reward_std": 1.7548170946538448,
-      "rewards/concensus_correctness_reward_func": 0.30174999311566353,
-      "rewards/consensus_reward_func": 0.25,
       "rewards/cumulative_reward_2": 0.0,
-      "rewards/final_correctness_reward_func": 0.75,
-      "rewards/question_recreation_reward_func": 0.44553349167108536,
       "rewards/soft_format_reward_func": 0.0,
-      "rewards/strict_format_reward_func": 0.0,
-      "rewards/xmlcount_reward_func": 0.4880000054836273,
       "step": 4
     },
     {
-      "completion_length": 231.25,
-      "epoch": 1.2352941176470589,
-      "grad_norm": 1.800493836402893,
-      "kl": 0.14625276923179625,
       "learning_rate": 4.472851273490984e-07,
       "loss": 0.0001,
-      "reward": 1.7385125279426574,
-      "reward_std": 1.1625995695590974,
-      "rewards/concensus_correctness_reward_func": 0.19190000295639037,
-      "rewards/consensus_reward_func": 0.2,
       "rewards/cumulative_reward_2": 0.0,
-      "rewards/final_correctness_reward_func": 0.0,
-      "rewards/question_recreation_reward_func": 0.6537625133991242,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
-      "rewards/xmlcount_reward_func": 0.6928500056266784,
       "step": 6
     },
     {
-      "completion_length": 242.3125,
-      "epoch": 1.7058823529411766,
-      "grad_norm": 2.63136625289917,
-      "kl": 0.16444904496893287,
       "learning_rate": 3.867370395306068e-07,
-      "loss": 0.0002,
-      "reward": 1.6977746412158012,
-      "reward_std": 1.073176771402359,
-      "rewards/concensus_correctness_reward_func": 0.17999999597668648,
-      "rewards/consensus_reward_func": 0.1875,
       "rewards/cumulative_reward_2": 0.0,
-      "rewards/final_correctness_reward_func": 0.1875,
-      "rewards/question_recreation_reward_func": 0.40999341383576393,
       "rewards/soft_format_reward_func": 0.0,
-      "rewards/strict_format_reward_func": 0.015625,
-      "rewards/xmlcount_reward_func": 0.7171562537550926,
       "step": 8
     },
     {
-      "completion_length": 271.85,
-      "epoch": 2.0,
-      "grad_norm": 1.4754101037979126,
-      "kl": 0.22022174149751664,
       "learning_rate": 3.1137137178519977e-07,
       "loss": 0.0001,
-      "reward": 2.0342857599258424,
-      "reward_std": 1.8073164343833923,
-      "rewards/concensus_correctness_reward_func": 0.29200000166893003,
-      "rewards/consensus_reward_func": 0.3,
       "rewards/cumulative_reward_2": 0.0,
-      "rewards/final_correctness_reward_func": 0.8,
-      "rewards/question_recreation_reward_func": 0.354585862159729,
       "rewards/soft_format_reward_func": 0.0,
-      "rewards/strict_format_reward_func": 0.0,
-      "rewards/xmlcount_reward_func": 0.2876999735832214,
       "step": 10
     },
     {
-      "completion_length": 235.125,
-      "epoch": 2.4705882352941178,
-      "grad_norm": 1.8735486268997192,
-      "kl": 0.23147841775789857,
       "learning_rate": 2.2935516363191693e-07,
-      "loss": 0.0002,
-      "reward": 2.1679425835609436,
-      "reward_std": 1.039525599218905,
-      "rewards/concensus_correctness_reward_func": 0.1822499968111515,
-      "rewards/consensus_reward_func": 0.125,
       "rewards/cumulative_reward_2": 0.0,
-      "rewards/final_correctness_reward_func": 0.625,
-      "rewards/question_recreation_reward_func": 0.5657239258289337,
-      "rewards/soft_format_reward_func": 0.0,
-      "rewards/strict_format_reward_func": 0.0,
-      "rewards/xmlcount_reward_func": 0.6699687549844384,
       "step": 12
     },
     {
-      "completion_length": 347.25,
-      "epoch": 2.9411764705882355,
-      "grad_norm": 1.921480417251587,
-      "kl": 0.11163338273763657,
       "learning_rate": 1.4957614383675767e-07,
       "loss": 0.0001,
-      "reward": 0.9966101981699467,
-      "reward_std": 0.9846028909087181,
-      "rewards/concensus_correctness_reward_func": 0.05999999865889549,
       "rewards/consensus_reward_func": 0.0625,
       "rewards/cumulative_reward_2": 0.0,
-      "rewards/final_correctness_reward_func": 0.0,
-      "rewards/question_recreation_reward_func": 0.4506727196276188,
-      "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
-      "rewards/xmlcount_reward_func": 0.42343749664723873,
       "step": 14
     },
     {
-      "completion_length": 184.35,
-      "epoch": 3.235294117647059,
-      "grad_norm": 2.502647638320923,
-      "kl": 0.24826591908931733,
       "learning_rate": 8.067960709356478e-08,
-      "loss": 0.0002,
-      "reward": 3.4231114387512207,
-      "reward_std": 2.127429389953613,
-      "rewards/concensus_correctness_reward_func": 0.8712000012397766,
-      "rewards/consensus_reward_func": 0.7,
       "rewards/cumulative_reward_2": 0.0,
-      "rewards/final_correctness_reward_func": 0.7,
-      "rewards/question_recreation_reward_func": 0.2681114345788956,
-      "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
-      "rewards/xmlcount_reward_func": 0.8838000178337098,
       "step": 16
     },
     {
-      "completion_length": 253.375,
-      "epoch": 3.7058823529411766,
-      "grad_norm": 2.3626856803894043,
-      "kl": 0.15681543154641986,
       "learning_rate": 3.013156219837776e-08,
-      "loss": 0.0002,
-      "reward": 2.1241530403494835,
-      "reward_std": 1.2047220133244991,
-      "rewards/concensus_correctness_reward_func": 0.2998124919831753,
-      "rewards/consensus_reward_func": 0.3125,
       "rewards/cumulative_reward_2": 0.0,
-      "rewards/final_correctness_reward_func": 0.25,
-      "rewards/question_recreation_reward_func": 0.5122155956923962,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
-      "rewards/xmlcount_reward_func": 0.749624989926815,
       "step": 18
     },
     {
-      "completion_length": 330.8,
-      "epoch": 4.0,
-      "grad_norm": 1.34980046749115,
-      "kl": 0.24179004430770873,
       "learning_rate": 3.4096741493194193e-09,
-      "loss": 0.0002,
-      "reward": 1.54414963722229,
-      "reward_std": 1.069698616862297,
-      "rewards/concensus_correctness_reward_func": 0.0,
-      "rewards/consensus_reward_func": 0.0,
       "rewards/cumulative_reward_2": 0.0,
-      "rewards/final_correctness_reward_func": 0.5,
-      "rewards/question_recreation_reward_func": 0.5736496210098266,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
-      "rewards/xmlcount_reward_func": 0.47049999237060547,
       "step": 20
     },
     {
-      "epoch": 4.0,
       "step": 20,
       "total_flos": 0.0,
-      "train_loss": 0.00015581278858007864,
-      "train_runtime": 728.6579,
-      "train_samples_per_second": 0.439,
-      "train_steps_per_second": 0.027
     }
   ],
   "logging_steps": 2,
   "max_steps": 20,
   "num_input_tokens_seen": 0,
-  "num_train_epochs": 5,
   "save_steps": 25,
   "stateful_callbacks": {
     "TrainerControl": {

   "best_global_step": null,
   "best_metric": null,
   "best_model_checkpoint": null,
+  "epoch": 3.3478260869565215,
   "eval_steps": 500,
   "global_step": 20,
   "is_hyper_param_search": false,
   "is_world_process_zero": true,
   "log_history": [
     {
+      "completion_length": 427.0625,
+      "epoch": 0.34782608695652173,
+      "grad_norm": 1.831247329711914,
+      "kl": 0.08465925557538867,
       "learning_rate": 5e-07,
+      "loss": 0.0001,
+      "reward": 1.4951009973883629,
+      "reward_std": 1.9578552730381489,
+      "rewards/concensus_correctness_reward_func": 0.306937500834465,
+      "rewards/consensus_reward_func": 0.5,
       "rewards/cumulative_reward_2": 0.0,
+      "rewards/final_correctness_reward_func": 0.125,
+      "rewards/question_recreation_reward_func": 0.3920697569847107,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
+      "rewards/xmlcount_reward_func": 0.17109374329447746,
       "step": 2
     },
     {
+      "completion_length": 312.90625,
+      "epoch": 0.6956521739130435,
+      "grad_norm": 2.707895517349243,
+      "kl": 0.18927789852023125,
       "learning_rate": 4.864543104251586e-07,
       "loss": 0.0002,
+      "reward": 3.3511684983968735,
+      "reward_std": 2.810737758874893,
+      "rewards/concensus_correctness_reward_func": 0.9857500195503235,
+      "rewards/consensus_reward_func": 0.5,
       "rewards/cumulative_reward_2": 0.0,
+      "rewards/final_correctness_reward_func": 0.5,
+      "rewards/question_recreation_reward_func": 0.5366372531279922,
       "rewards/soft_format_reward_func": 0.0,
+      "rewards/strict_format_reward_func": 0.015625,
+      "rewards/xmlcount_reward_func": 0.8131562396883965,
       "step": 4
     },
     {
+      "completion_length": 591.7142857142857,
+      "epoch": 1.0,
+      "grad_norm": 0.9553964138031006,
+      "kl": 0.07205795177391597,
       "learning_rate": 4.472851273490984e-07,
       "loss": 0.0001,
+      "reward": 1.6433789091450828,
+      "reward_std": 3.27373297725405,
+      "rewards/concensus_correctness_reward_func": 0.7857142857142857,
+      "rewards/consensus_reward_func": 0.2857142857142857,
       "rewards/cumulative_reward_2": 0.0,
+      "rewards/final_correctness_reward_func": 0.2857142857142857,
+      "rewards/question_recreation_reward_func": 0.6140574514865875,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
+      "rewards/xmlcount_reward_func": -0.3278214229004724,
       "step": 6
     },
     {
+      "completion_length": 458.03125,
+      "epoch": 1.3478260869565217,
+      "grad_norm": 1.9519122838974,
+      "kl": 0.09541197819635272,
       "learning_rate": 3.867370395306068e-07,
+      "loss": 0.0001,
+      "reward": 3.23869152367115,
+      "reward_std": 2.8737177960574627,
+      "rewards/concensus_correctness_reward_func": 1.5933125205338001,
+      "rewards/consensus_reward_func": 0.4375,
       "rewards/cumulative_reward_2": 0.0,
+      "rewards/final_correctness_reward_func": 0.375,
+      "rewards/question_recreation_reward_func": 0.5153790600597858,
       "rewards/soft_format_reward_func": 0.0,
+      "rewards/strict_format_reward_func": 0.0,
+      "rewards/xmlcount_reward_func": 0.3174999915063381,
       "step": 8
     },
     {
+      "completion_length": 465.15625,
+      "epoch": 1.6956521739130435,
+      "grad_norm": 2.256605625152588,
+      "kl": 0.12031417898833752,
       "learning_rate": 3.1137137178519977e-07,
       "loss": 0.0001,
+      "reward": 1.946889029815793,
+      "reward_std": 1.2802342623472214,
+      "rewards/concensus_correctness_reward_func": 0.36281250417232513,
+      "rewards/consensus_reward_func": 0.125,
       "rewards/cumulative_reward_2": 0.0,
+      "rewards/final_correctness_reward_func": 0.4375,
+      "rewards/question_recreation_reward_func": 0.4488264946267009,
       "rewards/soft_format_reward_func": 0.0,
+      "rewards/strict_format_reward_func": 0.03125,
+      "rewards/xmlcount_reward_func": 0.5415000058710575,
       "step": 10
     },
     {
+      "completion_length": 437.60714285714283,
+      "epoch": 2.0,
+      "grad_norm": 1.522103190422058,
+      "kl": 0.0894239145730223,
       "learning_rate": 2.2935516363191693e-07,
+      "loss": 0.0001,
+      "reward": 2.6395556926727295,
+      "reward_std": 2.6253241215433394,
+      "rewards/concensus_correctness_reward_func": 0.9945714133126395,
+      "rewards/consensus_reward_func": 0.2857142857142857,
       "rewards/cumulative_reward_2": 0.0,
+      "rewards/final_correctness_reward_func": 0.5714285714285714,
+      "rewards/question_recreation_reward_func": 0.5251272501690047,
+      "rewards/soft_format_reward_func": 0.017857142857142856,
+      "rewards/strict_format_reward_func": 0.017857142857142856,
+      "rewards/xmlcount_reward_func": 0.227000002350126,
       "step": 12
     },
     {
+      "completion_length": 325.40625,
+      "epoch": 2.3478260869565215,
+      "grad_norm": 5.116417407989502,
+      "kl": 0.13025188446044922,
       "learning_rate": 1.4957614383675767e-07,
       "loss": 0.0001,
+      "reward": 2.2546688467264175,
+      "reward_std": 2.2960597034543753,
+      "rewards/concensus_correctness_reward_func": 0.8603749945759773,
       "rewards/consensus_reward_func": 0.0625,
       "rewards/cumulative_reward_2": 0.0,
+      "rewards/final_correctness_reward_func": 0.4375,
+      "rewards/question_recreation_reward_func": 0.3634501527994871,
+      "rewards/soft_format_reward_func": 0.015625,
       "rewards/strict_format_reward_func": 0.0,
+      "rewards/xmlcount_reward_func": 0.5152187496423721,
       "step": 14
     },
     {
+      "completion_length": 439.6875,
+      "epoch": 2.6956521739130435,
+      "grad_norm": 2.5033061504364014,
+      "kl": 0.14386370312422514,
       "learning_rate": 8.067960709356478e-08,
+      "loss": 0.0001,
+      "reward": 2.7451365515589714,
+      "reward_std": 2.8820281606167555,
+      "rewards/concensus_correctness_reward_func": 0.960875004529953,
+      "rewards/consensus_reward_func": 0.5625,
       "rewards/cumulative_reward_2": 0.0,
+      "rewards/final_correctness_reward_func": 0.3125,
+      "rewards/question_recreation_reward_func": 0.4262927705422044,
+      "rewards/soft_format_reward_func": 0.015625,
       "rewards/strict_format_reward_func": 0.0,
+      "rewards/xmlcount_reward_func": 0.4673437364399433,
       "step": 16
     },
     {
+      "completion_length": 572.8571428571429,
+      "epoch": 3.0,
+      "grad_norm": 1.2184569835662842,
+      "kl": 0.0620973285819803,
       "learning_rate": 3.013156219837776e-08,
+      "loss": 0.0001,
+      "reward": 0.6767058819532394,
+      "reward_std": 2.5781510727746144,
+      "rewards/concensus_correctness_reward_func": 0.23378571229321615,
+      "rewards/consensus_reward_func": 0.35714285714285715,
       "rewards/cumulative_reward_2": 0.0,
+      "rewards/final_correctness_reward_func": 0.0,
+      "rewards/question_recreation_reward_func": 0.497634442789214,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
+      "rewards/xmlcount_reward_func": -0.4118571473019464,
       "step": 18
     },
     {
+      "completion_length": 487.9375,
+      "epoch": 3.3478260869565215,
+      "grad_norm": 1.472921371459961,
+      "kl": 0.07594193634577096,
       "learning_rate": 3.4096741493194193e-09,
+      "loss": 0.0001,
+      "reward": 3.8580808490514755,
+      "reward_std": 2.269144743680954,
+      "rewards/concensus_correctness_reward_func": 2.096250000409782,
+      "rewards/consensus_reward_func": 0.5625,
       "rewards/cumulative_reward_2": 0.0,
+      "rewards/final_correctness_reward_func": 0.1875,
+      "rewards/question_recreation_reward_func": 0.5588307604193687,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
+      "rewards/xmlcount_reward_func": 0.4529999941587448,
       "step": 20
     },
     {
+      "epoch": 3.3478260869565215,
       "step": 20,
       "total_flos": 0.0,
+      "train_loss": 0.00010353847828810103,
+      "train_runtime": 860.6355,
+      "train_samples_per_second": 0.372,
+      "train_steps_per_second": 0.023
     }
   ],
   "logging_steps": 2,
   "max_steps": 20,
   "num_input_tokens_seen": 0,
+  "num_train_epochs": 4,
   "save_steps": 25,
   "stateful_callbacks": {
     "TrainerControl": {