Instructions to use makermods/smolvla_3cam_dagger_corr20_blue_cube_orange_tray with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- LeRobot
How to use makermods/smolvla_3cam_dagger_corr20_blue_cube_orange_tray with LeRobot:
# See https://github.com/huggingface/lerobot?tab=readme-ov-file#installation for more details git clone https://github.com/huggingface/lerobot.git cd lerobot pip install -e .[smolvla]
# Launch finetuning on your dataset python lerobot/scripts/train.py \ --policy.path=makermods/smolvla_3cam_dagger_corr20_blue_cube_orange_tray \ --dataset.repo_id=lerobot/svla_so101_pickplace \ --batch_size=64 \ --steps=20000 \ --output_dir=outputs/train/my_smolvla \ --job_name=my_smolvla_training \ --policy.device=cuda \ --wandb.enable=true
# Run the policy using the record function python -m lerobot.record \ --robot.type=so101_follower \ --robot.port=/dev/ttyACM0 \ # <- Use your port --robot.id=my_blue_follower_arm \ # <- Use your robot id --robot.cameras="{ front: {type: opencv, index_or_path: 8, width: 640, height: 480, fps: 30}}" \ # <- Use your cameras --dataset.single_task="Grasp a lego block and put it in the bin." \ # <- Use the same task description you used in your dataset recording --dataset.repo_id=HF_USER/dataset_name \ # <- This will be the dataset name on HF Hub --dataset.episode_time_s=50 \ --dataset.num_episodes=10 \ --policy.path=makermods/smolvla_3cam_dagger_corr20_blue_cube_orange_tray - Notebooks
- Google Colab
- Kaggle
smolvla_3cam_dagger_corr20_blue_cube_orange_tray
DAgger correction pass over
makermods/smolvla_3cam_200ep_blue_cube_orange_tray
checkpoint 15000, fine-tuned on 20 human-corrected rollout episodes.
SO-101 (6-DoF), 3 cameras: "pick up blue cube and place in orange tray".
Cameras
observation.images.front / .wrist / .top, all 480x640. No --rename_map needed at
inference — feed the real names directly.
Training
| base | 3-cam checkpoint 15000 (not 20000 — 15k evaluated better) |
| corrections | 20 episodes / 3,510 frames (1.9 min), 100% intervention frames |
| steps | 5,000 @ batch 64 = 91 epochs over the correction set |
| lr | 1e-5 (10x below from-base), warmup auto-scaled 1000 -> 250, decay -> 5,000 |
| loss | 2.193 (step 10) -> 0.110 (step 5000), grad norm 13.0 -> 1.17 |
| hardware | RTX 4090, bf16 AMP, 19.9 GB, 1h09m |
Caveats
91 epochs over 1.9 minutes of data. Prior correction passes in this project ran 28.6 and
48.8 epochs on larger sets. Loss was already flat by ~step 3000 (0.121 -> 0.110 over the final
2,000 steps), so the later checkpoints buy little and may overfit the corrections at the
expense of the clean demos. Evaluate the earlier checkpoints — checkpoints/ holds one
every 500 steps for exactly this reason.
The correction set's task string was recorded as "Pick up blue cube and place in orange box", which does not match the base model's training instruction. It was normalised to "pick up blue cube and place in orange tray" before training; the source dataset is unchanged.
- Downloads last month
- 56