HuGe: Scaling Humanoid Generalist Vision-Language-Action Models with Egocentric Experience
Abstract
HuGe pre-trains vision-language-action models on egocentric human and robot data with pseudo-proprioception and visual adaptation to enable whole-body humanoid control.
Extending Vision-Language-Action models (VLAs) to humanoid robots requires coordinated whole-body control and diverse demonstrations that are costly to collect in real-world scenarios. Although egocentric human demonstrations provide a complementary source of task experience, differences in visual embodiment and missing robot proprioception complicate transfer to humanoid policies. To address these challenges, we introduce HuGe, a family of Humanoid Generalist VLAs pre-trained on over 2,000 hours of egocentric human and robot data. Specifically, HuGe employs three existing representative VLA architectures to predict latent motion tokens for a pretrained whole-body controller, together with hand-control signals. Based on this, we introduce a three-stage training pipeline that combines egocentric pre-training, humanoid adaptation, and downstream fine-tuning. To facilitate transfer across embodiments, we construct pseudo-proprioceptive states through simulation playback during pre-training and modify arm appearance in egocentric observations through re-rendering during downstream fine-tuning. With this pipeline, HuGe achieves the state-of-the-art on simulation benchmark HumanoidArena. Furthermore, real-world experiments on the Unitree G1 indicate that augmenting robot demonstrations with visually adapted egocentric demonstrations significantly increases success on a pick-and-drop task.
Community
HuGe (Humanoid Generalist) is a family of vision-language-action models for humanoid whole-body control. This repository provides Qwen3-VL-2B-Instruct implementations of OFT-, GR00T-, and Pi-style policies that predict SONIC motion tokens and hand-control signals through a three-stage training pipeline: egocentric pre-training, humanoid adaptation, and downstream fine-tuning.
This is an automated message from the Librarian Bot. I found the following papers similar to this paper.
The following papers were recommended by the Semantic Scholar API
- WB-WAM: Heterogeneous Body-Hand Pre-training for Humanoid Loco-Manipulation (2026)
- Towards a General Humanoid Loco-Manipulation Model via Egocentric Whole-Body Human Data Pretraining (2026)
- Zero-HLM: Generalizable Humanoid Loco-Manipulation without Real Robot Data (2026)
- Humanoid Loco-Manipulation With Discrete VLA Model (2026)
- Being-M0.7: A Latent World-Action Model for Humanoid Robots (2026)
- WholeBodyWAM: Generalizing Pre-trained World-Action Priors to Humanoid Loco-Manipulation via WBC-Grounded Coordination (2026)
- EgoAlign: Bridging the Human-Humanoid Gap for Long-Range Loco-Manipulation (2026)
Please give a thumbs up to this comment if you found it helpful!
If you want recommendations for any Paper on Hugging Face checkout this Space
You can directly ask Librarian Bot for paper recommendations by tagging it in a comment: @librarian-bot recommend
Get this paper in your agent:
hf papers read 2610.34186 Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash Models citing this paper 0
No model linking this paper
Datasets citing this paper 0
No dataset linking this paper
Spaces citing this paper 0
No Space linking this paper