ActiveMimic: Egocentric Video Pretraining with Active Perception
Abstract
ActiveMimic pretraining framework recovers camera and wrist trajectories from egocentric video to enable active perception learning that matches robot data performance.
Egocentric human video offers a scalable alternative to robot data for pretraining, yet models pretrained on such video consistently underperform those pretrained on robot data. We attribute this gap to a missing signal, the active perception behavior in egocentric videos, where humans continuously reposition their viewpoint during manipulation, inducing camera motion that standard pipelines treat as noise. To address this, we present ActiveMimic, a pretraining framework that recovers synchronized camera and wrist trajectories from a single body-worn RGB camera, models camera motion as a viewpoint action, and jointly learns active perception and manipulation from in-the-wild egocentric human video before adapting to a target robot. Empirically, real-world experiments across tasks with diverse active perception demands show that ActiveMimic consistently surpasses baselines pretrained on human video and matches state-of-the-art models pretrained on robot data. Further analysis provides evidence that active perception capability originates from egocentric human video pretraining rather than robot-specific fine-tuning, confirming active perception as the key to unlocking egocentric human video for robot pretraining.
Community
This is an automated message from the Librarian Bot. I found the following papers similar to this paper.
The following papers were recommended by the Semantic Scholar API
- HumanEgo: Zero-Shot Robot Learning from Minutes of Human Egocentric Videos (2026)
- Learning Human-Intention Priors from Large-Scale Human Demonstrations for Robotic Manipulation (2026)
- EgoEngine: From Egocentric Human Videos to High-Fidelity Dexterous Robot Demonstrations (2026)
- EggHand: A Multimodal Foundation Model for Egocentric Hand Pose Forecasting (2026)
- SABER: A Scalable Action-Based Embodied Dataset for Real-World VLA Adaptation (2026)
- GazeVLA: Learning Human Intention for Robotic Manipulation (2026)
- PointAction: 3D Points as Universal Action Representations for Robot Control (2026)
Please give a thumbs up to this comment if you found it helpful!
If you want recommendations for any Paper on Hugging Face checkout this Space
You can directly ask Librarian Bot for paper recommendations by tagging it in a comment: @librarian-bot recommend
Get this paper in your agent:
hf papers read 2606.06194 Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash Models citing this paper 0
No model linking this paper
Datasets citing this paper 1
Spaces citing this paper 0
No Space linking this paper
Collections including this paper 0
No Collection including this paper