“Pro²Assist: Continuous Step-aware Proactive Assistance with Multi-modal Egocentric Perception for Long-horizon Procedural Tasks” was recently accepted to IMWUT and will be presented at UbiComp 2026.
In this paper, we propose Pro²Assist, a proactive assistance system that continuously monitors the user’s progress through long-horizon procedural tasks using multimodal egocentric perception. Pro²Assist identifies the user’s current step, detects when assistance is needed, and proactively delivers timely guidance without requiring explicit requests. Through a user study with 20 participants, we demonstrate Pro²Assist’s ability to provide continuous, step-aware support during real-world procedures.
You must be logged in to post a comment.