: Vid2Coach analyzes how-to videos by combining narration and visual demonstrations to generate high-level steps and fine-grained demonstration details.

Provide guidance based on both narration and visual demonstration.

: Unlike standard audio descriptions, Vid2Coach monitors user progress through a camera in smart glasses to provide proactive feedback

: The assistant reads instructions and provides "Accessible Tips" (e.g., "Use kitchen scissors instead of a knife to cut peppers").

: The system categorizes actions into punctual (quick tasks), iterative (repetitive motions), and durative (gradual changes) to provide context-aware responses and low-latency descriptions of user actions.

Using Retrieval-Augmented Generation (RAG), it adds accessible workarounds (like using kitchen scissors instead of a knife) from trusted community resources.

For BLV users, it adds "accessibility tips" (e.g., using kitchen scissors instead of a knife for peppers) by pulling from curated datasets. 🔍 Key Performance Metrics Based on technical evaluations and user studies (N=8):

: A comprehensive app featuring over 1,000 soccer exercises, tactical animations, and team organization tools.

Advertisement