Back to all projects Ruyi Yang

AI Creation · 2026

Gestural Stream

Gesture-based hands-free content control (MediaPipe + temporal alignment, zero-latency)

Role
Individual Contributor
Affiliation / Context
Individual project
Year
2026
Scale
Small
Tech Stack
MediaPipe · Real-time Gesture Recognition · Temporal Alignment
Creation Interaction CV Real-time

Case Study

Intuitive Control: Implemented gesture-based commands (e.g., swipe, pause, skip) to revolutionize the video-browsing experience in "busy-hand" scenarios (e.g., cooking, exercising).

Tech Stack: Leveraged MediaPipe and Temporal Alignment algorithms to ensure zero-latency response between physical motion and system execution.

Scalability: Directly applicable to TikTok’s video feed, enhancing accessibility and user retention through immersive, touchless navigation.

Back to all projects