TypologySienna Chen
InputLightweight

Gesture recognition

A movement turned into a named command.

Turning a movement into a named command: swipe, circle, thumbs-up. Works with the mouse, a finger or a tracked hand. False triggers feel broken, so each gesture needs a clear confirmation.

Breaks when
false positives feel broken
Also called
GestureRecognizer, swipe detection, use-gesture

Prompts

Stroke gestures on a canvas
Implement a $1-style unistroke recognizer in TypeScript: resample the stroke to 64 points, rotate to indicative angle, scale to a unit box, translate to origin, and match against templates (circle, triangle, zigzag, check, X) by average point distance; report the best label and a score. Add swipe detection (net > 70% of path length) as a fast path. Draw the stroke, then the label with its score; refractory 300 ms.
Hand gestures that drive a UI
MediaPipe GestureRecognizer with the default 7 gestures: map Open_Palm to pause, Closed_Fist to select, Thumb_Up to like, Pointing_Up to scroll mode; require the same gesture for 8 consecutive frames before firing, and show a ring that fills during those frames so people learn the timing.
Custom gesture from landmarks
Define a “pinch and rotate” gesture from hand landmarks: pinch strength above 0.7 plus the angle of the thumb–index vector changing more than 15°; emit rotation deltas while held. Explain hysteresis for enter and exit thresholds and why they must differ.

Related

Resources · 1