GestureSynth.me is a free, browser-based gesture music synthesizer that runs entirely on-device — no install, no account, no MIDI controller required.
It uses your webcam to track both hands in real time (MediaPipe hand-landmark detection): the left hand selects chord degrees I–VII via finger count and switches between major/minor via wrist tilt, while the right hand controls volume, harmony type (triads / inversions / seventh chords), low-pass filter tone, and octave.
Two playing modes: Gesture mode (chord-focused) and Theremin mode (continuous pitch — right-hand height controls pitch, left-hand height controls volume).
Includes a four-track loop sequencer (30–300 BPM, tap tempo, multiple time signatures, WAV/WebM export) and a Learn mode with public-domain songs such as Twinkle Twinkle Little Star and Ode to Joy.
Privacy-first: camera frames are processed locally and never stored or uploaded, no microphone permission is requested, and preferences are kept in localStorage. Best experienced on desktop Chrome/Edge.
ABOUT THIS TOOL AND ITS ORIGINAL: Gesture Synth is an open-source project credited to developer Eric Wei, hosted by its creator at gesture-synth-weld.vercel.app with source code on GitHub. Because the project is open source, around a dozen separate domains now host re-skinned copies of it under the same name. gesturesynth.me, linked from this listing, is one of those copies rather than the original; the underlying instrument is the same code running locally in your browser. We list it because it is the version many people arrive at, but if you want the original and want the creator credited, go to gesture-synth-weld.vercel.app. For a full explanation of which sites are which, see our guide: aitoolsrecap.com/Blog/what-is-gesture-synth-how-to-use-2026
KNOWN ISSUE: several users report hand tracking working while no audio plays. This is usually the browser blocking sound until you physically interact with the page — click anywhere, or press the start control, before gesturing. Desktop Chrome or Edge is the most reliable combination.