Sleight
Your webcam becomes a MIDI control surface. Both hands tracked in space — fingers, palms, and fingertip distances mapped to any CC, channel, and range you want.
no gloves · no hardware · just hands
What it does
Sixteen controllers. Two hands. Zero hardware.
Sleight reads your hands through the camera and speaks fluent MIDI. Every signal is mappable — per channel, per CC number, with range and inversion.
Finger extension
Each finger's curl maps to a controller — ten independent signals, five per hand, straight from tip-to-knuckle distance.
Spatial position
Palm X/Y in the frame becomes two more axes per hand. Move to modulate, like an invisible XY pad.
Open hand
Average finger extension per hand — a single macro gesture for broad strokes like filter sweeps or volume.
Distance blocks
Pick any two fingertips — across hands or within one — and map the gap between them. Spread your fingers to open a filter.
Any output
Works with anything that listens to MIDI CC: loopMIDI, IAC, Ableton, Bitwig, VCV Rack, synths, lighting rigs.
Save & share rigs
Every mapping persists automatically. Export your whole rig to a JSON file and hand it to a friend — or your other machine.
How it works
Setup is ninety seconds.
Allow the camera
The browser or app asks once. Video never leaves your machine — all tracking runs locally via MediaPipe.
Pick your MIDI out & camera
One click in the settings popover. On macOS, loopMIDI or IAC gives you a virtual port in seconds.
Map your blocks
Every control block has a cog: channel, CC number, input range, invert. Tune it while performing — values update live.
Play
Show your hands. The overlay shows exactly what the tracker sees; hide the UI and perform with a clean view.
Get it
Browser now, desktop forever.
The web app is the full app. The desktop build adds background performance — MIDI keeps flowing even when the window is hidden.