Sleight
Use your hands as MIDI control surfaces. Fingertips, palms, distances between fingers: all can be mapped to any CC and channel.
no gloves · no hardware · just your hands
What it does
Use your hands as a MIDI controller.
Sleight reads your hands through the camera and outputs MIDI signals.
Finger extension
Each finger's curl maps to a control, tip-to-knuckle distance.
Spatial position
Your hand's position in the frame becomes another controller. Like an invisible XY pad.
Open/Close hand
Macro gesture mapped to your hands being open/closed.
Distances
Pick any two fingertips and map the gap between them to a control. Pinch, spread, make silly signs.
Any output
Works with anything that listens to MIDI CC.
Save & share settings
Every mapping persists automatically. Export it to a JSON file to keep it safe or share it.
Setup
How to use it.
Allow the camera
Video never leaves your machine, all tracking runs locally in the browser.
Pick your MIDI out & camera
One click in the settings popover, can be changed from the settings menu.
Map your controls
Every control block has a cog from which you can choose channel, CC number, input range, optionally invert the value.
Play
Show your hands. The overlay shows exactly what the tracker sees.
Get it
Works in the browser, but also has an app.
The web app has all the fetaures, but browsers tend to throttle computations and video feed when inactive, that's what the desktop app is for.
In the browser
Chromium-based browsers recommended.
Desktop app
Runs full-rate while unfocused, hidden, or minimized.
v0.1.8 · all downloads