Pick a camera (or a video file) and press Start.
Sound starts with the picture; stand so your whole body is in frame.

Dance2Music Live

Music Intelligence Lab · movement → sound in the browser. How it works (the math)

Setup

Source Camera Resolution Model Mirror Audio out

Record microphone separately

Record saves one ZIP with video or sound, body pose, and hands when enabled. Keep this tab open until the download is ready.

idle

Harmony

Mode

Sound

Pad timbre Sphere

The sphere sits between your wrists; its radius is half their distance. Choose the Sphere mapping preset to make its volume (r³) the instrument's loudness.

Mix

Percussion

Drums Beat on Sync offset

hips not seen

no steady pulse

Bounce steadily from the knees: the groove starts once the hips have been clearly periodic for about a second, and follows your tempo. A ring at the hips marks each beat; if the drums feel early or late against your body, move Sync offset.

Hands

Tracking

hand tracking off

Movement

Energy memory

Mapping

import

Each sound parameter reads one movement feature. Open a row to change its source, range and curve. With source “none” it stays at its min.

Sensitivity

iPhone: if there is no sound, check the volume buttons, then tap “Tap for sound”. The ring/silent switch should not matter on iOS 16.4 and later.

Keys: r record/stop · space start/stop · f performance view · 1–5 harmony mode · m mute. Everything runs on this computer; no video leaves the browser.