Turn your hand gestures into music!
This lightweight web app uses p5.js and Tone.js to track your fingers in real time and play musical notes based on their position.
- 🖐 Real-time hand tracking — detects individual finger positions.
- 🎶 Interactive music generation — every gesture triggers a sound.
- ⚡ Runs in the browser — no installation required.
- 🎨 Powered by p5.js for visuals and Tone.js for sound synthesis.
- 🔍 Works directly from a simple
index.htmlfile.
- p5.js — Creative coding library for visuals.
- Tone.js — Web Audio framework for music generation.
- Handpose / Finger Tracking API — Detects finger positions (via p5 addons or compatible ML models).
git clone https://github.com/digitreelab-gkp/Hand-Motion-Music.git
cd hand-motion-musicJust open index.html in your browser — no server needed.
⚠ Allow camera access so the app can track your hand.
- The app accesses your webcam feed.
- Hand tracking detects each finger’s position.
- Each finger maps to a musical note or sound effect.
- Move your hand — create your own melody in real time!
🔗 Live Demo (example link — replace with your actual demo)
- 🎵 Change instruments or notes in the Tone.js setup.
- 🎨 Adjust colors and visuals in the p5.js sketch.
- ✋ Experiment with gesture mappings for creative control.
Digitree Labs is dedicated to building fun, interactive, and innovative web experiments that merge creativity with technology.
Follow us for more creative coding projects!
MIT License — free to use, modify, and share.
Made with ❤️ by Digitree Labs