Neural Canvas — Paint With Your Hands

Paint with your hands

Allow camera access, then pinch your thumb and index finger together to paint. Use gestures to clear, erase, and change color; the gesture key is below. Works with both hands.

Gestures 🤏 Pinch Paint ✊ Fist Clear (hold) ✋ Open palm Erase ✌️ Victory Next color 👎 Thumb down Undo 👍 Thumb up View (clean)

Color

Brush

Symmetry

Input

How it works›

A trained neural network watches your hands, not the art. Each webcam frame is fed to Google's MediaPipe gesture & hand model, which locates 21 3D points per hand in real time, entirely in your browser with no server.

The app reads those points: your index fingertip is the brush, and a pinch (thumb + index together) is the pen. Gestures like ✊ fist and ✋ open palm are classified by the model to clear and erase. A one-euro filter smooths the tracking so lines are clean. Symmetry mirrors every stroke into a live kaleidoscope, and Body mode swaps in a full-body pose model so you paint with your whole body.

The machine doesn't make the art; you do. But it couldn't exist without it: there's no way to paint in mid-air unless a neural network perceives your motion about 60 times a second. Built for Hack the Arts 2026.

Load the model to begin…