Author: Torin Blankensmith Format: 3-part YouTube series + bonus projects Playlist: Watch on YouTube Videos: Part 1 · Part 2 · Part 3 · Bonus 1 · Bonus 2 Plugin repo: github.com/torinmb/mediapipe-touchdesigner Intro video: Quick overview on YouTube
Overview
This tutorial series details the implementation of real-time hand tracking in TouchDesigner using Google’s MediaPipe framework via Torin Blankensmith’s open-source plugin. The series covers end-to-end development from initial setup through to fully interactive, gesture-driven visual applications, requiring no machine learning expertise from the implementer.
Note: Although this series focuses on hand tracking, the underlying plugin supports the complete suite of MediaPipe vision models (excluding Interactive Segmentation and Image Embedding). Mastery of the techniques presented here enables straightforward adaptation to face tracking, pose estimation, and other supported models.
Tutorial
| (y-) ★ Complete Step-by-Step Tutorial | Setup → core rig → watercolor brush → generative architecture — everything in one document |
| (y-) 3D Sierpinski Tetrahedron with Hand Tracking | Recursive fractal geometry with Copy SOP, controlled by wrist orientation and pinch-zoom via MediaPipe |
Videos
| Part | Topic | Video |
|---|---|---|
| Part 1 | Plugin setup, camera config, 21 hand landmarks | ▶ Watch |
| Part 2 | Reading CHOP channels, remapping coordinates, Y-inversion | ▶ Watch |
| Part 3 | Gesture recognition, driving visuals, smoothing | ▶ Watch |
| Bonus 1 | Generative Architecture with Hand Tracking | ▶ Watch |
| Bonus 2 | Watercolor Hand Tracking Brush | ▶ Watch |
Related
- (y-) OSC and MIDI — alternative control input methods
- (y-) Python in TD — scripting gesture logic
- (y-) CHOPs — processing tracking data as signals
- (y-) Instancing — rendering landmark spheres efficiently
- Particle System with POPs — driving particles from hand position
- Hand-Tracked Chaotic Attractor — Lorenz attractor driven by a custom Script CHOP (no plugin)
(y) Return to Recipes & Projects | (y) Return to TouchDesigner | (y) Return to Home