HandMeshTracking

HandMeshTracking – Real-Time 3D Hand Tracking & Mesh Animation for Unity

HandMeshTracking is a powerful, easy-to-integrate Unity plugin that brings real-time 3D hand tracking, gesture-based interaction, and fully animated hand meshes directly into your projects. Whether you're building AR apps, VR experiences, or hand-controlled games, this plugin provides a complete solution for natural, intuitive hand interaction.

Powered by advanced machine learning, HandMeshTracking can detect left and right hands, track 20+ 3D landmarks per hand, and accurately animate finger joints, wrist rotation, and full hand poses. With support for camera, video, and image input sources, plus mobile-optimized models, you get both performance and precision in any environment.

Simply drag the included prefab into your scene, assign your hand model, and your project is instantly ready for real-time hand interaction.

Key Features

• Real-Time 3D Hand Tracking
Tracks 20+ hand landmarks, including fingertips, knuckles, and wrist, with high accuracy and stable motion output.

• Full Hand Mesh Animation
Automatically animates hand models using real hand movements, including finger curl, spread, rotation, and pose transitions.

• Left & Right Hand Detection
Independently detect and process each hand for more accurate interaction logic.

• Hand Mesh Movement Support
Follow the user’s hand position and scale in world space for natural, immersive interaction.

• Multiple Input Sources
Use live camera feed, video files, or images as tracking input.

• Performance-Optimized Models
Choose between Heavy (high accuracy) and Lite (mobile optimized) tracking models.

• Simple Integration
Ready-made prefabs and scripts allow setup in minutes—no complex configuration required.

• Included Demo Scenes
Examples for landmark tracking, mesh animation, and mesh movement help you understand and extend the system quickly.

Perfect For

• AR and VR hand interaction
• Gesture-controlled games
• Virtual object grabbing, touching, and UI interactions
• Mixed Reality applications
• Robotics, training, and research projects
• Any experience requiring natural hand input