Real-time AI Hand & Finger tracking for Unity. Detect 22 finger joints per hand using webcams, images, or videos. Supports 2D and 3D landmark tracking. Supported runtimes: Windows x64, Unity Editor.
For more detail this asset from the Unity Asset Store: Click Here
This is a paid asset, but now you can download the “Hand & Finger Tracking [Windows]” for FREE. Please keep in mind that this package is provided only for learning purposes or to test before buying the product, NOT FOR COMMERCIAL PURPOSES.
Hand & Finger Tracking [Windows] v1.2
“If possible, please buy the package to support the developer”
Description
✌️ Unlock the full potential of hand and finger tracking in your Unity applications with the LightBuzz Hand & Finger Tracking package. Powered by AI, this plugin ensures high-performance and low latency for real-time applications. ????
Overview
An overview of the asset’s provided packages and key features.
The Hand Tracking Unity plugin is an asset designed to track hands and finger joints accurately. Using color data, it detects hands in images, identifies key joint positions, and supports both 2D and 3D joint positioning.
Available packages
There are various options to choose from, depending on the platform you are developing for.
Every package comes with support for the Unity Editor, simplifying your development and testing processes.
???? Key features
Real-time tracking: Track 22 finger joints per hand in real time – wrist, plam, thumb, index, middle, ring, and pinky finger joints.
Multiple input sources: Use the live camera feed or existing video/image files.
3D & 2D visualization: Choose from 3D visualization to enhance spatial understanding, or 2D visualization for overlay applications on images and video streams.
Hand type recognition: Automatically distinguish between left and right hands.
Built-in demos: Get started with our built-in demos in seconds.
Powerful API: Simple, robust, and well-documented C# API for seasoned devs.
NO-CODE SUPPORT: Drag-and-drop our prefabs to create finger-tracking apps with no code!
Runtime platform
The asset supports runs on Windows computers, as well as the Unity Editor.
Windows 10 64-bit or later
Use the following assets to support more runtime platforms:
iOS + Android bundle ➡️
iOS ➡️
Android ➡️
macOS ➡️
Unity Editor
Unity 2020.3 or later
???? Demos & Samples
The package includes the following demos:
Webcam: Shows how to track finger landmarks on a webcam feed (phone cameras, laptop cameras, etc) and display the results on a Canvas or in the 3D world space.
Video: Demonstrates how to track finger landmarks on a video file (MP4, MOV, AVI, etc).
Picture: Shows how to track finger landmarks on a picture (PNG, JPEG file).
Key Features
Precise Tracking: Detects both 2D and 3D coordinates of each finger joint, ensuring accurate joint positioning in both the image plane and three-dimensional space.
Out-of-the-Box Visualization: Provides ready-to-use visualization components and comprehensive examples, significantly reducing your development effort.
Application Versatility: Supports all major platforms, enabling you to develop your application once and deploy it universally.
Workflow
The Hand Tracking Unity plugin is the easiest way to add hand and finger tracking to your application.
You can detect hands and fingers in 3 easy steps:
Load a raw RGB-encoded byte array to a Texture2D. The byte array could be an image file, a video file (eg mp4 file) or a camera live feed.
Pass the Texture2D to a HandTracker. The HandTracker will detect the hands and fingers in the texture.
Access the detected hand’s information. The detected Hand includes the following information:
Side: The side of the hand (Left or Right).
Confidence: The tracking confidence of the hand (0 to 1).
Thumb: The 2D and 3D positions for the CMC, MCP, IP and Tip thumb joints.
Index: The 2D and 3D positions for the MCP, PIP, DIP and Tip index joints.
Middle: The 2D and 3D positions for the MCP, PIP, DIP and Tip middle joints.
Ring: The 2D and 3D positions for the MCP, PIP, DIP and Tip ring joints.
Pinky: The 2D and 3D positions for the MCP, PIP, DIP and Tip pinky joints.
Palm: The 2D and 3D positions for the wrist, middle of the palm, thumb CMC, thumb MCP, index MCP, middle MCP, ring MCP and pinky MCP joints.
