The model detects 3D markers on a hand centered in an image. You could use these markers, for example, to control a bone rig.
IMPORTANT:
The hands needs to be centered and cropped to fit the image. For images with hands not in the center or for multiple hands, you will need another model to detect hands, and crop them before feeding them into this model. For example you could use
Blaze Palm
to detect them (but this model only works with open palms).
How to Use
Create a new scene in Unity 2023
Install
com.unity.sentis
version
1.4.0-pre.3
from the package manager
Add the c# file to the Main Camera
Drag the hand_landmark.sentis file in asset field
Put a video in the
Assets/StreamingAssets
folder and set
videoName
variable to the video name
Create a RawImage and place it in your scene. Link to this image in the
previewUI
field.
Preview
If you get it working it should look like this (original image from pexels.com):
License
All Google Mediapipe models are open source under the Apache 2.0 license. The accompanying C# source code we provide can be used in your applications for commercial purposes.
Runs of unity sentis-hand-landmark on huggingface.co
21
Total runs
0
24-hour runs
0
3-day runs
0
7-day runs
0
30-day runs
More Information About sentis-hand-landmark huggingface.co Model
sentis-hand-landmark huggingface.co is an AI model on huggingface.co that provides sentis-hand-landmark's model effect (), which can be used instantly with this unity sentis-hand-landmark model. huggingface.co supports a free trial of the sentis-hand-landmark model, and also provides paid use of the sentis-hand-landmark. Support call sentis-hand-landmark model through api, including Node.js, Python, http.
sentis-hand-landmark huggingface.co is an online trial and call api platform, which integrates sentis-hand-landmark's modeling effects, including api services, and provides a free online trial of sentis-hand-landmark, you can try sentis-hand-landmark online for free by clicking the link below.
unity sentis-hand-landmark online free url in huggingface.co:
sentis-hand-landmark is an open source model from GitHub that offers a free installation service, and any user can find sentis-hand-landmark on GitHub to install. At the same time, huggingface.co provides the effect of sentis-hand-landmark install, users can directly use sentis-hand-landmark installed effect in huggingface.co for debugging and trial. It also supports api for free installation.
sentis-hand-landmark install url in huggingface.co: