MediaPipe-Selfie-Segmentation: Optimized for Mobile Deployment
Segments the person from background in a selfie image and realtime background segmentation in video conferencing
Light-weight model that segments a person from the background in square or landscape selfie and video conference imagery.
This model is an implementation of MediaPipe-Selfie-Segmentation found
here
.
This repository provides scripts to run MediaPipe-Selfie-Segmentation on Qualcomm® devices.
More details on model performance across various devices, can be found
here
.
Profile Job summary of MediaPipe-Selfie-Segmentation
--------------------------------------------------
Device: SA8255 (Proxy) (13)
Estimated Inference Time: 0.77 ms
Estimated Peak Memory Range: 0.77-10.92 MB
Compute Units: NPU (138) | Total (138)
How does this work?
This
export script
leverages
Qualcomm® AI Hub
to optimize, validate, and deploy this model
on-device. Lets go through each step below in detail:
Step 1:
Compile model for on-device deployment
To compile a PyTorch model for on-device deployment, we first trace the model
in memory using the
jit.trace
and then call the
submit_compile_job
API.
import torch
import qai_hub as hub
from qai_hub_models.models.mediapipe_selfie import Model
# Load the model
torch_model = Model.from_pretrained()
# Device
device = hub.Device("Samsung Galaxy S23")
# Trace model
input_shape = torch_model.get_input_spec()
sample_inputs = torch_model.sample_inputs()
pt_model = torch.jit.trace(torch_model, [torch.tensor(data[0]) for _, data in sample_inputs.items()])
# Compile model on a specific device
compile_job = hub.submit_compile_job(
model=pt_model,
device=device,
input_specs=torch_model.get_input_spec(),
)
# Get target model to run on-device
target_model = compile_job.get_target_model()
Step 2:
Performance profiling on cloud-hosted device
After compiling models from step 1. Models can be profiled model on-device using the
target_model
. Note that this scripts runs the model on a device automatically
provisioned in the cloud. Once the job is submitted, you can navigate to a
provided job URL to view a variety of on-device performance metrics.
MediaPipe-Selfie-Segmentation huggingface.co is an AI model on huggingface.co that provides MediaPipe-Selfie-Segmentation's model effect (), which can be used instantly with this qualcomm MediaPipe-Selfie-Segmentation model. huggingface.co supports a free trial of the MediaPipe-Selfie-Segmentation model, and also provides paid use of the MediaPipe-Selfie-Segmentation. Support call MediaPipe-Selfie-Segmentation model through api, including Node.js, Python, http.
MediaPipe-Selfie-Segmentation huggingface.co is an online trial and call api platform, which integrates MediaPipe-Selfie-Segmentation's modeling effects, including api services, and provides a free online trial of MediaPipe-Selfie-Segmentation, you can try MediaPipe-Selfie-Segmentation online for free by clicking the link below.
qualcomm MediaPipe-Selfie-Segmentation online free url in huggingface.co:
MediaPipe-Selfie-Segmentation is an open source model from GitHub that offers a free installation service, and any user can find MediaPipe-Selfie-Segmentation on GitHub to install. At the same time, huggingface.co provides the effect of MediaPipe-Selfie-Segmentation install, users can directly use MediaPipe-Selfie-Segmentation installed effect in huggingface.co for debugging and trial. It also supports api for free installation.
MediaPipe-Selfie-Segmentation install url in huggingface.co: