MobileNetV2 is a machine learning model that can classify images from the Imagenet dataset. It can also be used as a backbone in building more complex models for specific use cases.
This model is an implementation of MobileNet-v2 found
here
.
This repository provides scripts to run MobileNet-v2 on Qualcomm® devices.
More details on model performance across various devices, can be found
here
.
Profile Job summary of MobileNet-v2
--------------------------------------------------
Device: SA8255 (Proxy) (13)
Estimated Inference Time: 1.25 ms
Estimated Peak Memory Range: 0.07-5.74 MB
Compute Units: NPU (105) | Total (105)
How does this work?
This
export script
leverages
Qualcomm® AI Hub
to optimize, validate, and deploy this model
on-device. Lets go through each step below in detail:
Step 1:
Compile model for on-device deployment
To compile a PyTorch model for on-device deployment, we first trace the model
in memory using the
jit.trace
and then call the
submit_compile_job
API.
import torch
import qai_hub as hub
from qai_hub_models.models.mobilenet_v2 import Model
# Load the model
torch_model = Model.from_pretrained()
# Device
device = hub.Device("Samsung Galaxy S23")
# Trace model
input_shape = torch_model.get_input_spec()
sample_inputs = torch_model.sample_inputs()
pt_model = torch.jit.trace(torch_model, [torch.tensor(data[0]) for _, data in sample_inputs.items()])
# Compile model on a specific device
compile_job = hub.submit_compile_job(
model=pt_model,
device=device,
input_specs=torch_model.get_input_spec(),
)
# Get target model to run on-device
target_model = compile_job.get_target_model()
Step 2:
Performance profiling on cloud-hosted device
After compiling models from step 1. Models can be profiled model on-device using the
target_model
. Note that this scripts runs the model on a device automatically
provisioned in the cloud. Once the job is submitted, you can navigate to a
provided job URL to view a variety of on-device performance metrics.
MobileNet-v2 huggingface.co is an AI model on huggingface.co that provides MobileNet-v2's model effect (), which can be used instantly with this qualcomm MobileNet-v2 model. huggingface.co supports a free trial of the MobileNet-v2 model, and also provides paid use of the MobileNet-v2. Support call MobileNet-v2 model through api, including Node.js, Python, http.
MobileNet-v2 huggingface.co is an online trial and call api platform, which integrates MobileNet-v2's modeling effects, including api services, and provides a free online trial of MobileNet-v2, you can try MobileNet-v2 online for free by clicking the link below.
qualcomm MobileNet-v2 online free url in huggingface.co:
MobileNet-v2 is an open source model from GitHub that offers a free installation service, and any user can find MobileNet-v2 on GitHub to install. At the same time, huggingface.co provides the effect of MobileNet-v2 install, users can directly use MobileNet-v2 installed effect in huggingface.co for debugging and trial. It also supports api for free installation.