The package contains a simple end-to-end demo that downloads pre-trained
weights and runs this model on a sample input.
python -m qai_hub_models.models.yolox.demo
The above demo runs a reference implementation of pre-processing, model
inference, and post processing.
NOTE
: If you want running in a Jupyter Notebook or Google Colab like
environment, please add the following to your cell (instead of the above).
%run -m qai_hub_models.models.yolox.demo
Run model on a cloud-hosted device
In addition to the demo, you can also run the model on a cloud-hosted Qualcomm®
device. This script does the following:
Performance check on-device on a cloud-hosted device
Downloads compiled assets that can be deployed on-device for Android.
Accuracy check between PyTorch and on-device outputs.
python -m qai_hub_models.models.yolox.export
Profiling Results```
## How does this work?
This [export script](https://aihub.qualcomm.com/models/yolox/qai_hub_models/models/Yolo-X/export.py)
leverages [Qualcomm® AI Hub](https://aihub.qualcomm.com/) to optimize, validate, and deploy this model
on-device. Lets go through each step below in detail:
Step 1: **Compile model for on-device deployment**
To compile a PyTorch model for on-device deployment, we first trace the model
in memory using the `jit.trace` and then call the `submit_compile_job` API.
```python
import torch
import qai_hub as hub
from qai_hub_models.models.yolox import Model
# Load the model
torch_model = Model.from_pretrained()
# Device
device = hub.Device("Samsung Galaxy S24")
# Trace model
input_shape = torch_model.get_input_spec()
sample_inputs = torch_model.sample_inputs()
pt_model = torch.jit.trace(torch_model, [torch.tensor(data[0]) for _, data in sample_inputs.items()])
# Compile model on a specific device
compile_job = hub.submit_compile_job(
model=pt_model,
device=device,
input_specs=torch_model.get_input_spec(),
)
# Get target model to run on-device
target_model = compile_job.get_target_model()
Step 2:
Performance profiling on cloud-hosted device
After compiling models from step 1. Models can be profiled model on-device using the
target_model
. Note that this scripts runs the model on a device automatically
provisioned in the cloud. Once the job is submitted, you can navigate to a
provided job URL to view a variety of on-device performance metrics.
Yolo-X huggingface.co is an AI model on huggingface.co that provides Yolo-X's model effect (), which can be used instantly with this qualcomm Yolo-X model. huggingface.co supports a free trial of the Yolo-X model, and also provides paid use of the Yolo-X. Support call Yolo-X model through api, including Node.js, Python, http.
Yolo-X huggingface.co is an online trial and call api platform, which integrates Yolo-X's modeling effects, including api services, and provides a free online trial of Yolo-X, you can try Yolo-X online for free by clicking the link below.
qualcomm Yolo-X online free url in huggingface.co:
Yolo-X is an open source model from GitHub that offers a free installation service, and any user can find Yolo-X on GitHub to install. At the same time, huggingface.co provides the effect of Yolo-X install, users can directly use Yolo-X installed effect in huggingface.co for debugging and trial. It also supports api for free installation.