This repository contains cached neuron compilation artifacts for the most popular models on the Hugging Face Hub.
Inference
LLM models
The transparent caching mechanism included in
optimum-neuron
and
NeuronX TGI
, makes it easier to export and deploy cached models to Neuron platforms such as Trainium and Inferentia.
To deploy directly any cached model to SageMaker:
go to the model page,
select "Deploy" in the top right corner,
select "AWS SageMaker" in the drop-down,
select the "AWS Inferentia & Trainium" tab,
copy the code snippet.
You can now paste the code snippet in your deployment script or notebook, following the instructions in the comment.
To export a model to Neuron and save it locally, please follow the instructions in the
optimum-neuron
documentation
.
For a list of the cached models and configurations, please refer to the inference cache
configuration files
.
Alternatively, you can use the
optimum-cli neuron cache lookup
command to look for a specific model and see the cached configurations.
Runs of aws-neuron optimum-neuron-cache on huggingface.co
0
Total runs
0
24-hour runs
0
3-day runs
0
7-day runs
0
30-day runs
More Information About optimum-neuron-cache huggingface.co Model
optimum-neuron-cache huggingface.co is an AI model on huggingface.co that provides optimum-neuron-cache's model effect (), which can be used instantly with this aws-neuron optimum-neuron-cache model. huggingface.co supports a free trial of the optimum-neuron-cache model, and also provides paid use of the optimum-neuron-cache. Support call optimum-neuron-cache model through api, including Node.js, Python, http.
optimum-neuron-cache huggingface.co is an online trial and call api platform, which integrates optimum-neuron-cache's modeling effects, including api services, and provides a free online trial of optimum-neuron-cache, you can try optimum-neuron-cache online for free by clicking the link below.
aws-neuron optimum-neuron-cache online free url in huggingface.co:
optimum-neuron-cache is an open source model from GitHub that offers a free installation service, and any user can find optimum-neuron-cache on GitHub to install. At the same time, huggingface.co provides the effect of optimum-neuron-cache install, users can directly use optimum-neuron-cache installed effect in huggingface.co for debugging and trial. It also supports api for free installation.
optimum-neuron-cache install url in huggingface.co: