aws-neuron / optimum-neuron-cache

huggingface.co
Total runs: 0
24-hour runs: 0
7-day runs: 0
30-day runs: 0
Model's Last Updated: September 09 2026

Introduction of optimum-neuron-cache

Model Details of optimum-neuron-cache

AWS Neuron optimum model cache

This repository contains cached neuron compilation artifacts for the most popular models on the Hugging Face Hub.

Inference
LLM models

The transparent caching mechanism included in optimum-neuron and NeuronX TGI , makes it easier to export and deploy cached models to Neuron platforms such as Trainium and Inferentia.

To deploy directly any cached model to SageMaker:

  • go to the model page,
  • select "Deploy" in the top right corner,
  • select "AWS SageMaker" in the drop-down,
  • select the "AWS Inferentia & Trainium" tab,
  • copy the code snippet.

You can now paste the code snippet in your deployment script or notebook, following the instructions in the comment.

To export a model to Neuron and save it locally, please follow the instructions in the optimum-neuron documentation .

For a list of the cached models and configurations, please refer to the inference cache configuration files .

Alternatively, you can use the optimum-cli neuron cache lookup command to look for a specific model and see the cached configurations.

Runs of aws-neuron optimum-neuron-cache on huggingface.co

0
Total runs
0
24-hour runs
0
3-day runs
0
7-day runs
0
30-day runs

More Information About optimum-neuron-cache huggingface.co Model

More optimum-neuron-cache license Visit here:

https://choosealicense.com/licenses/apache-2.0

optimum-neuron-cache huggingface.co

optimum-neuron-cache huggingface.co is an AI model on huggingface.co that provides optimum-neuron-cache's model effect (), which can be used instantly with this aws-neuron optimum-neuron-cache model. huggingface.co supports a free trial of the optimum-neuron-cache model, and also provides paid use of the optimum-neuron-cache. Support call optimum-neuron-cache model through api, including Node.js, Python, http.

optimum-neuron-cache huggingface.co Url

https://huggingface.co/aws-neuron/optimum-neuron-cache

aws-neuron optimum-neuron-cache online free

optimum-neuron-cache huggingface.co is an online trial and call api platform, which integrates optimum-neuron-cache's modeling effects, including api services, and provides a free online trial of optimum-neuron-cache, you can try optimum-neuron-cache online for free by clicking the link below.

aws-neuron optimum-neuron-cache online free url in huggingface.co:

https://huggingface.co/aws-neuron/optimum-neuron-cache

optimum-neuron-cache install

optimum-neuron-cache is an open source model from GitHub that offers a free installation service, and any user can find optimum-neuron-cache on GitHub to install. At the same time, huggingface.co provides the effect of optimum-neuron-cache install, users can directly use optimum-neuron-cache installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

optimum-neuron-cache install url in huggingface.co:

https://huggingface.co/aws-neuron/optimum-neuron-cache

Url of optimum-neuron-cache

optimum-neuron-cache huggingface.co Url

Provider of optimum-neuron-cache huggingface.co

aws-neuron
ORGANIZATIONS

Other API from aws-neuron