To use the compiled artifacts for inference, here is an example:
from transformers import AutoTokenizer
from optimum.neuron import NeuronModelForSenetenceTransformers
emb_model = NeuronModelForSenetenceTransformers.from_pretrained("optimum/bge-base-en-v1.5-neuronx")
inputs = tokenizer("Hamilton is considered to be the best musical of human history.", return_tensors="pt")
emb = emb_model(**inputs)
# ["token_embeddings", "sentence_embedding"]
Runs of optimum bge-base-en-v1.5-neuronx on huggingface.co
35
Total runs
0
24-hour runs
0
3-day runs
29
7-day runs
25
30-day runs
More Information About bge-base-en-v1.5-neuronx huggingface.co Model
bge-base-en-v1.5-neuronx huggingface.co is an AI model on huggingface.co that provides bge-base-en-v1.5-neuronx's model effect (), which can be used instantly with this optimum bge-base-en-v1.5-neuronx model. huggingface.co supports a free trial of the bge-base-en-v1.5-neuronx model, and also provides paid use of the bge-base-en-v1.5-neuronx. Support call bge-base-en-v1.5-neuronx model through api, including Node.js, Python, http.
bge-base-en-v1.5-neuronx huggingface.co is an online trial and call api platform, which integrates bge-base-en-v1.5-neuronx's modeling effects, including api services, and provides a free online trial of bge-base-en-v1.5-neuronx, you can try bge-base-en-v1.5-neuronx online for free by clicking the link below.
optimum bge-base-en-v1.5-neuronx online free url in huggingface.co:
bge-base-en-v1.5-neuronx is an open source model from GitHub that offers a free installation service, and any user can find bge-base-en-v1.5-neuronx on GitHub to install. At the same time, huggingface.co provides the effect of bge-base-en-v1.5-neuronx install, users can directly use bge-base-en-v1.5-neuronx installed effect in huggingface.co for debugging and trial. It also supports api for free installation.
bge-base-en-v1.5-neuronx install url in huggingface.co: