This model has been optimized for AWS Neuron devices (Inferentia/Trainium). To use it:
from optimum.neuron import NeuronModelForCausalLM
model = NeuronModelForCausalLM.from_pretrained("badaoui/microsoft-Phi-3-mini-4k-instruct-neuron")
Performance
These files are pre-compiled for AWS Neuron devices and should provide improved inference performance compared to the original model when deployed on Inferentia or Trainium instances.
microsoft-Phi-3-mini-4k-instruct-neuron huggingface.co is an AI model on huggingface.co that provides microsoft-Phi-3-mini-4k-instruct-neuron's model effect (), which can be used instantly with this badaoui microsoft-Phi-3-mini-4k-instruct-neuron model. huggingface.co supports a free trial of the microsoft-Phi-3-mini-4k-instruct-neuron model, and also provides paid use of the microsoft-Phi-3-mini-4k-instruct-neuron. Support call microsoft-Phi-3-mini-4k-instruct-neuron model through api, including Node.js, Python, http.
microsoft-Phi-3-mini-4k-instruct-neuron huggingface.co is an online trial and call api platform, which integrates microsoft-Phi-3-mini-4k-instruct-neuron's modeling effects, including api services, and provides a free online trial of microsoft-Phi-3-mini-4k-instruct-neuron, you can try microsoft-Phi-3-mini-4k-instruct-neuron online for free by clicking the link below.
badaoui microsoft-Phi-3-mini-4k-instruct-neuron online free url in huggingface.co:
microsoft-Phi-3-mini-4k-instruct-neuron is an open source model from GitHub that offers a free installation service, and any user can find microsoft-Phi-3-mini-4k-instruct-neuron on GitHub to install. At the same time, huggingface.co provides the effect of microsoft-Phi-3-mini-4k-instruct-neuron install, users can directly use microsoft-Phi-3-mini-4k-instruct-neuron installed effect in huggingface.co for debugging and trial. It also supports api for free installation.
microsoft-Phi-3-mini-4k-instruct-neuron install url in huggingface.co: