Introduction of Phi-3-mini-4k-instruct-062024-onnx
Model Details of Phi-3-mini-4k-instruct-062024-onnx
EmbeddedLLM/Phi-3-mini-4k-instruct-062024 ONNX
Model Summary
This model is an ONNX-optimized version of
microsoft/Phi-3-mini-4k-instruct (June 2024)
, designed to provide accelerated inference on a variety of hardware using ONNX Runtime(CPU and DirectML).
DirectML is a high-performance, hardware-accelerated DirectX 12 library for machine learning, providing GPU acceleration for a wide range of supported hardware and drivers, including AMD, Intel, NVIDIA, and Qualcomm GPUs.
ONNX Models
Here are some of the optimized configurations we have added:
ONNX model for int4 DirectML:
ONNX model for AMD, Intel, and NVIDIA GPUs on Windows, quantized to int4 using AWQ.
Usage
Installation and Setup
To use the EmbeddedLLM/Phi-3-mini-4k-instruct-062024 ONNX model on Windows with DirectML, follow these steps:
Phi-3-mini-4k-instruct-062024-onnx huggingface.co is an AI model on huggingface.co that provides Phi-3-mini-4k-instruct-062024-onnx's model effect (), which can be used instantly with this EmbeddedLLM Phi-3-mini-4k-instruct-062024-onnx model. huggingface.co supports a free trial of the Phi-3-mini-4k-instruct-062024-onnx model, and also provides paid use of the Phi-3-mini-4k-instruct-062024-onnx. Support call Phi-3-mini-4k-instruct-062024-onnx model through api, including Node.js, Python, http.
Phi-3-mini-4k-instruct-062024-onnx huggingface.co is an online trial and call api platform, which integrates Phi-3-mini-4k-instruct-062024-onnx's modeling effects, including api services, and provides a free online trial of Phi-3-mini-4k-instruct-062024-onnx, you can try Phi-3-mini-4k-instruct-062024-onnx online for free by clicking the link below.
EmbeddedLLM Phi-3-mini-4k-instruct-062024-onnx online free url in huggingface.co:
Phi-3-mini-4k-instruct-062024-onnx is an open source model from GitHub that offers a free installation service, and any user can find Phi-3-mini-4k-instruct-062024-onnx on GitHub to install. At the same time, huggingface.co provides the effect of Phi-3-mini-4k-instruct-062024-onnx install, users can directly use Phi-3-mini-4k-instruct-062024-onnx installed effect in huggingface.co for debugging and trial. It also supports api for free installation.
Phi-3-mini-4k-instruct-062024-onnx install url in huggingface.co: