This is the
microsoft/phi-2
model converted to
OpenVINO
with INT8 weights compression for accelerated inference.
An example of how to do inference on this model:
from optimum.intel import OVModelForCausalLM
from transformers import AutoTokenizer, pipeline
# model_id should be set to either a local directory or a model available on the HuggingFace hub.
model_id = "helenai/microsoft-phi-2-ov"
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = OVModelForCausalLM.from_pretrained(model_id)
pipe = pipeline("text-generation", model=model, tokenizer=tokenizer)
result = pipe("hello world")
print(result)
Runs of helenai microsoft-phi-2-ov on huggingface.co
3
Total runs
0
24-hour runs
1
3-day runs
1
7-day runs
3
30-day runs
More Information About microsoft-phi-2-ov huggingface.co Model
microsoft-phi-2-ov huggingface.co
microsoft-phi-2-ov huggingface.co is an AI model on huggingface.co that provides microsoft-phi-2-ov's model effect (), which can be used instantly with this helenai microsoft-phi-2-ov model. huggingface.co supports a free trial of the microsoft-phi-2-ov model, and also provides paid use of the microsoft-phi-2-ov. Support call microsoft-phi-2-ov model through api, including Node.js, Python, http.
microsoft-phi-2-ov huggingface.co is an online trial and call api platform, which integrates microsoft-phi-2-ov's modeling effects, including api services, and provides a free online trial of microsoft-phi-2-ov, you can try microsoft-phi-2-ov online for free by clicking the link below.
helenai microsoft-phi-2-ov online free url in huggingface.co:
microsoft-phi-2-ov is an open source model from GitHub that offers a free installation service, and any user can find microsoft-phi-2-ov on GitHub to install. At the same time, huggingface.co provides the effect of microsoft-phi-2-ov install, users can directly use microsoft-phi-2-ov installed effect in huggingface.co for debugging and trial. It also supports api for free installation.