from optimum.intel.openvino import OVModelForCausalLM
from transformers import AutoTokenizer, pipeline
# model_id should be set to either a local directory or a model available on the HuggingFace hub.
model_id = "katuni4ka/dolly-v2-3b-ov"
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = OVModelForCausalLM.from_pretrained(model_id)
pipe = pipeline("text-generation", model=model, tokenizer=tokenizer)
result = pipe("hello world")
print(result)
More detailed example how to use model in instruction following scenario, can be found in this
notebook
Runs of katuni4ka dolly-v2-3b-ov on huggingface.co
16
Total runs
0
24-hour runs
-1
3-day runs
-1
7-day runs
3
30-day runs
More Information About dolly-v2-3b-ov huggingface.co Model
dolly-v2-3b-ov huggingface.co is an AI model on huggingface.co that provides dolly-v2-3b-ov's model effect (), which can be used instantly with this katuni4ka dolly-v2-3b-ov model. huggingface.co supports a free trial of the dolly-v2-3b-ov model, and also provides paid use of the dolly-v2-3b-ov. Support call dolly-v2-3b-ov model through api, including Node.js, Python, http.
dolly-v2-3b-ov huggingface.co is an online trial and call api platform, which integrates dolly-v2-3b-ov's modeling effects, including api services, and provides a free online trial of dolly-v2-3b-ov, you can try dolly-v2-3b-ov online for free by clicking the link below.
katuni4ka dolly-v2-3b-ov online free url in huggingface.co:
dolly-v2-3b-ov is an open source model from GitHub that offers a free installation service, and any user can find dolly-v2-3b-ov on GitHub to install. At the same time, huggingface.co provides the effect of dolly-v2-3b-ov install, users can directly use dolly-v2-3b-ov installed effect in huggingface.co for debugging and trial. It also supports api for free installation.