# pip install optimum[openvino]from transformers import AutoTokenizer
from optimum.intel import OVModelForCausalLM
model_path = "helenai/ibm-granite-granite-8b-code-instruct-ov"
tokenizer = AutoTokenizer.from_pretrained(model_path)
model = OVModelForCausalLM.from_pretrained(model_path)
# change input text as desired
chat = [
{ "role": "user", "content": "Write a code to find the maximum value in a list of numbers." },
]
chat = tokenizer.apply_chat_template(chat, tokenize=False, add_generation_prompt=True)
# tokenize the text
input_tokens = tokenizer(chat, return_tensors="pt")
# generate output tokens
output = model.generate(**input_tokens, max_new_tokens=100)
# decode output tokens into text
output = tokenizer.batch_decode(output)
# loop over the batch to print, in this example the batch size is 1for i in output:
print(i)
Runs of helenai ibm-granite-granite-8b-code-instruct-ov on huggingface.co
27
Total runs
0
24-hour runs
3
3-day runs
1
7-day runs
19
30-day runs
More Information About ibm-granite-granite-8b-code-instruct-ov huggingface.co Model
ibm-granite-granite-8b-code-instruct-ov huggingface.co is an AI model on huggingface.co that provides ibm-granite-granite-8b-code-instruct-ov's model effect (), which can be used instantly with this helenai ibm-granite-granite-8b-code-instruct-ov model. huggingface.co supports a free trial of the ibm-granite-granite-8b-code-instruct-ov model, and also provides paid use of the ibm-granite-granite-8b-code-instruct-ov. Support call ibm-granite-granite-8b-code-instruct-ov model through api, including Node.js, Python, http.
ibm-granite-granite-8b-code-instruct-ov huggingface.co is an online trial and call api platform, which integrates ibm-granite-granite-8b-code-instruct-ov's modeling effects, including api services, and provides a free online trial of ibm-granite-granite-8b-code-instruct-ov, you can try ibm-granite-granite-8b-code-instruct-ov online for free by clicking the link below.
helenai ibm-granite-granite-8b-code-instruct-ov online free url in huggingface.co:
ibm-granite-granite-8b-code-instruct-ov is an open source model from GitHub that offers a free installation service, and any user can find ibm-granite-granite-8b-code-instruct-ov on GitHub to install. At the same time, huggingface.co provides the effect of ibm-granite-granite-8b-code-instruct-ov install, users can directly use ibm-granite-granite-8b-code-instruct-ov installed effect in huggingface.co for debugging and trial. It also supports api for free installation.
ibm-granite-granite-8b-code-instruct-ov install url in huggingface.co: