helenai / ibm-granite-granite-8b-code-instruct-ov

huggingface.co
Total runs: 27
24-hour runs: 0
7-day runs: 1
30-day runs: 19
Model's Last Updated: June 07 2024
text-generation

Introduction of ibm-granite-granite-8b-code-instruct-ov

Model Details of ibm-granite-granite-8b-code-instruct-ov

ibm-granite/granite-8b-code-instruct

This is the ibm-granite/granite-8b-code-instruct model converted to OpenVINO with INT8 weights compression for accelerated inference.

An example of how to do inference on this model:

# pip install optimum[openvino]
from transformers import AutoTokenizer
from optimum.intel import OVModelForCausalLM

model_path = "helenai/ibm-granite-granite-8b-code-instruct-ov"
tokenizer = AutoTokenizer.from_pretrained(model_path)
model = OVModelForCausalLM.from_pretrained(model_path)

# change input text as desired
chat = [
    { "role": "user", "content": "Write a code to find the maximum value in a list of numbers." },
]
chat = tokenizer.apply_chat_template(chat, tokenize=False, add_generation_prompt=True)
# tokenize the text
input_tokens = tokenizer(chat, return_tensors="pt")
# generate output tokens
output = model.generate(**input_tokens, max_new_tokens=100)
# decode output tokens into text
output = tokenizer.batch_decode(output)
# loop over the batch to print, in this example the batch size is 1
for i in output:
    print(i)

Runs of helenai ibm-granite-granite-8b-code-instruct-ov on huggingface.co

27
Total runs
0
24-hour runs
3
3-day runs
1
7-day runs
19
30-day runs

More Information About ibm-granite-granite-8b-code-instruct-ov huggingface.co Model

ibm-granite-granite-8b-code-instruct-ov huggingface.co

ibm-granite-granite-8b-code-instruct-ov huggingface.co is an AI model on huggingface.co that provides ibm-granite-granite-8b-code-instruct-ov's model effect (), which can be used instantly with this helenai ibm-granite-granite-8b-code-instruct-ov model. huggingface.co supports a free trial of the ibm-granite-granite-8b-code-instruct-ov model, and also provides paid use of the ibm-granite-granite-8b-code-instruct-ov. Support call ibm-granite-granite-8b-code-instruct-ov model through api, including Node.js, Python, http.

ibm-granite-granite-8b-code-instruct-ov huggingface.co Url

https://huggingface.co/helenai/ibm-granite-granite-8b-code-instruct-ov

helenai ibm-granite-granite-8b-code-instruct-ov online free

ibm-granite-granite-8b-code-instruct-ov huggingface.co is an online trial and call api platform, which integrates ibm-granite-granite-8b-code-instruct-ov's modeling effects, including api services, and provides a free online trial of ibm-granite-granite-8b-code-instruct-ov, you can try ibm-granite-granite-8b-code-instruct-ov online for free by clicking the link below.

helenai ibm-granite-granite-8b-code-instruct-ov online free url in huggingface.co:

https://huggingface.co/helenai/ibm-granite-granite-8b-code-instruct-ov

ibm-granite-granite-8b-code-instruct-ov install

ibm-granite-granite-8b-code-instruct-ov is an open source model from GitHub that offers a free installation service, and any user can find ibm-granite-granite-8b-code-instruct-ov on GitHub to install. At the same time, huggingface.co provides the effect of ibm-granite-granite-8b-code-instruct-ov install, users can directly use ibm-granite-granite-8b-code-instruct-ov installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

ibm-granite-granite-8b-code-instruct-ov install url in huggingface.co:

https://huggingface.co/helenai/ibm-granite-granite-8b-code-instruct-ov

Url of ibm-granite-granite-8b-code-instruct-ov

ibm-granite-granite-8b-code-instruct-ov huggingface.co Url

Provider of ibm-granite-granite-8b-code-instruct-ov huggingface.co

helenai
ORGANIZATIONS

Other API from helenai

huggingface.co

Total runs: 825
Run Growth: 11
Growth Rate: 1.33%
Updated:April 13 2023
huggingface.co

Total runs: 741
Run Growth: 90
Growth Rate: 12.15%
Updated:March 12 2023