This is the repository for
Gemma-7B-it
quantized to 8-bit using bitsandbytes.
Original model card and license for Gemma-7B can be found
here
.
This is the base model and it's not instruction fine-tuned.
Usage
Please visit original Gemma-7B-it
model card
for intended uses and limitations.
You can use this model like following:
from transformers import AutoModelForCausalLM
model = AutoModelForCausalLM.from_pretrained(
"merve/gemma-7b-it-8bit"
)
from transformers import AutoTokenizer
tokenizer =AutoTokenizer.from_pretrained(
"google/gemma-7b-it"
)
#outputs = model.generate(**input_ids)
chat = [
{ "role": "user", "content": "Write a hello world program" },
]
prompt = tokenizer.apply_chat_template(chat, tokenize=False, add_generation_prompt=True)
inputs = tokenizer.encode(prompt, add_special_tokens=True, return_tensors="pt")
outputs = model.generate(input_ids=inputs.to(model.device), max_new_tokens=150)
tokenizer.decode(outputs[0])
Runs of merve gemma-7b-it-8bit on huggingface.co
12
Total runs
0
24-hour runs
2
3-day runs
2
7-day runs
7
30-day runs
More Information About gemma-7b-it-8bit huggingface.co Model
gemma-7b-it-8bit huggingface.co is an AI model on huggingface.co that provides gemma-7b-it-8bit's model effect (), which can be used instantly with this merve gemma-7b-it-8bit model. huggingface.co supports a free trial of the gemma-7b-it-8bit model, and also provides paid use of the gemma-7b-it-8bit. Support call gemma-7b-it-8bit model through api, including Node.js, Python, http.
gemma-7b-it-8bit huggingface.co is an online trial and call api platform, which integrates gemma-7b-it-8bit's modeling effects, including api services, and provides a free online trial of gemma-7b-it-8bit, you can try gemma-7b-it-8bit online for free by clicking the link below.
merve gemma-7b-it-8bit online free url in huggingface.co:
gemma-7b-it-8bit is an open source model from GitHub that offers a free installation service, and any user can find gemma-7b-it-8bit on GitHub to install. At the same time, huggingface.co provides the effect of gemma-7b-it-8bit install, users can directly use gemma-7b-it-8bit installed effect in huggingface.co for debugging and trial. It also supports api for free installation.