merve / gemma-7b-it-8bit

huggingface.co
Total runs: 12
24-hour runs: 0
7-day runs: 2
30-day runs: 7
Model's Last Updated: February 22 2024
text-generation

Introduction of gemma-7b-it-8bit

Model Details of gemma-7b-it-8bit

Gemma-7B in 8-bit with bitsandbytes

This is the repository for Gemma-7B-it quantized to 8-bit using bitsandbytes. Original model card and license for Gemma-7B can be found here . This is the base model and it's not instruction fine-tuned.

Usage

Please visit original Gemma-7B-it model card for intended uses and limitations.

You can use this model like following:

from transformers import AutoModelForCausalLM
model = AutoModelForCausalLM.from_pretrained(
  "merve/gemma-7b-it-8bit"
)
from transformers import AutoTokenizer
tokenizer =AutoTokenizer.from_pretrained(
  "google/gemma-7b-it"
)
#outputs = model.generate(**input_ids)
chat = [
    { "role": "user", "content": "Write a hello world program" },
]
prompt = tokenizer.apply_chat_template(chat, tokenize=False, add_generation_prompt=True)
inputs = tokenizer.encode(prompt, add_special_tokens=True, return_tensors="pt")
outputs = model.generate(input_ids=inputs.to(model.device), max_new_tokens=150)
tokenizer.decode(outputs[0])

Runs of merve gemma-7b-it-8bit on huggingface.co

12
Total runs
0
24-hour runs
2
3-day runs
2
7-day runs
7
30-day runs

More Information About gemma-7b-it-8bit huggingface.co Model

More gemma-7b-it-8bit license Visit here:

https://choosealicense.com/licenses/gemma

gemma-7b-it-8bit huggingface.co

gemma-7b-it-8bit huggingface.co is an AI model on huggingface.co that provides gemma-7b-it-8bit's model effect (), which can be used instantly with this merve gemma-7b-it-8bit model. huggingface.co supports a free trial of the gemma-7b-it-8bit model, and also provides paid use of the gemma-7b-it-8bit. Support call gemma-7b-it-8bit model through api, including Node.js, Python, http.

gemma-7b-it-8bit huggingface.co Url

https://huggingface.co/merve/gemma-7b-it-8bit

merve gemma-7b-it-8bit online free

gemma-7b-it-8bit huggingface.co is an online trial and call api platform, which integrates gemma-7b-it-8bit's modeling effects, including api services, and provides a free online trial of gemma-7b-it-8bit, you can try gemma-7b-it-8bit online for free by clicking the link below.

merve gemma-7b-it-8bit online free url in huggingface.co:

https://huggingface.co/merve/gemma-7b-it-8bit

gemma-7b-it-8bit install

gemma-7b-it-8bit is an open source model from GitHub that offers a free installation service, and any user can find gemma-7b-it-8bit on GitHub to install. At the same time, huggingface.co provides the effect of gemma-7b-it-8bit install, users can directly use gemma-7b-it-8bit installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

gemma-7b-it-8bit install url in huggingface.co:

https://huggingface.co/merve/gemma-7b-it-8bit

Url of gemma-7b-it-8bit

gemma-7b-it-8bit huggingface.co Url

Provider of gemma-7b-it-8bit huggingface.co

merve
ORGANIZATIONS

Other API from merve

huggingface.co

Total runs: 39
Run Growth: -1
Growth Rate: -2.78%
Updated:February 26 2024
huggingface.co

Total runs: 34
Run Growth: -24
Growth Rate: -70.59%
Updated:January 06 2024
huggingface.co

Total runs: 22
Run Growth: -46
Growth Rate: -209.09%
Updated:October 12 2023
huggingface.co

Total runs: 15
Run Growth: 9
Growth Rate: 60.00%
Updated:February 22 2024
huggingface.co

Total runs: 15
Run Growth: 8
Growth Rate: 53.33%
Updated:September 19 2025
huggingface.co

Total runs: 14
Run Growth: 7
Growth Rate: 50.00%
Updated:July 18 2024
huggingface.co

Total runs: 14
Run Growth: -17
Growth Rate: -121.43%
Updated:January 28 2026
huggingface.co

Total runs: 11
Run Growth: -2
Growth Rate: -18.18%
Updated:September 11 2025
huggingface.co

Total runs: 10
Run Growth: 9
Growth Rate: 90.00%
Updated:November 25 2023
huggingface.co

Total runs: 10
Run Growth: 6
Growth Rate: 54.55%
Updated:January 28 2023
huggingface.co

Total runs: 9
Run Growth: 6
Growth Rate: 66.67%
Updated:February 10 2023
huggingface.co

Total runs: 9
Run Growth: 5
Growth Rate: 55.56%
Updated:March 26 2024
huggingface.co

Total runs: 8
Run Growth: -22
Growth Rate: -275.00%
Updated:December 18 2024
huggingface.co

Total runs: 8
Run Growth: 4
Growth Rate: 50.00%
Updated:July 11 2023
huggingface.co

Total runs: 7
Run Growth: -8
Growth Rate: -114.29%
Updated:October 04 2023
huggingface.co

Total runs: 7
Run Growth: 1
Growth Rate: 14.29%
Updated:March 26 2024
huggingface.co

Total runs: 5
Run Growth: 3
Growth Rate: 60.00%
Updated:April 02 2023
huggingface.co

Total runs: 5
Run Growth: 3
Growth Rate: 60.00%
Updated:April 02 2023
huggingface.co

Total runs: 4
Run Growth: 0
Growth Rate: 0.00%
Updated:June 14 2023
huggingface.co

Total runs: 1
Run Growth: 1
Growth Rate: 100.00%
Updated:December 20 2024
huggingface.co

Total runs: 0
Run Growth: 0
Growth Rate: 0.00%
Updated:April 25 2026
huggingface.co

Total runs: 0
Run Growth: 0
Growth Rate: 0.00%
Updated:May 22 2024
huggingface.co

Total runs: 0
Run Growth: 0
Growth Rate: 0.00%
Updated:August 30 2022
huggingface.co

Total runs: 0
Run Growth: 0
Growth Rate: 0.00%
Updated:January 04 2024
huggingface.co

Total runs: 0
Run Growth: 0
Growth Rate: 0.00%
Updated:October 22 2024
huggingface.co

Total runs: 0
Run Growth: 0
Growth Rate: 0.00%
Updated:May 30 2022