cloudyu / google-gemma-7b-it-dpo-v1

huggingface.co
Total runs: 66
24-hour runs: 0
7-day runs: 5
30-day runs: 20
Model's Last Updated: February 23 2024
text-generation

Introduction of google-gemma-7b-it-dpo-v1

Model Details of google-gemma-7b-it-dpo-v1

this is a DPO fine-tuned model for google/gemma-7b-it using jondurbin/truthy-dpo-v0.1

DPO Trainer
TRL supports the DPO Trainer for training language models from preference data, as described in the paper Direct Preference Optimization: Your Language Model is Secretly a Reward Model by Rafailov et al., 2023. 
 target_modules=[ "gate_proj", "up_proj", "down_proj"]

sample code

import torch
from transformers import AutoTokenizer, AutoModelForCausalLM
import math

## v2 models
model_path = "cloudyu/google-gemma-7b-it-dpo-v1"

tokenizer = AutoTokenizer.from_pretrained(model_path, use_default_system_prompt=False)
model = AutoModelForCausalLM.from_pretrained(
        model_path, torch_dtype=torch.bfloat16, device_map='auto',local_files_only=False, load_in_4bit=True
)
print(model)
prompt = input("please input prompt:")
while len(prompt) > 0:
  input_ids = tokenizer(prompt, return_tensors="pt").input_ids.to("cuda")

  generation_output = model.generate(
    input_ids=input_ids, max_new_tokens=500,repetition_penalty=1.2
  )
  print(tokenizer.decode(generation_output[0]))
  prompt = input("please input prompt:")
  

Runs of cloudyu google-gemma-7b-it-dpo-v1 on huggingface.co

66
Total runs
0
24-hour runs
1
3-day runs
5
7-day runs
20
30-day runs

More Information About google-gemma-7b-it-dpo-v1 huggingface.co Model

More google-gemma-7b-it-dpo-v1 license Visit here:

https://choosealicense.com/licenses/gemma-terms-of-use

google-gemma-7b-it-dpo-v1 huggingface.co

google-gemma-7b-it-dpo-v1 huggingface.co is an AI model on huggingface.co that provides google-gemma-7b-it-dpo-v1's model effect (), which can be used instantly with this cloudyu google-gemma-7b-it-dpo-v1 model. huggingface.co supports a free trial of the google-gemma-7b-it-dpo-v1 model, and also provides paid use of the google-gemma-7b-it-dpo-v1. Support call google-gemma-7b-it-dpo-v1 model through api, including Node.js, Python, http.

google-gemma-7b-it-dpo-v1 huggingface.co Url

https://huggingface.co/cloudyu/google-gemma-7b-it-dpo-v1

cloudyu google-gemma-7b-it-dpo-v1 online free

google-gemma-7b-it-dpo-v1 huggingface.co is an online trial and call api platform, which integrates google-gemma-7b-it-dpo-v1's modeling effects, including api services, and provides a free online trial of google-gemma-7b-it-dpo-v1, you can try google-gemma-7b-it-dpo-v1 online for free by clicking the link below.

cloudyu google-gemma-7b-it-dpo-v1 online free url in huggingface.co:

https://huggingface.co/cloudyu/google-gemma-7b-it-dpo-v1

google-gemma-7b-it-dpo-v1 install

google-gemma-7b-it-dpo-v1 is an open source model from GitHub that offers a free installation service, and any user can find google-gemma-7b-it-dpo-v1 on GitHub to install. At the same time, huggingface.co provides the effect of google-gemma-7b-it-dpo-v1 install, users can directly use google-gemma-7b-it-dpo-v1 installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

google-gemma-7b-it-dpo-v1 install url in huggingface.co:

https://huggingface.co/cloudyu/google-gemma-7b-it-dpo-v1

Url of google-gemma-7b-it-dpo-v1

google-gemma-7b-it-dpo-v1 huggingface.co Url

Provider of google-gemma-7b-it-dpo-v1 huggingface.co

cloudyu
ORGANIZATIONS

Other API from cloudyu

huggingface.co

Total runs: 915
Run Growth: 512
Growth Rate: 55.96%
Updated:July 11 2026
huggingface.co

Total runs: 70
Run Growth: 25
Growth Rate: 35.71%
Updated:January 23 2024
huggingface.co

Total runs: 68
Run Growth: 18
Growth Rate: 26.47%
Updated:January 30 2024
huggingface.co

Total runs: 5
Run Growth: 3
Growth Rate: 60.00%
Updated:December 16 2024
huggingface.co

Total runs: 5
Run Growth: 5
Growth Rate: 100.00%
Updated:December 07 2024
huggingface.co

Total runs: 4
Run Growth: 2
Growth Rate: 50.00%
Updated:December 16 2024
huggingface.co

Total runs: 4
Run Growth: 3
Growth Rate: 75.00%
Updated:December 17 2024
huggingface.co

Total runs: 4
Run Growth: 4
Growth Rate: 100.00%
Updated:September 09 2024
huggingface.co

Total runs: 2
Run Growth: 1
Growth Rate: 50.00%
Updated:December 18 2024
huggingface.co

Total runs: 2
Run Growth: 2
Growth Rate: 100.00%
Updated:November 28 2024
huggingface.co

Total runs: 0
Run Growth: -5
Growth Rate: 0.00%
Updated:November 28 2024
huggingface.co

Total runs: 0
Run Growth: -2
Growth Rate: 0.00%
Updated:November 28 2024
huggingface.co

Total runs: 0
Run Growth: -2
Growth Rate: 0.00%
Updated:December 06 2024