Total runs:
305.5K
Run Growth:
25.5K
Growth Rate:
8.35%
Sponsored by
PoYo.AI
mrm8488 / llama-2-coder-7b
Model's Last Updated: December 24 2023
text-generation
Introduction of llama-2-coder-7b
Model Details of llama-2-coder-7b
LlaMa 2 Coder 🦙👩💻
LlaMa-2 7b fine-tuned on the CodeAlpaca 20k instructions dataset by using the method QLoRA with PEFT library.
Model description 🧠
Llama 2 is a collection of pretrained and fine-tuned generative text models ranging in scale from 7 billion to 70 billion parameters. Meta developed and publicly released the Llama 2 family of large language models (LLMs), a collection of pretrained and fine-tuned generative text models ranging in scale from 7 billion to 70 billion parameters. Our fine-tuned LLMs, called Llama-2-Chat, are optimized for dialogue use cases. Llama-2-Chat models outperform open-source chat models on most benchmarks we tested, and in our human evaluations for helpfulness and safety, are on par with some popular closed-source models like ChatGPT and PaLM.
Training and evaluation data 📚
CodeAlpaca_20K : contains 20K instruction-following data used for fine-tuning the Code Alpaca model.
Training hyperparameters ⚙
optim="paged_adamw_32bit",
num_train_epochs = 2,
eval_steps=50,
save_steps=50,
evaluation_strategy="steps",
save_strategy="steps",
save_total_limit=2,
seed=66,
load_best_model_at_end=True,
logging_steps=1,
learning_rate=2e-4,
fp16=True,
bf16=False,
max_grad_norm=0.3,
warmup_ratio=0.03,
group_by_length=True,
lr_scheduler_type="constant"
Training results 🗒️
| Step | Training Loss | Validation Loss |
|---|---|---|
| 50 | 0.624400 | 0.600070 |
| 100 | 0.634100 | 0.592757 |
| 150 | 0.545800 | 0.586652 |
| 200 | 0.572500 | 0.577525 |
| 250 | 0.528000 | 0.590118 |
Eval results 📊
WIP
Example of usage 👩💻
import torch
from transformers import AutoModelForCausalLM, AutoTokenizer, GenerationConfig
model_id = "mrm8488/llama-2-coder-7b"
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(model_id).to("cuda")
def create_prompt(instruction):
system = "You are a coding assistant that will help the user to resolve the following instruction:"
instruction = "### Instruction: " + instruction
return system + "\n" + instruction + "\n\n" + "### Solution:" + "\n"
def generate(
instruction,
max_new_tokens=128,
temperature=0.1,
top_p=0.75,
top_k=40,
num_beams=4,
**kwargs,
):
prompt = create_prompt(instruction)
print(prompt)
inputs = tokenizer(prompt, return_tensors="pt")
input_ids = inputs["input_ids"].to("cuda")
attention_mask = inputs["attention_mask"].to("cuda")
generation_config = GenerationConfig(
temperature=temperature,
top_p=top_p,
top_k=top_k,
num_beams=num_beams,
**kwargs,
)
with torch.no_grad():
generation_output = model.generate(
input_ids=input_ids,
attention_mask=attention_mask,
generation_config=generation_config,
return_dict_in_generate=True,
output_scores=True,
max_new_tokens=max_new_tokens,
early_stopping=True
)
s = generation_output.sequences[0]
output = tokenizer.decode(s)
return output.split("### Solution:")[1].lstrip("\n")
instruction = """
Edit the following XML code to add a navigation bar to the top of a web page
<html>
<head>
<title>CliBrAIn</title>
</head>
"""
print(generate(instruction))
Citation
@misc {manuel_romero_2023,
author = { {Manuel Romero} },
title = { llama-2-coder-7b (Revision d30d193) },
year = 2023,
url = { https://huggingface.co/mrm8488/llama-2-coder-7b },
doi = { 10.57967/hf/0931 },
publisher = { Hugging Face }
}
Runs of mrm8488 llama-2-coder-7b on huggingface.co
84
Total runs
-2
24-hour runs
0
3-day runs
3
7-day runs
29
30-day runs
More Information About llama-2-coder-7b huggingface.co Model
Url of llama-2-coder-7b
llama-2-coder-7b huggingface.co Url
Provider of llama-2-coder-7b huggingface.co
Other API from mrm8488
Updated:January 21 2024
Total runs:
32.5K
Run Growth:
1.6K
Growth Rate:
4.80%
Total runs:
13.6K
Run Growth:
2.9K
Growth Rate:
21.44%
Total runs:
10.0K
Run Growth:
-3.3K
Growth Rate:
-32.59%
Total runs:
9.8K
Run Growth:
5.7K
Growth Rate:
58.62%
Total runs:
9.5K
Run Growth:
4.9K
Growth Rate:
50.91%
Total runs:
8.7K
Run Growth:
5.7K
Growth Rate:
65.22%
Total runs:
8.7K
Run Growth:
-830
Growth Rate:
-9.54%
Total runs:
5.9K
Run Growth:
425
Growth Rate:
7.17%
Total runs:
4.8K
Run Growth:
4.0K
Growth Rate:
81.92%
Total runs:
4.7K
Run Growth:
-2.9K
Growth Rate:
-62.94%
Total runs:
4.3K
Run Growth:
4.2K
Growth Rate:
96.32%
Total runs:
1.7K
Run Growth:
798
Growth Rate:
47.64%
Total runs:
1.4K
Run Growth:
41
Growth Rate:
2.91%
Total runs:
1.2K
Run Growth:
-833
Growth Rate:
-71.50%
Total runs:
1.2K
Run Growth:
602
Growth Rate:
51.90%
Total runs:
876
Run Growth:
16
Growth Rate:
1.83%
Total runs:
797
Run Growth:
-434
Growth Rate:
-54.45%
Total runs:
700
Run Growth:
-68
Growth Rate:
-9.71%
Total runs:
682
Run Growth:
335
Growth Rate:
49.12%
Total runs:
667
Run Growth:
235
Growth Rate:
35.23%
Total runs:
626
Run Growth:
-1.6K
Growth Rate:
-261.50%
Total runs:
604
Run Growth:
-44
Growth Rate:
-7.25%
Total runs:
600
Run Growth:
-487
Growth Rate:
-81.17%
Total runs:
541
Run Growth:
-3.0K
Growth Rate:
-563.22%
Total runs:
530
Run Growth:
282
Growth Rate:
53.21%
Total runs:
464
Run Growth:
366
Growth Rate:
78.88%
Total runs:
464
Run Growth:
168
Growth Rate:
36.21%
Total runs:
414
Run Growth:
36
Growth Rate:
8.70%
Total runs:
366
Run Growth:
57
Growth Rate:
15.57%
Total runs:
326
Run Growth:
88
Growth Rate:
26.99%
Total runs:
301
Run Growth:
269
Growth Rate:
89.37%
Total runs:
300
Run Growth:
-48
Growth Rate:
-16.00%
Total runs:
269
Run Growth:
24
Growth Rate:
8.92%
Total runs:
266
Run Growth:
23
Growth Rate:
8.65%
Total runs:
260
Run Growth:
255
Growth Rate:
98.08%
Total runs:
250
Run Growth:
-122
Growth Rate:
-48.80%
Total runs:
248
Run Growth:
111
Growth Rate:
44.76%
Total runs:
242
Run Growth:
-17
Growth Rate:
-7.02%
Total runs:
230
Run Growth:
-121
Growth Rate:
-52.61%
Total runs:
227
Run Growth:
-197
Growth Rate:
-86.78%
Total runs:
197
Run Growth:
64
Growth Rate:
32.49%
Total runs:
172
Run Growth:
-13
Growth Rate:
-7.56%
Total runs:
161
Run Growth:
102
Growth Rate:
63.35%
Total runs:
154
Run Growth:
120
Growth Rate:
77.92%
Total runs:
153
Run Growth:
139
Growth Rate:
90.85%
Total runs:
149
Run Growth:
-7
Growth Rate:
-4.70%
Total runs:
147
Run Growth:
97
Growth Rate:
65.54%
Total runs:
145
Run Growth:
136
Growth Rate:
93.79%
Total runs:
131
Run Growth:
13
Growth Rate:
9.92%
Total runs:
130
Run Growth:
37
Growth Rate:
28.46%
Total runs:
129
Run Growth:
-128
Growth Rate:
-99.22%
Total runs:
127
Run Growth:
48
Growth Rate:
37.80%
Total runs:
121
Run Growth:
101
Growth Rate:
83.47%
Total runs:
120
Run Growth:
24
Growth Rate:
20.00%
Total runs:
118
Run Growth:
102
Growth Rate:
86.44%
Total runs:
116
Run Growth:
38
Growth Rate:
32.76%
Total runs:
110
Run Growth:
86
Growth Rate:
78.18%
Total runs:
109
Run Growth:
74
Growth Rate:
67.89%
Total runs:
109
Run Growth:
35
Growth Rate:
32.11%
Total runs:
103
Run Growth:
96
Growth Rate:
93.20%
Total runs:
102
Run Growth:
46
Growth Rate:
45.10%
Total runs:
100
Run Growth:
-47
Growth Rate:
-47.00%
Total runs:
98
Run Growth:
61
Growth Rate:
62.24%
Total runs:
98
Run Growth:
4
Growth Rate:
4.08%
Total runs:
94
Run Growth:
87
Growth Rate:
92.55%
Total runs:
93
Run Growth:
14
Growth Rate:
15.05%
Total runs:
92
Run Growth:
68
Growth Rate:
73.91%
Total runs:
92
Run Growth:
67
Growth Rate:
72.83%
Total runs:
89
Run Growth:
19
Growth Rate:
21.35%
Total runs:
87
Run Growth:
78
Growth Rate:
89.66%
Total runs:
82
Run Growth:
-40
Growth Rate:
-48.78%
Total runs:
82
Run Growth:
57
Growth Rate:
69.51%
Total runs:
81
Run Growth:
73
Growth Rate:
90.12%
Total runs:
78
Run Growth:
11
Growth Rate:
14.10%
Total runs:
78
Run Growth:
0
Growth Rate:
0.00%
Total runs:
76
Run Growth:
32
Growth Rate:
42.11%
Total runs:
76
Run Growth:
47
Growth Rate:
61.84%
Total runs:
75
Run Growth:
-50
Growth Rate:
-66.67%
Total runs:
75
Run Growth:
55
Growth Rate:
73.33%
Total runs:
73
Run Growth:
31
Growth Rate:
42.47%
Total runs:
70
Run Growth:
47
Growth Rate:
67.14%
Total runs:
63
Run Growth:
53
Growth Rate:
84.13%
Total runs:
63
Run Growth:
28
Growth Rate:
44.44%
Total runs:
62
Run Growth:
54
Growth Rate:
87.10%
Total runs:
62
Run Growth:
31
Growth Rate:
50.00%
Total runs:
60
Run Growth:
36
Growth Rate:
60.00%
Total runs:
60
Run Growth:
47
Growth Rate:
78.33%
Total runs:
59
Run Growth:
53
Growth Rate:
89.83%
Total runs:
59
Run Growth:
44
Growth Rate:
74.58%
Total runs:
57
Run Growth:
29
Growth Rate:
50.88%
Total runs:
55
Run Growth:
47
Growth Rate:
85.45%
Total runs:
55
Run Growth:
32
Growth Rate:
58.18%