Total runs:
24.7K
Run Growth:
-10.6K
Growth Rate:
-43.02%
Sponsored by
Demi AI
TechxGenus / starcoder2-15b-instruct-GPTQ
Model's Last Updated: March 24 2024
text-generation
Introduction of starcoder2-15b-instruct-GPTQ
Model Details of starcoder2-15b-instruct-GPTQ
GPTQ quantized version of starcoder2-15b-instruct model.
starcoder2-instruct
We've fine-tuned starcoder2-15b with an additional 0.7 billion high-quality, code-related tokens for 3 epochs. We used DeepSpeed ZeRO 3 and Flash Attention 2 to accelerate the training process. It achieves 77.4 pass@1 on HumanEval-Python. This model operates using the Alpaca instruction format (excluding the system prompt).
Usage
Here give some examples of how to use our model:
from transformers import AutoTokenizer, AutoModelForCausalLM
import torch
PROMPT = """### Instruction
{instruction}
### Response
"""
instruction = <Your code instruction here>
prompt = PROMPT.format(instruction=instruction)
tokenizer = AutoTokenizer.from_pretrained("TechxGenus/starcoder2-15b-instruct")
model = AutoModelForCausalLM.from_pretrained(
"TechxGenus/starcoder2-15b-instruct",
torch_dtype=torch.bfloat16,
device_map="auto",
)
inputs = tokenizer.encode(prompt, return_tensors="pt")
outputs = model.generate(input_ids=inputs.to(model.device), max_new_tokens=2048)
print(tokenizer.decode(outputs[0]))
With text-generation pipeline:
from transformers import pipeline
import torch
PROMPT = """### Instruction
{instruction}
### Response
"""
instruction = <Your code instruction here>
prompt = PROMPT.format(instruction=instruction)
generator = pipeline(
model="TechxGenus/starcoder2-15b-instruct",
task="text-generation",
torch_dtype=torch.bfloat16,
device_map="auto",
)
result = generator(prompt, max_length=2048)
print(result[0]["generated_text"])
Note
Model may sometimes make errors, produce misleading contents, or struggle to manage tasks that are not related to coding. It has undergone very limited testing. Additional safety testing should be performed before any real-world deployments.
Runs of TechxGenus starcoder2-15b-instruct-GPTQ on huggingface.co
42
Total runs
0
24-hour runs
0
3-day runs
0
7-day runs
41
30-day runs
More Information About starcoder2-15b-instruct-GPTQ huggingface.co Model
Url of starcoder2-15b-instruct-GPTQ
starcoder2-15b-instruct-GPTQ huggingface.co Url
Provider of starcoder2-15b-instruct-GPTQ huggingface.co
Other API from TechxGenus
Updated:April 07 2024
Total runs:
11.2K
Run Growth:
10.7K
Growth Rate:
94.96%
Total runs:
3.5K
Run Growth:
-7.2K
Growth Rate:
-206.94%
Total runs:
1.5K
Run Growth:
776
Growth Rate:
52.79%
Total runs:
898
Run Growth:
244
Growth Rate:
27.17%
Total runs:
879
Run Growth:
296
Growth Rate:
33.67%
Total runs:
646
Run Growth:
393
Growth Rate:
60.84%
Total runs:
551
Run Growth:
-663
Growth Rate:
-120.33%
Total runs:
507
Run Growth:
-174
Growth Rate:
-34.32%
Total runs:
388
Run Growth:
-944
Growth Rate:
-243.30%
Total runs:
303
Run Growth:
-391
Growth Rate:
-129.04%
Total runs:
254
Run Growth:
-135
Growth Rate:
-53.15%
Total runs:
182
Run Growth:
157
Growth Rate:
86.26%
Total runs:
159
Run Growth:
-188
Growth Rate:
-118.24%
Total runs:
156
Run Growth:
85
Growth Rate:
54.49%
Total runs:
146
Run Growth:
128
Growth Rate:
87.67%
Total runs:
103
Run Growth:
67
Growth Rate:
65.05%
Total runs:
78
Run Growth:
69
Growth Rate:
88.46%
Total runs:
68
Run Growth:
-122
Growth Rate:
-179.41%
Total runs:
62
Run Growth:
9
Growth Rate:
14.52%
Total runs:
54
Run Growth:
18
Growth Rate:
33.33%
Total runs:
53
Run Growth:
-130
Growth Rate:
-245.28%
Total runs:
52
Run Growth:
49
Growth Rate:
94.23%
Total runs:
50
Run Growth:
-13
Growth Rate:
-26.00%
Total runs:
35
Run Growth:
30
Growth Rate:
85.71%
Total runs:
35
Run Growth:
-157
Growth Rate:
-448.57%
Total runs:
34
Run Growth:
26
Growth Rate:
76.47%
Total runs:
32
Run Growth:
11
Growth Rate:
34.38%
Total runs:
31
Run Growth:
31
Growth Rate:
100.00%
Total runs:
29
Run Growth:
25
Growth Rate:
86.21%
Total runs:
29
Run Growth:
27
Growth Rate:
93.10%
Total runs:
28
Run Growth:
14
Growth Rate:
50.00%
Total runs:
25
Run Growth:
-92
Growth Rate:
-368.00%
Total runs:
24
Run Growth:
15
Growth Rate:
62.50%
Total runs:
18
Run Growth:
-37
Growth Rate:
-205.56%
Total runs:
18
Run Growth:
16
Growth Rate:
88.89%
Total runs:
18
Run Growth:
15
Growth Rate:
83.33%
Total runs:
18
Run Growth:
13
Growth Rate:
72.22%
Total runs:
17
Run Growth:
10
Growth Rate:
58.82%
Total runs:
16
Run Growth:
15
Growth Rate:
93.75%
Total runs:
15
Run Growth:
13
Growth Rate:
86.67%
Total runs:
15
Run Growth:
14
Growth Rate:
93.33%
Total runs:
14
Run Growth:
14
Growth Rate:
100.00%
Total runs:
14
Run Growth:
10
Growth Rate:
71.43%
Total runs:
12
Run Growth:
8
Growth Rate:
66.67%
Total runs:
12
Run Growth:
11
Growth Rate:
91.67%
Total runs:
12
Run Growth:
6
Growth Rate:
50.00%
Total runs:
12
Run Growth:
7
Growth Rate:
58.33%
Total runs:
11
Run Growth:
2
Growth Rate:
18.18%
Total runs:
11
Run Growth:
7
Growth Rate:
63.64%
Total runs:
11
Run Growth:
8
Growth Rate:
72.73%
Total runs:
11
Run Growth:
8
Growth Rate:
72.73%
Total runs:
11
Run Growth:
10
Growth Rate:
90.91%
Total runs:
10
Run Growth:
10
Growth Rate:
100.00%
Total runs:
10
Run Growth:
6
Growth Rate:
60.00%
Total runs:
10
Run Growth:
6
Growth Rate:
60.00%
Total runs:
10
Run Growth:
8
Growth Rate:
80.00%
Total runs:
10
Run Growth:
6
Growth Rate:
60.00%
Total runs:
10
Run Growth:
-504
Growth Rate:
-5040.00%
Total runs:
10
Run Growth:
9
Growth Rate:
90.00%
Total runs:
10
Run Growth:
8
Growth Rate:
80.00%
Total runs:
9
Run Growth:
-10
Growth Rate:
-111.11%
Total runs:
9
Run Growth:
6
Growth Rate:
66.67%
Total runs:
9
Run Growth:
2
Growth Rate:
22.22%
Total runs:
9
Run Growth:
6
Growth Rate:
66.67%
Total runs:
9
Run Growth:
5
Growth Rate:
55.56%
Total runs:
9
Run Growth:
8
Growth Rate:
88.89%
Total runs:
9
Run Growth:
9
Growth Rate:
100.00%
Total runs:
9
Run Growth:
3
Growth Rate:
33.33%
Total runs:
8
Run Growth:
-12
Growth Rate:
-150.00%
Total runs:
8
Run Growth:
0
Growth Rate:
0.00%
Total runs:
8
Run Growth:
8
Growth Rate:
100.00%
Total runs:
8
Run Growth:
8
Growth Rate:
100.00%
Total runs:
8
Run Growth:
6
Growth Rate:
75.00%
Total runs:
8
Run Growth:
4
Growth Rate:
50.00%
Total runs:
8
Run Growth:
6
Growth Rate:
75.00%
Total runs:
8
Run Growth:
-48
Growth Rate:
-600.00%
Total runs:
8
Run Growth:
4
Growth Rate:
50.00%
Total runs:
8
Run Growth:
5
Growth Rate:
62.50%
Total runs:
7
Run Growth:
6
Growth Rate:
85.71%
Total runs:
7
Run Growth:
6
Growth Rate:
85.71%
Total runs:
7
Run Growth:
5
Growth Rate:
71.43%
Total runs:
7
Run Growth:
6
Growth Rate:
85.71%
Total runs:
7
Run Growth:
6
Growth Rate:
85.71%
Total runs:
7
Run Growth:
-2
Growth Rate:
-28.57%