Total runs:
24.7K
Run Growth:
-10.6K
Growth Rate:
-43.02%
Sponsored by
i10X
TechxGenus / stable-code-instruct-3b-AWQ
Model's Last Updated: April 07 2024
text-generation
Introduction of stable-code-instruct-3b-AWQ
Model Details of stable-code-instruct-3b-AWQ
AWQ quantized version of stable-code-instruct-3b model.
Stable Code Instruct 3B
Try it out here: https://huggingface.co/spaces/stabilityai/stable-code-instruct-3b
Model Description
stable-code-instruct-3b
is a 2.7B billion parameter decoder-only language model tuned from
stable-code-3b
. This model was trained on a mix of publicly available datasets, synthetic datasets using
Direct Preference Optimization (DPO)
.
This instruct tune demonstrates state-of-the-art performance (compared to models of similar size) on the MultiPL-E metrics across multiple programming languages tested using BigCode's Evaluation Harness , and on the code portions of MT Bench . The model is finetuned to make it useable in tasks like,
- General purpose Code/Software Engineering like conversations.
- SQL related generation and conversation.
Usage
Here's how you can run the model use the model:
import torch
from transformers import AutoModelForCausalLM, AutoTokenizer
tokenizer = AutoTokenizer.from_pretrained("stabilityai/stable-code-instruct-3b", trust_remote_code=True)
model = AutoModelForCausalLM.from_pretrained("stabilityai/stable-code-instruct-3b", torch_dtype=torch.bfloat16, trust_remote_code=True)
model.eval()
model = model.cuda()
messages = [
{
"role": "system",
"content": "You are a helpful and polite assistant",
},
{
"role": "user",
"content": "Write a simple website in HTML. When a user clicks the button, it shows a random joke from a list of 4 jokes."
},
]
prompt = tokenizer.apply_chat_template(messages, add_generation_prompt=True, tokenize=False)
inputs = tokenizer([prompt], return_tensors="pt").to(model.device)
tokens = model.generate(
**inputs,
max_new_tokens=1024,
temperature=0.5,
top_p=0.95,
top_k=100,
do_sample=True,
use_cache=True
)
output = tokenizer.batch_decode(tokens[:, inputs.input_ids.shape[-1]:], skip_special_tokens=False)[0]
Model Details
- Developed by : Stability AI
-
Model type
:
Stable Code Instruct 3Bmodel is an auto-regressive language model based on the transformer decoder architecture. - Language(s) : English
- Paper : Stable Code Technical Report
- Library : Alignment Handbook
- Finetuned from model : https://huggingface.co/stabilityai/stable-code-3b
- License : StabilityAI Non-Commercial Research Community License . If you want to use this model for your commercial products or purposes, please contact us here to learn more.
-
Contact
: For questions and comments about the model, please email
[email protected]
Performance
Multi-PL Benchmark:
| Model | Size | Avg | Python | C++ | JavaScript | Java | PHP | Rust |
|---|---|---|---|---|---|---|---|---|
| Codellama Instruct | 7B | 0.30 | 0.33 | 0.31 | 0.31 | 0.29 | 0.31 | 0.25 |
| Deepseek Instruct | 1.3B | 0.44 | 0.52 | 0.52 | 0.41 | 0.46 | 0.45 | 0.28 |
| Stable Code Instruct (SFT) | 3B | 0.44 | 0.55 | 0.45 | 0.42 | 0.42 | 0.44 | 0.32 |
| Stable Code Instruct (DPO) | 3B | 0.47 | 0.59 | 0.49 | 0.49 | 0.44 | 0.45 | 0.37 |
MT-Bench Coding:
| Model | Size | Score |
|---|---|---|
| DeepSeek Coder | 1.3B | 4.6 |
| Stable Code Instruct (DPO) | 3B | 5.8 (ours) |
| Stable Code Instruct (SFT) | 3B | 5.5 |
| DeepSeek Coder | 6.7B | 6.9 |
| CodeLlama Instruct | 7B | 3.55 |
| StarChat2 | 15B | 5.7 |
SQL Performance
| Model | Size | Date | Group By | Order By | Ratio | Join | Where |
|---|---|---|---|---|---|---|---|
| Stable Code Instruct (DPO) | 3B | 24.0% | 54.2% | 68.5% | 40.0% | 54.2% | 42.8% |
| DeepSeek-Coder Instruct | 1.3B | 24.0% | 37.1% | 51.4% | 34.3% | 45.7% | 45.7% |
| SQLCoder | 7B | 64.0% | 82.9% | 74.3% | 54.3% | 74.3% | 74.3% |
How to Cite
@misc{stable-code-instruct-3b,
url={[https://huggingface.co/stabilityai/stable-code-3b](https://huggingface.co/stabilityai/stable-code-instruct-3b)},
title={Stable Code 3B},
author={Phung, Duy, and Pinnaparaju, Nikhil and Adithyan, Reshinth and Zhuravinskyi, Maksym and Tow, Jonathan and Cooper, Nathan}
}
Runs of TechxGenus stable-code-instruct-3b-AWQ on huggingface.co
11
Total runs
0
24-hour runs
0
3-day runs
0
7-day runs
9
30-day runs
More Information About stable-code-instruct-3b-AWQ huggingface.co Model
Url of stable-code-instruct-3b-AWQ
stable-code-instruct-3b-AWQ huggingface.co Url
Provider of stable-code-instruct-3b-AWQ huggingface.co
Other API from TechxGenus
Updated:April 07 2024
Total runs:
12.2K
Run Growth:
11.7K
Growth Rate:
95.59%
Total runs:
3.2K
Run Growth:
-5.8K
Growth Rate:
-183.85%
Total runs:
1.5K
Run Growth:
776
Growth Rate:
52.79%
Total runs:
1.2K
Run Growth:
943
Growth Rate:
78.98%
Total runs:
898
Run Growth:
244
Growth Rate:
27.17%
Total runs:
879
Run Growth:
296
Growth Rate:
33.67%
Total runs:
522
Run Growth:
-163
Growth Rate:
-31.23%
Total runs:
473
Run Growth:
-950
Growth Rate:
-200.85%
Total runs:
396
Run Growth:
-895
Growth Rate:
-226.01%
Total runs:
354
Run Growth:
2
Growth Rate:
0.56%
Total runs:
303
Run Growth:
-391
Growth Rate:
-129.04%
Total runs:
180
Run Growth:
155
Growth Rate:
86.11%
Total runs:
178
Run Growth:
-223
Growth Rate:
-125.28%
Total runs:
156
Run Growth:
85
Growth Rate:
54.49%
Total runs:
143
Run Growth:
125
Growth Rate:
87.41%
Total runs:
94
Run Growth:
57
Growth Rate:
60.64%
Total runs:
78
Run Growth:
69
Growth Rate:
88.46%
Total runs:
62
Run Growth:
9
Growth Rate:
14.52%
Total runs:
54
Run Growth:
18
Growth Rate:
33.33%
Total runs:
51
Run Growth:
-206
Growth Rate:
-403.92%
Total runs:
49
Run Growth:
-14
Growth Rate:
-28.57%
Total runs:
42
Run Growth:
41
Growth Rate:
97.62%
Total runs:
42
Run Growth:
-163
Growth Rate:
-388.10%
Total runs:
34
Run Growth:
29
Growth Rate:
85.29%
Total runs:
34
Run Growth:
26
Growth Rate:
76.47%
Total runs:
33
Run Growth:
-159
Growth Rate:
-481.82%
Total runs:
32
Run Growth:
11
Growth Rate:
34.38%
Total runs:
31
Run Growth:
31
Growth Rate:
100.00%
Total runs:
29
Run Growth:
18
Growth Rate:
62.07%
Total runs:
28
Run Growth:
26
Growth Rate:
92.86%
Total runs:
26
Run Growth:
22
Growth Rate:
84.62%
Total runs:
25
Run Growth:
-91
Growth Rate:
-364.00%
Total runs:
24
Run Growth:
15
Growth Rate:
62.50%
Total runs:
21
Run Growth:
16
Growth Rate:
76.19%
Total runs:
18
Run Growth:
16
Growth Rate:
88.89%
Total runs:
17
Run Growth:
-38
Growth Rate:
-223.53%
Total runs:
16
Run Growth:
7
Growth Rate:
43.75%
Total runs:
15
Run Growth:
13
Growth Rate:
86.67%
Total runs:
15
Run Growth:
14
Growth Rate:
93.33%
Total runs:
14
Run Growth:
14
Growth Rate:
100.00%
Total runs:
14
Run Growth:
11
Growth Rate:
78.57%
Total runs:
14
Run Growth:
10
Growth Rate:
71.43%
Total runs:
13
Run Growth:
10
Growth Rate:
76.92%
Total runs:
12
Run Growth:
8
Growth Rate:
66.67%
Total runs:
12
Run Growth:
11
Growth Rate:
91.67%
Total runs:
12
Run Growth:
6
Growth Rate:
50.00%
Total runs:
12
Run Growth:
6
Growth Rate:
50.00%
Total runs:
11
Run Growth:
2
Growth Rate:
18.18%
Total runs:
11
Run Growth:
4
Growth Rate:
36.36%
Total runs:
11
Run Growth:
10
Growth Rate:
90.91%
Total runs:
10
Run Growth:
9
Growth Rate:
90.00%
Total runs:
10
Run Growth:
7
Growth Rate:
70.00%
Total runs:
10
Run Growth:
6
Growth Rate:
60.00%
Total runs:
10
Run Growth:
-504
Growth Rate:
-5040.00%
Total runs:
9
Run Growth:
6
Growth Rate:
66.67%
Total runs:
9
Run Growth:
8
Growth Rate:
88.89%
Total runs:
9
Run Growth:
8
Growth Rate:
88.89%
Total runs:
9
Run Growth:
6
Growth Rate:
66.67%
Total runs:
9
Run Growth:
9
Growth Rate:
100.00%
Total runs:
9
Run Growth:
5
Growth Rate:
55.56%
Total runs:
9
Run Growth:
7
Growth Rate:
77.78%
Total runs:
9
Run Growth:
7
Growth Rate:
77.78%
Total runs:
8
Run Growth:
4
Growth Rate:
50.00%
Total runs:
8
Run Growth:
1
Growth Rate:
12.50%
Total runs:
8
Run Growth:
3
Growth Rate:
37.50%
Total runs:
8
Run Growth:
8
Growth Rate:
100.00%
Total runs:
8
Run Growth:
-1
Growth Rate:
-12.50%
Total runs:
8
Run Growth:
3
Growth Rate:
37.50%
Total runs:
7
Run Growth:
-12
Growth Rate:
-171.43%
Total runs:
7
Run Growth:
5
Growth Rate:
71.43%
Total runs:
7
Run Growth:
3
Growth Rate:
42.86%
Total runs:
7
Run Growth:
7
Growth Rate:
100.00%
Total runs:
7
Run Growth:
7
Growth Rate:
100.00%
Total runs:
7
Run Growth:
5
Growth Rate:
71.43%
Total runs:
7
Run Growth:
4
Growth Rate:
57.14%
Total runs:
7
Run Growth:
-49
Growth Rate:
-700.00%
Total runs:
7
Run Growth:
3
Growth Rate:
42.86%
Total runs:
6
Run Growth:
5
Growth Rate:
83.33%
Total runs:
6
Run Growth:
5
Growth Rate:
83.33%
Total runs:
6
Run Growth:
-4
Growth Rate:
-66.67%
Total runs:
6
Run Growth:
4
Growth Rate:
66.67%
Total runs:
6
Run Growth:
2
Growth Rate:
33.33%
Total runs:
6
Run Growth:
6
Growth Rate:
100.00%
Total runs:
6
Run Growth:
3
Growth Rate:
50.00%