Total runs:
337.7K
Run Growth:
135.1K
Growth Rate:
40.03%
Sponsored by
Agentkit
mrm8488 / mamba-coder
Model's Last Updated: January 24 2024
text-generation
Introduction of mamba-coder
Model Details of mamba-coder
Mamba-Coder
MAMBA (2.8B) 🐍 fine-tuned on CodeAlpaca_20k for code generation
Base model info
Mamba is a new state space model architecture showing promising performance on information-dense data such as language modeling, where previous subquadratic models fall short of Transformers. It is based on the line of progress on structured state space models , with an efficient hardware-aware design and implementation in the spirit of FlashAttention .
Dataset info
CodeAlpaca_20K : contains 20K instruction-following data used for fine-tuning the Code Alpaca model.
Usage
pip install torch==2.1.0 transformers==4.35.0 causal-conv1d==1.0.0 mamba-ssm==1.0.1
import torch
from transformers import AutoTokenizer, AutoModelForCausalLM
from mamba_ssm.models.mixer_seq_simple import MambaLMHeadModel
CHAT_TEMPLATE_ID = "HuggingFaceH4/zephyr-7b-beta"
device = "cuda:0" if torch.cuda.is_available() else "cpu"
model_name = "mrm8488/mamba-coder"
eos_token = "<|endoftext|>"
tokenizer = AutoTokenizer.from_pretrained(model_name)
tokenizer.eos_token = eos_token
tokenizer.pad_token = tokenizer.eos_token
tokenizer.chat_template = AutoTokenizer.from_pretrained(CHAT_TEMPLATE_ID).chat_template
model = MambaLMHeadModel.from_pretrained(
model_name, device=device, dtype=torch.float16)
messages = []
prompt = "Write a bash script to remove .tmp files"
messages.append(dict(role="user", content=prompt))
input_ids = tokenizer.apply_chat_template(
messages, return_tensors="pt", add_generation_prompt=True
).to(device)
out = model.generate(
input_ids=input_ids,
max_length=2000,
temperature=0.9,
top_p=0.7,
eos_token_id=tokenizer.eos_token_id,
)
decoded = tokenizer.batch_decode(out)
assistant_message = (
decoded[0].split("<|assistant|>\n")[-1].replace(eos_token, "")
)
print(assistant_message)
Gradio Demo
git clone https://github.com/mrm8488/mamba-chat.git
cd mamba-chat
pip install -r requirements.txt
pip install -q gradio==4.8.0
python app.py \
--model mrm8488/mamba-coder \
--share
Evaluations
Coming soon!
Citation
@misc {manuel_romero_2024,
author = { {Manuel Romero} },
title = { mamba-coder (Revision 214a13a) },
year = 2024,
url = { https://huggingface.co/mrm8488/mamba-coder },
doi = { 10.57967/hf/1673 },
publisher = { Hugging Face }
}
Acknowledgments
Thanks to mamba-chat for heavily inspiring our work
Runs of mrm8488 mamba-coder on huggingface.co
72
Total runs
0
24-hour runs
10
3-day runs
32
7-day runs
32
30-day runs
More Information About mamba-coder huggingface.co Model
Url of mamba-coder
mamba-coder huggingface.co Url
Provider of mamba-coder huggingface.co
Other API from mrm8488
Updated:January 21 2024
Total runs:
31.7K
Run Growth:
-1.5K
Growth Rate:
-4.84%
Total runs:
16.6K
Run Growth:
-45.7K
Growth Rate:
-277.60%
Total runs:
12.9K
Run Growth:
456
Growth Rate:
3.54%
Total runs:
9.6K
Run Growth:
371
Growth Rate:
3.85%
Total runs:
9.5K
Run Growth:
4.9K
Growth Rate:
50.91%
Total runs:
8.7K
Run Growth:
5.7K
Growth Rate:
65.22%
Total runs:
7.8K
Run Growth:
5.1K
Growth Rate:
64.60%
Total runs:
5.9K
Run Growth:
5
Growth Rate:
0.08%
Total runs:
4.6K
Run Growth:
-30.3K
Growth Rate:
-660.88%
Total runs:
3.7K
Run Growth:
2.8K
Growth Rate:
74.17%
Total runs:
3.0K
Run Growth:
2.7K
Growth Rate:
90.01%
Total runs:
2.3K
Run Growth:
-3.1K
Growth Rate:
-128.85%
Total runs:
1.9K
Run Growth:
1.4K
Growth Rate:
73.80%
Total runs:
1.3K
Run Growth:
-73
Growth Rate:
-5.42%
Total runs:
1.0K
Run Growth:
376
Growth Rate:
36.43%
Total runs:
994
Run Growth:
-1.1K
Growth Rate:
-117.55%
Total runs:
968
Run Growth:
417
Growth Rate:
43.12%
Total runs:
952
Run Growth:
-2.0K
Growth Rate:
-192.42%
Total runs:
805
Run Growth:
-102
Growth Rate:
-12.55%
Total runs:
727
Run Growth:
-345
Growth Rate:
-47.46%
Total runs:
682
Run Growth:
335
Growth Rate:
49.12%
Total runs:
675
Run Growth:
-223
Growth Rate:
-31.23%
Total runs:
588
Run Growth:
68
Growth Rate:
11.97%
Total runs:
508
Run Growth:
51
Growth Rate:
10.18%
Total runs:
489
Run Growth:
425
Growth Rate:
87.99%
Total runs:
464
Run Growth:
366
Growth Rate:
78.88%
Total runs:
402
Run Growth:
-396
Growth Rate:
-88.20%
Total runs:
366
Run Growth:
57
Growth Rate:
15.57%
Total runs:
358
Run Growth:
68
Growth Rate:
17.94%
Total runs:
352
Run Growth:
165
Growth Rate:
46.88%
Total runs:
326
Run Growth:
88
Growth Rate:
26.99%
Total runs:
307
Run Growth:
-237
Growth Rate:
-75.48%
Total runs:
300
Run Growth:
-48
Growth Rate:
-16.00%
Total runs:
269
Run Growth:
24
Growth Rate:
8.92%
Total runs:
264
Run Growth:
172
Growth Rate:
65.15%
Total runs:
260
Run Growth:
255
Growth Rate:
98.08%
Total runs:
250
Run Growth:
-122
Growth Rate:
-48.80%
Total runs:
242
Run Growth:
-17
Growth Rate:
-7.02%
Total runs:
227
Run Growth:
-197
Growth Rate:
-86.78%
Total runs:
196
Run Growth:
72
Growth Rate:
36.55%
Total runs:
182
Run Growth:
42
Growth Rate:
23.33%
Total runs:
165
Run Growth:
102
Growth Rate:
62.58%
Total runs:
164
Run Growth:
132
Growth Rate:
80.49%
Total runs:
164
Run Growth:
-79
Growth Rate:
-48.17%
Total runs:
161
Run Growth:
-89
Growth Rate:
-55.28%
Total runs:
154
Run Growth:
120
Growth Rate:
77.92%
Total runs:
153
Run Growth:
83
Growth Rate:
54.61%
Total runs:
131
Run Growth:
109
Growth Rate:
83.21%
Total runs:
130
Run Growth:
-100
Growth Rate:
-76.92%
Total runs:
123
Run Growth:
115
Growth Rate:
95.83%
Total runs:
119
Run Growth:
37
Growth Rate:
31.09%
Total runs:
116
Run Growth:
38
Growth Rate:
32.76%
Total runs:
114
Run Growth:
46
Growth Rate:
40.35%
Total runs:
110
Run Growth:
97
Growth Rate:
86.61%
Total runs:
103
Run Growth:
-2
Growth Rate:
-1.94%
Total runs:
96
Run Growth:
91
Growth Rate:
95.79%
Total runs:
94
Run Growth:
-5
Growth Rate:
-5.32%
Total runs:
92
Run Growth:
68
Growth Rate:
73.91%
Total runs:
91
Run Growth:
-8
Growth Rate:
-8.79%
Total runs:
90
Run Growth:
65
Growth Rate:
73.03%
Total runs:
87
Run Growth:
79
Growth Rate:
90.80%
Total runs:
85
Run Growth:
6
Growth Rate:
6.90%
Total runs:
84
Run Growth:
-12
Growth Rate:
-14.29%
Total runs:
82
Run Growth:
-40
Growth Rate:
-48.78%
Total runs:
82
Run Growth:
57
Growth Rate:
69.51%
Total runs:
81
Run Growth:
73
Growth Rate:
90.12%
Total runs:
81
Run Growth:
10
Growth Rate:
11.90%
Total runs:
81
Run Growth:
56
Growth Rate:
70.89%
Total runs:
80
Run Growth:
76
Growth Rate:
95.00%
Total runs:
78
Run Growth:
53
Growth Rate:
67.95%
Total runs:
77
Run Growth:
1
Growth Rate:
1.39%
Total runs:
77
Run Growth:
-109
Growth Rate:
-125.29%
Total runs:
76
Run Growth:
47
Growth Rate:
61.84%
Total runs:
73
Run Growth:
31
Growth Rate:
42.47%
Total runs:
72
Run Growth:
9
Growth Rate:
23.08%
Total runs:
66
Run Growth:
3
Growth Rate:
4.55%
Total runs:
65
Run Growth:
22
Growth Rate:
33.85%
Total runs:
63
Run Growth:
38
Growth Rate:
64.41%
Total runs:
60
Run Growth:
43
Growth Rate:
71.67%
Total runs:
60
Run Growth:
-102
Growth Rate:
-170.00%
Total runs:
58
Run Growth:
54
Growth Rate:
93.10%
Total runs:
55
Run Growth:
47
Growth Rate:
85.45%
Total runs:
55
Run Growth:
49
Growth Rate:
92.45%
Total runs:
53
Run Growth:
43
Growth Rate:
82.69%
Total runs:
53
Run Growth:
42
Growth Rate:
79.25%
Total runs:
52
Run Growth:
16
Growth Rate:
30.77%
Total runs:
51
Run Growth:
25
Growth Rate:
49.02%
Total runs:
50
Run Growth:
41
Growth Rate:
83.67%
Total runs:
48
Run Growth:
-2
Growth Rate:
-4.17%
Total runs:
48
Run Growth:
34
Growth Rate:
70.83%
Total runs:
47
Run Growth:
47
Growth Rate:
100.00%
Total runs:
46
Run Growth:
17
Growth Rate:
34.00%