Total runs:
2.1M
Run Growth:
-364.0K
Growth Rate:
-17.43%
Sponsored by
APIMart
jinaai / falcon-7b-code-alpaca-lora
Model's Last Updated: July 20 2023
text-generation
Introduction of falcon-7b-code-alpaca-lora
Model Details of falcon-7b-code-alpaca-lora
LLM Generation models trained by Jina AI, Finetuner team.
This repo contains the lora weights (8bit) for Falcon-7b fit on the Code Alpaca dataset.
Reproduction
This version of the weights was trained with the following hyperparameters:
- Epochs: 6
- Batch size: 128
- Micro batch size: 8
- Learning rate: 3e-4
- Lora r : 8
- Lora target modules: query_key_value
You can reproduce using this repository:
https://github.com/jina-ai/jerboa
Make sure you install requirements and finetune using this command using the following command:
python finetune.py \
--base-model tiiuae/falcon-7b --lora-target-modules query_key_value \
--data-path sahil2801/CodeAlpaca-20k --output-dir ./lora-alpaca-code \
--batch-size 128 --micro-batch-size 8 --eval-limit 45 \
--eval-file code_eval.jsonl --wandb-project jerboa --wandb-log-model \
--wandb-watch gradients --num-epochs 6
Inference
import torch
from peft import PeftModel
from transformers import AutoTokenizer, AutoModelForCausalLM
TOKENIZER_SOURCE = 'tiiuae/falcon-7b'
BASE_MODEL = 'tiiuae/falcon-7b'
LORA_REPO = 'jinaai/falcon-7b-code-alpaca-lora'
DEVICE = "cuda"
PROMPT = """
Below is an instruction that describes a task, paired with an input that provides further context. Write a response that appropriately completes the request.
### Instruction:
Write a for loop in python
### Input:
### Response:
"""
model = AutoModelForCausalLM.from_pretrained(
pretrained_model_name_or_path=BASE_MODEL,
torch_dtype=torch.float16,
trust_remote_code=True,
device_map='auto',
)
model = PeftModel.from_pretrained(
model=model,
model_id=LORA_REPO,
)
model.eval()
tokenizer = AutoTokenizer.from_pretrained(
TOKENIZER_SOURCE,
trust_remote_code=True,
padding_side='left',
)
tokenizer.pad_token = tokenizer.eos_token
inputs = tokenizer(PROMPT, return_tensors="pt")
input_ids = inputs["input_ids"].to(DEVICE)
input_attention_mask = inputs["attention_mask"].to(DEVICE)
with torch.no_grad():
generation_output = model.generate(
input_ids=input_ids,
attention_mask=input_attention_mask,
return_dict_in_generate=True,
max_new_tokens=32,
eos_token_id=tokenizer.eos_token_id,
)
generation_output = generation_output.sequences[0]
output = tokenizer.decode(generation_output, skip_special_tokens=True)
print(output)
Contact
Join our Discord community and chat with other community members about ideas.
Runs of jinaai falcon-7b-code-alpaca-lora on huggingface.co
0
Total runs
0
24-hour runs
0
3-day runs
0
7-day runs
0
30-day runs
More Information About falcon-7b-code-alpaca-lora huggingface.co Model
Url of falcon-7b-code-alpaca-lora
falcon-7b-code-alpaca-lora huggingface.co Url
Provider of falcon-7b-code-alpaca-lora huggingface.co
Other API from jinaai
Updated:April 08 2026
Total runs:
1.1M
Run Growth:
190.1K
Growth Rate:
16.72%
Total runs:
1.0M
Run Growth:
-182.8K
Growth Rate:
-17.89%
Total runs:
890.0K
Run Growth:
154.2K
Growth Rate:
17.52%
Total runs:
860.3K
Run Growth:
-19.3K
Growth Rate:
-2.25%
Total runs:
553.4K
Run Growth:
516.4K
Growth Rate:
93.31%
Total runs:
388.4K
Run Growth:
5.1K
Growth Rate:
1.31%
Total runs:
359.3K
Run Growth:
100.6K
Growth Rate:
27.94%
Total runs:
317.9K
Run Growth:
106.7K
Growth Rate:
33.57%
Total runs:
150.9K
Run Growth:
16.8K
Growth Rate:
11.11%
Total runs:
142.3K
Run Growth:
-260.4K
Growth Rate:
-186.71%
Total runs:
136.6K
Run Growth:
-286.8K
Growth Rate:
-210.00%
Total runs:
116.8K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
106.3K
Run Growth:
37.5K
Growth Rate:
35.31%
Total runs:
105.3K
Run Growth:
-24.5K
Growth Rate:
-23.23%
Total runs:
104.3K
Run Growth:
93.0K
Growth Rate:
89.17%
Total runs:
99.7K
Run Growth:
60.1K
Growth Rate:
61.72%
Total runs:
99.7K
Run Growth:
91.9K
Growth Rate:
92.18%
Total runs:
77.7K
Run Growth:
-17.7K
Growth Rate:
-22.82%
Total runs:
72.8K
Run Growth:
-151.6K
Growth Rate:
-208.22%
Total runs:
41.2K
Run Growth:
28.2K
Growth Rate:
64.11%
Total runs:
32.7K
Run Growth:
-1.3K
Growth Rate:
-3.84%
Total runs:
21.0K
Run Growth:
4.7K
Growth Rate:
22.24%
Total runs:
16.9K
Run Growth:
-2.6K
Growth Rate:
-15.32%
Total runs:
15.6K
Run Growth:
-3.0K
Growth Rate:
-19.22%
Total runs:
12.2K
Run Growth:
-147
Growth Rate:
-1.20%
Total runs:
12.0K
Run Growth:
-8.7K
Growth Rate:
-72.50%
Total runs:
11.4K
Run Growth:
-14
Growth Rate:
-0.12%
Total runs:
11.0K
Run Growth:
-3.9K
Growth Rate:
-35.57%
Total runs:
9.3K
Run Growth:
-44.8K
Growth Rate:
-479.86%
Total runs:
7.7K
Run Growth:
-339
Growth Rate:
-4.34%
Total runs:
7.0K
Run Growth:
1.1K
Growth Rate:
15.02%
Total runs:
4.5K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
4.0K
Run Growth:
-532
Growth Rate:
-13.35%
Total runs:
3.8K
Run Growth:
-220
Growth Rate:
-5.87%
Total runs:
3.4K
Run Growth:
3.3K
Growth Rate:
97.56%
Total runs:
3.1K
Run Growth:
1.6K
Growth Rate:
50.10%
Total runs:
2.9K
Run Growth:
1.5K
Growth Rate:
52.30%
Total runs:
2.6K
Run Growth:
399
Growth Rate:
15.50%
Total runs:
2.2K
Run Growth:
1.1K
Growth Rate:
52.22%
Total runs:
2.1K
Run Growth:
957
Growth Rate:
45.79%
Total runs:
1.9K
Run Growth:
790
Growth Rate:
40.98%
Total runs:
1.8K
Run Growth:
579
Growth Rate:
32.55%
Total runs:
1.7K
Run Growth:
645
Growth Rate:
38.08%
Total runs:
1.7K
Run Growth:
19
Growth Rate:
1.12%
Total runs:
1.6K
Run Growth:
-51
Growth Rate:
-3.20%
Total runs:
1.5K
Run Growth:
341
Growth Rate:
22.03%
Total runs:
1.5K
Run Growth:
9
Growth Rate:
0.60%
Total runs:
1.4K
Run Growth:
588
Growth Rate:
40.98%
Total runs:
1.4K
Run Growth:
-2.4K
Growth Rate:
-172.42%
Total runs:
1.4K
Run Growth:
149
Growth Rate:
10.73%
Total runs:
1.4K
Run Growth:
1.3K
Growth Rate:
95.04%
Total runs:
1.2K
Run Growth:
1.1K
Growth Rate:
89.96%
Total runs:
1.1K
Run Growth:
-91
Growth Rate:
-8.53%
Total runs:
921
Run Growth:
696
Growth Rate:
75.57%
Total runs:
859
Run Growth:
277
Growth Rate:
32.25%
Total runs:
778
Run Growth:
700
Growth Rate:
89.97%
Total runs:
745
Run Growth:
358
Growth Rate:
48.05%
Total runs:
721
Run Growth:
252
Growth Rate:
34.95%
Total runs:
697
Run Growth:
544
Growth Rate:
78.05%
Total runs:
637
Run Growth:
14
Growth Rate:
2.25%
Total runs:
574
Run Growth:
-98
Growth Rate:
-17.07%
Total runs:
562
Run Growth:
281
Growth Rate:
50.00%
Total runs:
551
Run Growth:
-5
Growth Rate:
-0.91%
Total runs:
533
Run Growth:
265
Growth Rate:
49.72%
Total runs:
503
Run Growth:
224
Growth Rate:
44.53%
Total runs:
379
Run Growth:
110
Growth Rate:
29.02%
Total runs:
338
Run Growth:
-26
Growth Rate:
-7.69%
Total runs:
315
Run Growth:
153
Growth Rate:
48.57%
Total runs:
296
Run Growth:
-156
Growth Rate:
-54.17%
Total runs:
246
Run Growth:
246
Growth Rate:
100.00%
Total runs:
208
Run Growth:
88
Growth Rate:
42.31%
Total runs:
204
Run Growth:
6
Growth Rate:
2.94%
Total runs:
194
Run Growth:
57
Growth Rate:
29.38%
Total runs:
186
Run Growth:
39
Growth Rate:
20.97%
Total runs:
183
Run Growth:
10
Growth Rate:
5.46%
Total runs:
180
Run Growth:
91
Growth Rate:
50.56%
Total runs:
159
Run Growth:
0
Growth Rate:
0.00%
Total runs:
152
Run Growth:
93
Growth Rate:
61.18%
Total runs:
151
Run Growth:
-89
Growth Rate:
-58.94%
Total runs:
114
Run Growth:
10
Growth Rate:
9.35%
Total runs:
102
Run Growth:
-22
Growth Rate:
-21.57%
Total runs:
94
Run Growth:
76
Growth Rate:
80.85%
Total runs:
68
Run Growth:
30
Growth Rate:
44.12%
Total runs:
54
Run Growth:
29
Growth Rate:
53.70%
Total runs:
54
Run Growth:
16
Growth Rate:
29.63%
Total runs:
52
Run Growth:
28
Growth Rate:
53.85%
Total runs:
45
Run Growth:
22
Growth Rate:
48.89%
Total runs:
27
Run Growth:
9
Growth Rate:
33.33%
Total runs:
27
Run Growth:
3
Growth Rate:
11.11%