Total runs:
1.7M
Run Growth:
-249.4K
Growth Rate:
-14.40%
Sponsored by
AdsCreator.com
jinaai / falcon-40b-code-alpaca
Model's Last Updated: Julio 20 2023
text-generation
Introduction of falcon-40b-code-alpaca
Model Details of falcon-40b-code-alpaca
LLM Generation models trained by Jina AI, Finetuner team.
This repo contains the full weights (16bit) for Falcon-40b fit on the Code Alpaca dataset.
Reproduction
This version of the weights was trained with the following hyperparameters:
- Epochs: 2
- Batch size: 128
- Micro batch size: 4
- Learning rate: 3e-4
- Lora r : 8
- Lora target modules: query_key_value
You can reproduce using this repository:
https://github.com/jina-ai/jerboa
Make sure you install requirements and finetune using this command using the following command:
python finetune.py \
--base-model tiiuae/falcon-40b --lora-target-modules query_key_value \
--data-path sahil2801/CodeAlpaca-20k --output-dir ./lora-alpaca-code \
--batch-size 128 --micro-batch-size 4 --eval-limit 45 \
--eval-file code_eval.jsonl --wandb-project jerboa --wandb-log-model \
--wandb-watch gradients --num-epochs 2
Inference
import torch
from transformers import AutoTokenizer, AutoModelForCausalLM
TOKENIZER_SOURCE = 'tiiuae/falcon-40b'
BASE_MODEL = 'jinaai/falcon-40b-code-alpaca'
DEVICE = "cuda"
PROMPT = """
Below is an instruction that describes a task, paired with an input that provides further context. Write a response that appropriately completes the request.
### Instruction:
Write a for loop in python
### Input:
### Response:
"""
model = AutoModelForCausalLM.from_pretrained(
pretrained_model_name_or_path=BASE_MODEL,
torch_dtype=torch.float16,
trust_remote_code=True,
device_map='auto',
)
model.eval()
tokenizer = AutoTokenizer.from_pretrained(
TOKENIZER_SOURCE,
trust_remote_code=True,
padding_side='left',
)
tokenizer.pad_token = tokenizer.eos_token
inputs = tokenizer(PROMPT, return_tensors="pt")
input_ids = inputs["input_ids"].to(DEVICE)
input_attention_mask = inputs["attention_mask"].to(DEVICE)
with torch.no_grad():
generation_output = model.generate(
input_ids=input_ids,
attention_mask=input_attention_mask,
return_dict_in_generate=True,
max_new_tokens=32,
eos_token_id=tokenizer.eos_token_id,
)
generation_output = generation_output.sequences[0]
output = tokenizer.decode(generation_output, skip_special_tokens=True)
print(output)
Contact
Join our Discord community and chat with other community members about ideas.
Runs of jinaai falcon-40b-code-alpaca on huggingface.co
35
Total runs
0
24-hour runs
0
3-day runs
0
7-day runs
11
30-day runs
More Information About falcon-40b-code-alpaca huggingface.co Model
Url of falcon-40b-code-alpaca
falcon-40b-code-alpaca huggingface.co Url
Provider of falcon-40b-code-alpaca huggingface.co
Other API from jinaai
Updated:Abril 08 2026
Total runs:
1.3M
Run Growth:
239.4K
Growth Rate:
18.48%
Total runs:
1.2M
Run Growth:
243.3K
Growth Rate:
20.87%
Total runs:
1.1M
Run Growth:
190.1K
Growth Rate:
16.72%
Total runs:
1.0M
Run Growth:
879.3K
Growth Rate:
85.33%
Total runs:
696.1K
Run Growth:
-155.4K
Growth Rate:
-22.61%
Total runs:
388.4K
Run Growth:
5.1K
Growth Rate:
1.31%
Total runs:
357.0K
Run Growth:
-26.0K
Growth Rate:
-7.29%
Total runs:
177.4K
Run Growth:
-61.4K
Growth Rate:
-34.98%
Total runs:
155.6K
Run Growth:
93.0K
Growth Rate:
59.78%
Total runs:
150.7K
Run Growth:
26.6K
Growth Rate:
17.68%
Total runs:
146.8K
Run Growth:
-61.4K
Growth Rate:
-41.83%
Total runs:
118.3K
Run Growth:
-240.0K
Growth Rate:
-202.95%
Total runs:
106.3K
Run Growth:
37.5K
Growth Rate:
35.31%
Total runs:
105.3K
Run Growth:
-24.5K
Growth Rate:
-23.23%
Total runs:
104.3K
Run Growth:
93.0K
Growth Rate:
89.17%
Total runs:
86.8K
Run Growth:
22.7K
Growth Rate:
25.24%
Total runs:
82.1K
Run Growth:
-34.7K
Growth Rate:
-42.30%
Total runs:
57.4K
Run Growth:
-22.2K
Growth Rate:
-38.69%
Total runs:
32.7K
Run Growth:
-1.3K
Growth Rate:
-3.84%
Total runs:
21.0K
Run Growth:
4.7K
Growth Rate:
22.24%
Total runs:
16.9K
Run Growth:
-2.6K
Growth Rate:
-15.32%
Total runs:
15.6K
Run Growth:
-3.0K
Growth Rate:
-19.22%
Total runs:
14.9K
Run Growth:
-29.3K
Growth Rate:
-198.82%
Total runs:
12.2K
Run Growth:
-147
Growth Rate:
-1.20%
Total runs:
12.0K
Run Growth:
-8.7K
Growth Rate:
-72.50%
Total runs:
11.4K
Run Growth:
-14
Growth Rate:
-0.12%
Total runs:
11.0K
Run Growth:
-3.9K
Growth Rate:
-35.57%
Total runs:
8.8K
Run Growth:
6.4K
Growth Rate:
73.57%
Total runs:
8.6K
Run Growth:
-95.4K
Growth Rate:
-1107.65%
Total runs:
7.0K
Run Growth:
1.1K
Growth Rate:
15.02%
Total runs:
6.7K
Run Growth:
2.2K
Growth Rate:
32.37%
Total runs:
6.2K
Run Growth:
-892
Growth Rate:
-14.08%
Total runs:
5.1K
Run Growth:
-195
Growth Rate:
-3.81%
Total runs:
4.6K
Run Growth:
625
Growth Rate:
13.60%
Total runs:
4.0K
Run Growth:
-532
Growth Rate:
-13.35%
Total runs:
3.5K
Run Growth:
1.0K
Growth Rate:
29.58%
Total runs:
3.4K
Run Growth:
3.3K
Growth Rate:
97.56%
Total runs:
2.2K
Run Growth:
1.1K
Growth Rate:
52.22%
Total runs:
2.1K
Run Growth:
-351
Growth Rate:
-16.60%
Total runs:
2.1K
Run Growth:
957
Growth Rate:
45.79%
Total runs:
1.9K
Run Growth:
790
Growth Rate:
40.98%
Total runs:
1.8K
Run Growth:
579
Growth Rate:
32.55%
Total runs:
1.7K
Run Growth:
645
Growth Rate:
38.08%
Total runs:
1.7K
Run Growth:
19
Growth Rate:
1.12%
Total runs:
1.7K
Run Growth:
200
Growth Rate:
12.03%
Total runs:
1.6K
Run Growth:
-51
Growth Rate:
-3.20%
Total runs:
1.5K
Run Growth:
341
Growth Rate:
22.03%
Total runs:
1.4K
Run Growth:
588
Growth Rate:
40.98%
Total runs:
1.4K
Run Growth:
-2.4K
Growth Rate:
-172.42%
Total runs:
1.4K
Run Growth:
149
Growth Rate:
10.73%
Total runs:
1.4K
Run Growth:
1.3K
Growth Rate:
95.04%
Total runs:
1.2K
Run Growth:
1.1K
Growth Rate:
89.96%
Total runs:
1.1K
Run Growth:
-91
Growth Rate:
-8.53%
Total runs:
1.0K
Run Growth:
442
Growth Rate:
42.91%
Total runs:
859
Run Growth:
277
Growth Rate:
32.25%
Total runs:
778
Run Growth:
-92
Growth Rate:
-11.83%
Total runs:
778
Run Growth:
700
Growth Rate:
89.97%
Total runs:
721
Run Growth:
252
Growth Rate:
34.95%
Total runs:
704
Run Growth:
162
Growth Rate:
23.01%
Total runs:
574
Run Growth:
-98
Growth Rate:
-17.07%
Total runs:
551
Run Growth:
-5
Growth Rate:
-0.91%
Total runs:
547
Run Growth:
91
Growth Rate:
16.64%
Total runs:
486
Run Growth:
-112
Growth Rate:
-22.67%
Total runs:
416
Run Growth:
18
Growth Rate:
4.33%
Total runs:
379
Run Growth:
110
Growth Rate:
29.02%
Total runs:
338
Run Growth:
-26
Growth Rate:
-7.69%
Total runs:
320
Run Growth:
12
Growth Rate:
3.69%
Total runs:
315
Run Growth:
153
Growth Rate:
48.57%
Total runs:
246
Run Growth:
246
Growth Rate:
100.00%
Total runs:
227
Run Growth:
-265
Growth Rate:
-116.74%
Total runs:
208
Run Growth:
88
Growth Rate:
42.31%
Total runs:
194
Run Growth:
57
Growth Rate:
29.38%
Total runs:
186
Run Growth:
39
Growth Rate:
20.97%
Total runs:
183
Run Growth:
10
Growth Rate:
5.46%
Total runs:
180
Run Growth:
91
Growth Rate:
50.56%
Total runs:
161
Run Growth:
1
Growth Rate:
0.86%
Total runs:
159
Run Growth:
0
Growth Rate:
0.00%
Total runs:
135
Run Growth:
-59
Growth Rate:
-43.70%
Total runs:
122
Run Growth:
-78
Growth Rate:
-63.41%
Total runs:
102
Run Growth:
-22
Growth Rate:
-21.57%
Total runs:
77
Run Growth:
-61
Growth Rate:
-79.22%
Total runs:
58
Run Growth:
-14
Growth Rate:
-24.14%
Total runs:
54
Run Growth:
29
Growth Rate:
53.70%
Total runs:
53
Run Growth:
-8
Growth Rate:
-15.09%
Total runs:
52
Run Growth:
28
Growth Rate:
53.85%
Total runs:
48
Run Growth:
25
Growth Rate:
52.08%
Total runs:
45
Run Growth:
22
Growth Rate:
48.89%
Total runs:
33
Run Growth:
10
Growth Rate:
30.30%
Total runs:
32
Run Growth:
-22
Growth Rate:
-68.75%