Total runs:
315
Run Growth:
-5
Growth Rate:
-1.59%
Sponsored by
Designkit Free Background Remover
Pinkstack / Luau-coder-v2-3B-base-32k
Model's Last Updated: July 30 2025
text-generation
Introduction of Luau-coder-v2-3B-base-32k
Model Details of Luau-coder-v2-3B-base-32k
print("Before we start")
We are not related to Roblox in any way, any mention of Roblox is purely to help people understand what the model is about. As per the Roblox website , they use Meta's Llama 3 (we assume 70B) for their AI assistant. This model, while powerful, cannot come close to the performance of a 70B model.
print("Stages of pre-training")
This model was continually pre-trained in 3 stages. (Note, allenai states that olmo 2 1B, which is the model this is based on was pre-trained on 4 trillion or so tokens.)
-
Stage 1: Pre-training on the Pinkstack/roblox-luau-corpus-text & Roblox/luau_corpus on 4096 context (the maximum olmo 2 can usually reach)
-
Stage 2: Pre-training on the boatbomber/roblox-info-dump with rope scaling set to 4, so stage 2 was for expanding the context of the model to 16384 .
!stage 3 and onwards were with added layers. the model started with 16 layers, then we merged another 20 to make the model bigger and deeper!
- Stage 3: Training on a mix of Pinkstack/roblox-luau-corpus-text & Roblox/luau_corpus + wikimedia/wikipedia with rope scaling set to 8, aka 32768 tokens of context. We mixed the wikimedia/wikipedia to hopefully improve the general text and knowledge of the model.
In total, the model was continually pre-trained on up to 1.3B tokens, final loss of 1.916400 .
print("Use cases")
As this is a base model, there isn't much to do with it currently. But, you can fine-tune it on your own datasets to turn it into an instruct - chat type model.
print("Notice")
This stage-3 base model did not undergo saftey alignment by us, thus it can generate unethical content. Any outputs generated by the LLM are your responsibility.
print("Additional information")
This repo contains the stage 3 pre-trained/base model.
unsloth was used for training ( https://unsloth.ai/ )
Runs of Pinkstack Luau-coder-v2-3B-base-32k on huggingface.co
30
Total runs
0
24-hour runs
0
3-day runs
0
7-day runs
17
30-day runs
More Information About Luau-coder-v2-3B-base-32k huggingface.co Model
Url of Luau-coder-v2-3B-base-32k
Luau-coder-v2-3B-base-32k huggingface.co Url
Provider of Luau-coder-v2-3B-base-32k huggingface.co
Other API from Pinkstack
Updated:July 24 2026
Total runs:
265
Run Growth:
0
Growth Rate:
0.00%
Total runs:
233
Run Growth:
-26
Growth Rate:
-11.16%
Total runs:
219
Run Growth:
219
Growth Rate:
100.00%
Total runs:
212
Run Growth:
0
Growth Rate:
0.00%
Total runs:
178
Run Growth:
0
Growth Rate:
0.00%
Total runs:
157
Run Growth:
0
Growth Rate:
0.00%
Total runs:
153
Run Growth:
0
Growth Rate:
0.00%
Total runs:
136
Run Growth:
23
Growth Rate:
16.20%
Total runs:
113
Run Growth:
0
Growth Rate:
0.00%
Total runs:
103
Run Growth:
32
Growth Rate:
31.07%
Total runs:
100
Run Growth:
57
Growth Rate:
57.00%
Total runs:
84
Run Growth:
0
Growth Rate:
0.00%
Total runs:
78
Run Growth:
0
Growth Rate:
0.00%
Total runs:
67
Run Growth:
18
Growth Rate:
31.58%
Total runs:
67
Run Growth:
-25
Growth Rate:
-37.31%
Total runs:
64
Run Growth:
0
Growth Rate:
0.00%
Total runs:
62
Run Growth:
15
Growth Rate:
24.19%
Total runs:
54
Run Growth:
-41
Growth Rate:
-74.55%
Total runs:
45
Run Growth:
0
Growth Rate:
0.00%
Total runs:
39
Run Growth:
0
Growth Rate:
0.00%
Total runs:
39
Run Growth:
7
Growth Rate:
17.95%
Total runs:
33
Run Growth:
0
Growth Rate:
0.00%
Total runs:
32
Run Growth:
0
Growth Rate:
0.00%
Total runs:
31
Run Growth:
0
Growth Rate:
0.00%
Total runs:
30
Run Growth:
14
Growth Rate:
46.67%
Total runs:
29
Run Growth:
13
Growth Rate:
46.43%
Total runs:
28
Run Growth:
-22
Growth Rate:
-78.57%
Total runs:
27
Run Growth:
17
Growth Rate:
62.96%
Total runs:
23
Run Growth:
-4
Growth Rate:
-17.39%
Total runs:
23
Run Growth:
-5
Growth Rate:
-21.74%
Total runs:
22
Run Growth:
3
Growth Rate:
13.64%
Total runs:
18
Run Growth:
-73
Growth Rate:
-405.56%
Total runs:
17
Run Growth:
-4
Growth Rate:
-23.53%
Total runs:
17
Run Growth:
6
Growth Rate:
35.29%
Total runs:
12
Run Growth:
0
Growth Rate:
0.00%
Total runs:
12
Run Growth:
2
Growth Rate:
16.67%
Total runs:
12
Run Growth:
0
Growth Rate:
0.00%
Total runs:
9
Run Growth:
-9
Growth Rate:
-100.00%
Total runs:
9
Run Growth:
0
Growth Rate:
0.00%
Total runs:
8
Run Growth:
-3
Growth Rate:
-37.50%
Total runs:
8
Run Growth:
4
Growth Rate:
50.00%
Total runs:
7
Run Growth:
-4
Growth Rate:
-57.14%
Total runs:
7
Run Growth:
0
Growth Rate:
0.00%
Total runs:
7
Run Growth:
1
Growth Rate:
14.29%
Total runs:
6
Run Growth:
-6
Growth Rate:
-100.00%
Total runs:
5
Run Growth:
3
Growth Rate:
60.00%
Total runs:
3
Run Growth:
-1
Growth Rate:
-33.33%
Total runs:
2
Run Growth:
0
Growth Rate:
0.00%
Total runs:
2
Run Growth:
-2
Growth Rate:
-100.00%
Total runs:
1
Run Growth:
1
Growth Rate:
100.00%
Total runs:
1
Run Growth:
1
Growth Rate:
100.00%
Total runs:
1
Run Growth:
1
Growth Rate:
100.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%