Total runs:
1.5M
Run Growth:
-1.0M
Growth Rate:
-71.17%
Sponsored by
Agentkit
TinyLlama / tinyLlama-intermediate-checkpoints-after-1T-token
Model's Last Updated: December 28 2023
text-generation
Introduction of tinyLlama-intermediate-checkpoints-after-1T-token
Model Details of tinyLlama-intermediate-checkpoints-after-1T-token
https://github.com/jzhang38/TinyLlama
The TinyLlama project aims to pretrain a 1.1B Llama model on 3 trillion tokens . With some proper optimization, we can achieve this within a span of "just" 90 days using 16 A100-40G GPUs 🚀🚀. The training has started on 2023-09-01.
We adopted exactly the same architecture and tokenizer as Llama 2. This means TinyLlama can be plugged and played in many open-source projects built upon Llama. Besides, TinyLlama is compact with only 1.1B parameters. This compactness allows it to cater to a multitude of applications demanding a restricted computation and memory footprint.
This Collection
This collection contains all checkpoints after the 1T fix. Branch name indicates the step and number of tokens seen.
Runs of TinyLlama tinyLlama-intermediate-checkpoints-after-1T-token on huggingface.co
2.6K
Total runs
0
24-hour runs
34
3-day runs
1.1K
7-day runs
2.6K
30-day runs
More Information About tinyLlama-intermediate-checkpoints-after-1T-token huggingface.co Model
Url of tinyLlama-intermediate-checkpoints-after-1T-token
tinyLlama-intermediate-checkpoints-after-1T-token huggingface.co Url
Provider of tinyLlama-intermediate-checkpoints-after-1T-token huggingface.co
Other API from TinyLlama
Updated:March 17 2024
Total runs:
87.0K
Run Growth:
-23.8K
Growth Rate:
-27.30%
Total runs:
29.3K
Run Growth:
-7.2K
Growth Rate:
-24.54%
Total runs:
10.0K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
8.1K
Run Growth:
1.1K
Growth Rate:
13.69%
Total runs:
4.2K
Run Growth:
-305
Growth Rate:
-7.35%
Total runs:
2.8K
Run Growth:
534
Growth Rate:
18.91%
Total runs:
2.5K
Run Growth:
1.0K
Growth Rate:
41.40%
Total runs:
2.3K
Run Growth:
1.4K
Growth Rate:
62.39%
Total runs:
2.0K
Run Growth:
290
Growth Rate:
14.26%
Total runs:
1.9K
Run Growth:
435
Growth Rate:
23.24%
Total runs:
1.7K
Run Growth:
840
Growth Rate:
49.67%
Total runs:
1.5K
Run Growth:
395
Growth Rate:
26.07%
Total runs:
792
Run Growth:
406
Growth Rate:
51.26%
Total runs:
564
Run Growth:
-139
Growth Rate:
-24.65%
Total runs:
396
Run Growth:
-67
Growth Rate:
-16.92%
Total runs:
360
Run Growth:
-84
Growth Rate:
-23.27%
Total runs:
265
Run Growth:
-31
Growth Rate:
-11.70%
Total runs:
146
Run Growth:
15
Growth Rate:
10.27%
Total runs:
117
Run Growth:
-1
Growth Rate:
-0.85%
Total runs:
19
Run Growth:
-10
Growth Rate:
-52.63%
Total runs:
10
Run Growth:
1
Growth Rate:
10.00%
Total runs:
5
Run Growth:
1
Growth Rate:
20.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%