Sponsored by
AdsCreator.com
arcee-ai / teeny-tiny-mixtral
Model's Last Updated: April 24 2024
text-generation
Introduction of teeny-tiny-mixtral
Model Details of teeny-tiny-mixtral
Model Card for Model ID
This model is a dummy model created for testing purposes only. It utilizes a custom configuration to explore various training scenarios and should not be used for production.
Configuration Highlights
The configuration of this dummy model is distinct from the original model in several key aspects:
- Number of Layers: Reduced to 2, allowing for quicker tests of layer-specific behaviors.
- Experts: Configured with 4 local experts and 2 experts per token, experimenting with the model's capacity to handle multiple expert inputs.
- Hidden Size: Set at 512, this smaller size is suitable for testing the impact of network width.
- Intermediate Size: Enlarged to 3579, to investigate how an increase in the size affects the model's ability to process information deeply.
Runs of arcee-ai teeny-tiny-mixtral on huggingface.co
238
Total runs
1
24-hour runs
-11
3-day runs
-43
7-day runs
17
30-day runs
More Information About teeny-tiny-mixtral huggingface.co Model
Url of teeny-tiny-mixtral
teeny-tiny-mixtral huggingface.co Url
Provider of teeny-tiny-mixtral huggingface.co
Other API from arcee-ai
Total runs:
14.3K
Run Growth:
14.2K
Growth Rate:
99.44%
Total runs:
5.6K
Run Growth:
-752
Growth Rate:
-13.47%
Total runs:
3.7K
Run Growth:
-221
Growth Rate:
-5.85%
Total runs:
2.5K
Run Growth:
1.2K
Growth Rate:
48.53%
Total runs:
2.5K
Run Growth:
1.4K
Growth Rate:
56.26%
Total runs:
2.4K
Run Growth:
-567
Growth Rate:
-23.29%
Total runs:
2.1K
Run Growth:
433
Growth Rate:
20.22%
Total runs:
1.9K
Run Growth:
1.0K
Growth Rate:
54.57%
Total runs:
1.8K
Run Growth:
1.5K
Growth Rate:
82.87%
Total runs:
1.7K
Run Growth:
-860
Growth Rate:
-49.60%
Total runs:
1.7K
Run Growth:
1.6K
Growth Rate:
92.28%
Total runs:
1.7K
Run Growth:
-3.2K
Growth Rate:
-191.35%
Total runs:
1.6K
Run Growth:
1.0K
Growth Rate:
61.88%
Total runs:
1.5K
Run Growth:
1.5K
Growth Rate:
98.63%
Total runs:
1.5K
Run Growth:
375
Growth Rate:
25.24%
Total runs:
1.4K
Run Growth:
684
Growth Rate:
50.41%
Total runs:
1.2K
Run Growth:
-106
Growth Rate:
-8.55%
Total runs:
1.2K
Run Growth:
124
Growth Rate:
10.48%
Total runs:
1.1K
Run Growth:
971
Growth Rate:
83.78%
Total runs:
1.1K
Run Growth:
652
Growth Rate:
64.05%
Total runs:
1.0K
Run Growth:
-6
Growth Rate:
-0.58%
Total runs:
1.0K
Run Growth:
-1.8K
Growth Rate:
-174.58%
Total runs:
922
Run Growth:
458
Growth Rate:
47.41%
Total runs:
875
Run Growth:
-112
Growth Rate:
-12.61%
Total runs:
850
Run Growth:
0
Growth Rate:
0.00%
Total runs:
766
Run Growth:
-6.3K
Growth Rate:
-820.89%
Total runs:
664
Run Growth:
422
Growth Rate:
63.55%
Total runs:
614
Run Growth:
-4.4K
Growth Rate:
-715.15%
Total runs:
612
Run Growth:
253
Growth Rate:
49.41%
Total runs:
590
Run Growth:
-6
Growth Rate:
-1.01%
Total runs:
505
Run Growth:
201
Growth Rate:
39.80%
Total runs:
467
Run Growth:
410
Growth Rate:
87.79%
Total runs:
448
Run Growth:
107
Growth Rate:
23.88%
Total runs:
410
Run Growth:
175
Growth Rate:
42.68%
Total runs:
408
Run Growth:
0
Growth Rate:
0.00%
Total runs:
351
Run Growth:
351
Growth Rate:
100.00%
Total runs:
281
Run Growth:
0
Growth Rate:
0.00%
Total runs:
278
Run Growth:
137
Growth Rate:
48.24%
Total runs:
269
Run Growth:
172
Growth Rate:
64.42%
Total runs:
243
Run Growth:
-1.7K
Growth Rate:
-680.25%
Total runs:
215
Run Growth:
46
Growth Rate:
20.00%
Total runs:
183
Run Growth:
75
Growth Rate:
40.98%
Total runs:
158
Run Growth:
-1
Growth Rate:
-0.63%
Total runs:
157
Run Growth:
64
Growth Rate:
41.03%
Total runs:
148
Run Growth:
-99
Growth Rate:
-66.89%
Total runs:
140
Run Growth:
-39
Growth Rate:
-27.86%
Total runs:
137
Run Growth:
7
Growth Rate:
5.11%
Total runs:
137
Run Growth:
18
Growth Rate:
13.33%
Total runs:
136
Run Growth:
54
Growth Rate:
40.30%
Total runs:
130
Run Growth:
-50
Growth Rate:
-38.17%
Total runs:
119
Run Growth:
27
Growth Rate:
22.50%
Total runs:
119
Run Growth:
34
Growth Rate:
29.06%
Total runs:
114
Run Growth:
29
Growth Rate:
25.44%
Total runs:
113
Run Growth:
14
Growth Rate:
12.07%
Total runs:
111
Run Growth:
35
Growth Rate:
32.41%
Total runs:
110
Run Growth:
20
Growth Rate:
18.18%
Total runs:
109
Run Growth:
24
Growth Rate:
22.02%
Total runs:
108
Run Growth:
21
Growth Rate:
19.63%
Total runs:
108
Run Growth:
8
Growth Rate:
7.48%
Total runs:
108
Run Growth:
15
Growth Rate:
13.64%
Total runs:
106
Run Growth:
11
Growth Rate:
10.48%
Total runs:
105
Run Growth:
14
Growth Rate:
13.59%
Total runs:
105
Run Growth:
23
Growth Rate:
21.50%
Total runs:
104
Run Growth:
15
Growth Rate:
14.42%
Total runs:
103
Run Growth:
4
Growth Rate:
3.81%
Total runs:
103
Run Growth:
18
Growth Rate:
17.65%
Total runs:
103
Run Growth:
43
Growth Rate:
35.25%
Total runs:
102
Run Growth:
17
Growth Rate:
17.00%
Total runs:
102
Run Growth:
15
Growth Rate:
14.56%
Total runs:
101
Run Growth:
18
Growth Rate:
18.18%
Total runs:
101
Run Growth:
17
Growth Rate:
17.17%
Total runs:
101
Run Growth:
21
Growth Rate:
21.00%
Total runs:
101
Run Growth:
6
Growth Rate:
6.00%
Total runs:
101
Run Growth:
16
Growth Rate:
15.69%