Total runs:
471
Run Growth:
440
Growth Rate:
93.42%
Sponsored by
APIMart
blockblockblock / Mistral-7B-Instruct-v0.2-sliced-24-layer-bpw4.2
Model's Last Updated: April 12 2024
text-generation
Introduction of Mistral-7B-Instruct-v0.2-sliced-24-layer-bpw4.2
Model Details of Mistral-7B-Instruct-v0.2-sliced-24-layer-bpw4.2
Quick Summary
This model is an adaptation of the
mistralai/Mistral-7B-Instruct-v0.2
, refined through the application of layer pruning techniques as detailed in the paper "The Unreasonable Ineffectiveness of the Deeper Layers." It incorporates methodologies from the
MergeKit
and
PruneMe
repositories to optimize its structure, focusing on reducing redundancy within the model's deeper layers without compromising its ability to generate coherent text. The model is maintained by Arcee-ai and represents a practical implementation of computational efficiency improvements in Large Language Models (LLMs), aiming to balance performance with resource usage effectively.
Model Description
This model represents a specialized iteration of the
mistralai/Mistral-7B-Instruct-v0.2
, optimized for efficiency and performance through selective layer pruning. Developed by Arcee-ai, it leverages insights from the "The Unreasonable Ineffectiveness of the Deeper Layers" research. The pruning process was informed by the
MergeKit
and
PruneMe
tools, focusing on eliminating redundant layers to ensure a leaner, more efficient model capable of generating high-quality text outputs.
Model Sources
- Pruning: PruneMe GitHub (unofficial)
- Paper: "The Unreasonable Ineffectiveness of the Deeper Layers"
- Merging Repository: MergeKit GitHub
Uses
This pruned model is designed for a range of NLP tasks, with a focus on maintaining or even enhancing the model's original capabilities in generating coherent text, despite the reduction in its size. It stands as a testament to the feasibility of layer pruning in preserving the essential functional attributes of a model while offering a template for computational resource optimization.
Downstream Use
The pruned model serves as a robust foundation for fine-tuning on specific tasks and is an ideal candidate for exploring continuous pre-training opportunities. Its development is a direct application of principles outlined in "The Unreasonable Ineffectiveness of the Deeper Layers," utilizing the
MergeKit
and
PruneMe
repositories for practical pruning implementation. This model is a step forward in efficient model design, demonstrating the potential for significant reductions in computational resource requirements without detrimental effects on performance.
Runs of blockblockblock Mistral-7B-Instruct-v0.2-sliced-24-layer-bpw4.2 on huggingface.co
19
Total runs
0
24-hour runs
1
3-day runs
7
7-day runs
12
30-day runs
More Information About Mistral-7B-Instruct-v0.2-sliced-24-layer-bpw4.2 huggingface.co Model
Url of Mistral-7B-Instruct-v0.2-sliced-24-layer-bpw4.2
Mistral-7B-Instruct-v0.2-sliced-24-layer-bpw4.2 huggingface.co Url
Provider of Mistral-7B-Instruct-v0.2-sliced-24-layer-bpw4.2 huggingface.co
Other API from blockblockblock
Updated:July 04 2026
Total runs:
382
Run Growth:
382
Growth Rate:
100.00%
Total runs:
340
Run Growth:
31
Growth Rate:
9.12%
Total runs:
253
Run Growth:
112
Growth Rate:
44.27%
Total runs:
202
Run Growth:
36
Growth Rate:
17.82%
Total runs:
189
Run Growth:
43
Growth Rate:
22.40%
Total runs:
179
Run Growth:
179
Growth Rate:
100.00%
Total runs:
157
Run Growth:
48
Growth Rate:
30.57%
Total runs:
135
Run Growth:
-19
Growth Rate:
-13.97%
Total runs:
95
Run Growth:
51
Growth Rate:
53.68%
Total runs:
68
Run Growth:
-72
Growth Rate:
-98.63%
Total runs:
65
Run Growth:
39
Growth Rate:
60.00%
Total runs:
64
Run Growth:
-89
Growth Rate:
-136.92%
Total runs:
63
Run Growth:
38
Growth Rate:
60.32%
Total runs:
61
Run Growth:
55
Growth Rate:
90.16%
Total runs:
61
Run Growth:
48
Growth Rate:
78.69%
Total runs:
61
Run Growth:
-88
Growth Rate:
-144.26%
Total runs:
58
Run Growth:
42
Growth Rate:
72.41%
Total runs:
55
Run Growth:
-94
Growth Rate:
-170.91%
Total runs:
50
Run Growth:
41
Growth Rate:
82.00%
Total runs:
50
Run Growth:
-100
Growth Rate:
-200.00%
Total runs:
48
Run Growth:
34
Growth Rate:
70.83%
Total runs:
47
Run Growth:
32
Growth Rate:
68.09%
Total runs:
44
Run Growth:
-104
Growth Rate:
-221.28%
Total runs:
41
Run Growth:
10
Growth Rate:
24.39%
Total runs:
38
Run Growth:
-72
Growth Rate:
-167.44%
Total runs:
36
Run Growth:
20
Growth Rate:
55.56%
Total runs:
35
Run Growth:
17
Growth Rate:
48.57%
Total runs:
35
Run Growth:
27
Growth Rate:
77.14%
Total runs:
33
Run Growth:
33
Growth Rate:
100.00%
Total runs:
33
Run Growth:
21
Growth Rate:
63.64%
Total runs:
33
Run Growth:
24
Growth Rate:
72.73%
Total runs:
33
Run Growth:
24
Growth Rate:
72.73%
Total runs:
33
Run Growth:
23
Growth Rate:
69.70%
Total runs:
32
Run Growth:
16
Growth Rate:
50.00%
Total runs:
28
Run Growth:
21
Growth Rate:
75.00%
Total runs:
24
Run Growth:
15
Growth Rate:
60.00%
Total runs:
23
Run Growth:
19
Growth Rate:
86.36%
Total runs:
22
Run Growth:
13
Growth Rate:
59.09%
Total runs:
22
Run Growth:
15
Growth Rate:
68.18%
Total runs:
22
Run Growth:
15
Growth Rate:
68.18%
Total runs:
22
Run Growth:
16
Growth Rate:
72.73%
Total runs:
21
Run Growth:
9
Growth Rate:
42.86%
Total runs:
21
Run Growth:
13
Growth Rate:
61.90%
Total runs:
21
Run Growth:
16
Growth Rate:
76.19%
Total runs:
21
Run Growth:
15
Growth Rate:
71.43%
Total runs:
20
Run Growth:
15
Growth Rate:
78.95%
Total runs:
20
Run Growth:
11
Growth Rate:
55.00%
Total runs:
20
Run Growth:
13
Growth Rate:
65.00%
Total runs:
20
Run Growth:
14
Growth Rate:
70.00%
Total runs:
20
Run Growth:
17
Growth Rate:
85.00%
Total runs:
20
Run Growth:
13
Growth Rate:
65.00%
Total runs:
20
Run Growth:
11
Growth Rate:
57.89%
Total runs:
20
Run Growth:
14
Growth Rate:
70.00%
Total runs:
20
Run Growth:
16
Growth Rate:
80.00%
Total runs:
20
Run Growth:
12
Growth Rate:
60.00%
Total runs:
20
Run Growth:
15
Growth Rate:
78.95%
Total runs:
20
Run Growth:
14
Growth Rate:
70.00%
Total runs:
20
Run Growth:
13
Growth Rate:
65.00%
Total runs:
19
Run Growth:
11
Growth Rate:
57.89%
Total runs:
19
Run Growth:
15
Growth Rate:
78.95%
Total runs:
19
Run Growth:
10
Growth Rate:
52.63%
Total runs:
19
Run Growth:
13
Growth Rate:
68.42%
Total runs:
19
Run Growth:
13
Growth Rate:
72.22%
Total runs:
19
Run Growth:
13
Growth Rate:
65.00%
Total runs:
19
Run Growth:
14
Growth Rate:
73.68%
Total runs:
19
Run Growth:
13
Growth Rate:
68.42%
Total runs:
19
Run Growth:
11
Growth Rate:
57.89%
Total runs:
19
Run Growth:
11
Growth Rate:
57.89%
Total runs:
19
Run Growth:
9
Growth Rate:
47.37%
Total runs:
19
Run Growth:
15
Growth Rate:
78.95%
Total runs:
18
Run Growth:
14
Growth Rate:
77.78%
Total runs:
18
Run Growth:
9
Growth Rate:
52.94%
Total runs:
18
Run Growth:
10
Growth Rate:
55.56%
Total runs:
18
Run Growth:
13
Growth Rate:
72.22%
Total runs:
18
Run Growth:
12
Growth Rate:
75.00%
Total runs:
18
Run Growth:
13
Growth Rate:
72.22%
Total runs:
18
Run Growth:
13
Growth Rate:
72.22%
Total runs:
18
Run Growth:
12
Growth Rate:
66.67%
Total runs:
18
Run Growth:
10
Growth Rate:
55.56%
Total runs:
18
Run Growth:
12
Growth Rate:
66.67%
Total runs:
18
Run Growth:
9
Growth Rate:
50.00%
Total runs:
18
Run Growth:
11
Growth Rate:
61.11%
Total runs:
18
Run Growth:
13
Growth Rate:
72.22%
Total runs:
18
Run Growth:
12
Growth Rate:
66.67%
Total runs:
18
Run Growth:
6
Growth Rate:
31.58%
Total runs:
18
Run Growth:
12
Growth Rate:
66.67%
Total runs:
18
Run Growth:
11
Growth Rate:
61.11%
Total runs:
18
Run Growth:
12
Growth Rate:
66.67%
Total runs:
18
Run Growth:
11
Growth Rate:
61.11%
Total runs:
18
Run Growth:
9
Growth Rate:
50.00%
Total runs:
18
Run Growth:
9
Growth Rate:
50.00%
Total runs:
17
Run Growth:
14
Growth Rate:
77.78%
Total runs:
17
Run Growth:
12
Growth Rate:
75.00%
Total runs:
17
Run Growth:
12
Growth Rate:
70.59%
Total runs:
17
Run Growth:
13
Growth Rate:
76.47%
Total runs:
17
Run Growth:
12
Growth Rate:
70.59%
Total runs:
17
Run Growth:
6
Growth Rate:
33.33%
Total runs:
17
Run Growth:
4
Growth Rate:
22.22%
Total runs:
17
Run Growth:
8
Growth Rate:
47.06%