Total runs:
13.4K
Run Growth:
-1.1K
Growth Rate:
-8.19%
Sponsored by
Vmake Labs Video Enhancer
vicgalle / CarbonBeagle-11B
Model's Last Updated: June 24 2025
text-generation
Introduction of CarbonBeagle-11B
Model Details of CarbonBeagle-11B
CarbonBeagle-11B
An experiment in merging models of different architectures and sizes. Here are the steps:
- Upscale mlabonne/NeuralBeagle14-7B to vicgalle/franken-Beagle-11B.
- DPO-tune vicgalle/franken-Beagle-11B to vicgalle/NeuralBeagle-11B.
- Merge vicgalle/NeuralBeagle-11B and jeonsworld/CarbonVillain-en-10.7B-v4.
Merge Details
Merge Method
This model was merged using the linear merge method.
Models Merged
The following models were included in the merge:
Configuration
The following YAML configuration was used to produce this model:
models:
- model: jeonsworld/CarbonVillain-en-10.7B-v4
parameters:
weight: 1.0
- model: vicgalle/NeuralBeagle-11B
parameters:
weight: 0.5
merge_method: linear
dtype: float16
Evaluations
At the time of its creation (21-01-2024), it is the best model in the Open LLM Leaderboard for its size class (10.7B-11B), and also 13B models:
Open LLM Leaderboard Evaluation Results
Detailed results can be found here
| Metric | Value |
|---|---|
| Avg. | 74.64 |
| AI2 Reasoning Challenge (25-Shot) | 71.84 |
| HellaSwag (10-Shot) | 88.93 |
| MMLU (5-Shot) | 66.62 |
| TruthfulQA (0-shot) | 69.43 |
| Winogrande (5-shot) | 84.06 |
| GSM8k (5-shot) | 66.94 |
Open LLM Leaderboard Evaluation Results
Detailed results can be found here
| Metric | Value |
|---|---|
| Avg. | 22.36 |
| IFEval (0-Shot) | 54.15 |
| BBH (3-Shot) | 33.06 |
| MATH Lvl 5 (4-Shot) | 5.51 |
| GPQA (0-shot) | 6.94 |
| MuSR (0-shot) | 9.19 |
| MMLU-PRO (5-shot) | 25.29 |
Runs of vicgalle CarbonBeagle-11B on huggingface.co
8.0K
Total runs
0
24-hour runs
0
3-day runs
24
7-day runs
-36
30-day runs
More Information About CarbonBeagle-11B huggingface.co Model
Url of CarbonBeagle-11B
CarbonBeagle-11B huggingface.co Url
Provider of CarbonBeagle-11B huggingface.co
Other API from vicgalle
Updated:July 25 2024
Total runs:
10.1K
Run Growth:
1.2K
Growth Rate:
11.95%
Total runs:
8.6K
Run Growth:
-1.1K
Growth Rate:
-12.42%
Total runs:
8.6K
Run Growth:
6
Growth Rate:
0.07%
Total runs:
8.6K
Run Growth:
-1.1K
Growth Rate:
-12.94%
Total runs:
8.3K
Run Growth:
-316
Growth Rate:
-3.80%
Total runs:
8.3K
Run Growth:
-309
Growth Rate:
-3.72%
Total runs:
8.3K
Run Growth:
-346
Growth Rate:
-4.18%
Total runs:
2.0K
Run Growth:
778
Growth Rate:
38.82%
Total runs:
603
Run Growth:
174
Growth Rate:
28.86%
Total runs:
418
Run Growth:
-1.3K
Growth Rate:
-305.98%
Total runs:
392
Run Growth:
-9
Growth Rate:
-2.30%
Total runs:
360
Run Growth:
-194
Growth Rate:
-53.01%
Total runs:
330
Run Growth:
-772
Growth Rate:
-233.94%
Total runs:
321
Run Growth:
-419
Growth Rate:
-130.53%
Total runs:
163
Run Growth:
-1.1K
Growth Rate:
-700.00%
Total runs:
118
Run Growth:
46
Growth Rate:
38.98%
Total runs:
114
Run Growth:
58
Growth Rate:
50.88%
Total runs:
106
Run Growth:
-4
Growth Rate:
-3.77%
Total runs:
74
Run Growth:
-10
Growth Rate:
-13.33%
Total runs:
72
Run Growth:
-16
Growth Rate:
-22.86%
Total runs:
70
Run Growth:
46
Growth Rate:
65.71%
Total runs:
66
Run Growth:
2
Growth Rate:
3.92%
Total runs:
64
Run Growth:
-12
Growth Rate:
-18.18%
Total runs:
59
Run Growth:
-8
Growth Rate:
-13.33%
Total runs:
58
Run Growth:
-50
Growth Rate:
-83.33%
Total runs:
56
Run Growth:
-11
Growth Rate:
-19.30%
Total runs:
54
Run Growth:
0
Growth Rate:
0.00%
Total runs:
49
Run Growth:
-9
Growth Rate:
-18.75%
Total runs:
46
Run Growth:
12
Growth Rate:
26.09%
Total runs:
41
Run Growth:
-8
Growth Rate:
-19.51%
Total runs:
38
Run Growth:
-24
Growth Rate:
-63.16%
Total runs:
23
Run Growth:
-48
Growth Rate:
-208.70%
Total runs:
22
Run Growth:
21
Growth Rate:
95.45%
Total runs:
21
Run Growth:
1
Growth Rate:
4.76%
Total runs:
17
Run Growth:
-24
Growth Rate:
-141.18%
Total runs:
10
Run Growth:
5
Growth Rate:
50.00%
Total runs:
9
Run Growth:
2
Growth Rate:
22.22%
Total runs:
6
Run Growth:
-3
Growth Rate:
-50.00%
Total runs:
5
Run Growth:
-1
Growth Rate:
-20.00%
Total runs:
4
Run Growth:
-3
Growth Rate:
-75.00%
Total runs:
4
Run Growth:
-13
Growth Rate:
-325.00%
Total runs:
2
Run Growth:
0
Growth Rate:
0.00%
Total runs:
2
Run Growth:
-4
Growth Rate:
-200.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%