Total runs:
4.8M
Run Growth:
0
Growth Rate:
0.00%
Sponsored by
PostMcpAi
cognitivecomputations / laserxtral
Model's Last Updated: May 20 2024
text-generation
Introduction of laserxtral
Model Details of laserxtral
by David, Fernando and Eric
Sponsored by: VAGO Solutions
An experimentation regarding 'lasering' each expert to denoise and enhance model capabilities.
This model has half size in comparison to the Mixtral 8x7b Instruct. And it basically has the same level of performance (we are working to get a better MMLU score).
Laserxtral - 4x7b (all, except for base, lasered using laserRMT)
This model is a Mixture of Experts (MoE) made with mergekit (mixtral branch). It uses the following base models:
- cognitivecomputations/dolphin-2.6-mistral-7b-dpo
- mlabonne/Marcoro14-7B-slerp (base)
- beowolx/CodeNinja-1.0-OpenChat-7B
- Q-bert/MetaMath-Cybertron-Starling
- WizardLM/WizardMath-7B-V1.1
It follows the implementation of laserRMT @ https://github.com/cognitivecomputations/laserRMT
Here, we are controlling layers checking which ones have lower signal to noise ratios (which are more subject to noise), to apply Laser interventions, still using Machenko Pastur to calculate this ratio.
We intend to be the first of a family of experimentations being carried out @ Cognitive Computations.
In this experiment we have observed very high truthfulness and high reasoning capabilities.
Evals
Runs of cognitivecomputations laserxtral on huggingface.co
810
Total runs
0
24-hour runs
0
3-day runs
0
7-day runs
0
30-day runs
More Information About laserxtral huggingface.co Model
Url of laserxtral
laserxtral huggingface.co Url
Provider of laserxtral huggingface.co
Other API from cognitivecomputations
Updated:May 20 2024
Total runs:
35.9K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
12.9K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
12.8K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
12.4K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
11.3K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
10.4K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
10.0K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
9.5K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
9.3K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
9.3K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
9.3K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
9.3K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
8.9K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
8.5K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
6.0K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
5.8K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
5.3K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
4.8K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
4.5K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
4.3K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
4.1K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
4.1K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
4.0K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
3.5K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
3.5K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
3.2K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
2.8K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
2.6K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
2.5K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
2.5K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
2.4K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
2.4K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
2.2K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
2.2K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
2.2K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
2.1K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
2.0K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
2.0K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1.9K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1.8K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1.8K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1.8K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1.8K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1.7K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1.7K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1.5K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1.5K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1.4K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1.3K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1.3K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1.2K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1.2K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1.1K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1.1K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1.1K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1.1K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1.1K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1.1K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1.0K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
993
Run Growth:
0
Growth Rate:
0.00%
Total runs:
982
Run Growth:
0
Growth Rate:
0.00%
Total runs:
960
Run Growth:
0
Growth Rate:
0.00%
Total runs:
951
Run Growth:
0
Growth Rate:
0.00%
Total runs:
933
Run Growth:
0
Growth Rate:
0.00%
Total runs:
795
Run Growth:
0
Growth Rate:
0.00%
Total runs:
788
Run Growth:
0
Growth Rate:
0.00%
Total runs:
716
Run Growth:
0
Growth Rate:
0.00%
Total runs:
461
Run Growth:
0
Growth Rate:
0.00%
Total runs:
456
Run Growth:
0
Growth Rate:
0.00%
Total runs:
447
Run Growth:
0
Growth Rate:
0.00%
Total runs:
385
Run Growth:
0
Growth Rate:
0.00%
Total runs:
309
Run Growth:
0
Growth Rate:
0.00%
Total runs:
223
Run Growth:
0
Growth Rate:
0.00%
Total runs:
219
Run Growth:
0
Growth Rate:
0.00%
Total runs:
210
Run Growth:
0
Growth Rate:
0.00%
Total runs:
198
Run Growth:
0
Growth Rate:
0.00%
Total runs:
186
Run Growth:
0
Growth Rate:
0.00%
Total runs:
155
Run Growth:
0
Growth Rate:
0.00%
Total runs:
153
Run Growth:
0
Growth Rate:
0.00%
Total runs:
144
Run Growth:
0
Growth Rate:
0.00%
Total runs:
113
Run Growth:
0
Growth Rate:
0.00%
Total runs:
112
Run Growth:
0
Growth Rate:
0.00%
Total runs:
108
Run Growth:
0
Growth Rate:
0.00%
Total runs:
101
Run Growth:
0
Growth Rate:
0.00%
Total runs:
90
Run Growth:
0
Growth Rate:
0.00%
Total runs:
84
Run Growth:
0
Growth Rate:
0.00%
Total runs:
81
Run Growth:
0
Growth Rate:
0.00%
Total runs:
78
Run Growth:
0
Growth Rate:
0.00%
Total runs:
77
Run Growth:
0
Growth Rate:
0.00%
Total runs:
61
Run Growth:
0
Growth Rate:
0.00%
Total runs:
57
Run Growth:
0
Growth Rate:
0.00%
Total runs:
43
Run Growth:
0
Growth Rate:
0.00%
Total runs:
40
Run Growth:
0
Growth Rate:
0.00%
Total runs:
38
Run Growth:
0
Growth Rate:
0.00%
Total runs:
34
Run Growth:
0
Growth Rate:
0.00%
Total runs:
33
Run Growth:
0
Growth Rate:
0.00%
Total runs:
30
Run Growth:
0
Growth Rate:
0.00%
Total runs:
29
Run Growth:
0
Growth Rate:
0.00%
Total runs:
28
Run Growth:
0
Growth Rate:
0.00%