Total runs:
9.1K
Run Growth:
0
Growth Rate:
0.00%
Sponsored by
APIMart
QuixiAI / laserxtral
Model's Last Updated: May 20 2024
text-generation
Introduction of laserxtral
Model Details of laserxtral
by David, Fernando and Eric
Sponsored by: VAGO Solutions
An experimentation regarding 'lasering' each expert to denoise and enhance model capabilities.
This model has half size in comparison to the Mixtral 8x7b Instruct. And it basically has the same level of performance (we are working to get a better MMLU score).
Laserxtral - 4x7b (all, except for base, lasered using laserRMT)
This model is a Mixture of Experts (MoE) made with mergekit (mixtral branch). It uses the following base models:
- cognitivecomputations/dolphin-2.6-mistral-7b-dpo
- mlabonne/Marcoro14-7B-slerp (base)
- beowolx/CodeNinja-1.0-OpenChat-7B
- Q-bert/MetaMath-Cybertron-Starling
- WizardLM/WizardMath-7B-V1.1
It follows the implementation of laserRMT @ https://github.com/cognitivecomputations/laserRMT
Here, we are controlling layers checking which ones have lower signal to noise ratios (which are more subject to noise), to apply Laser interventions, still using Machenko Pastur to calculate this ratio.
We intend to be the first of a family of experimentations being carried out @ Cognitive Computations.
In this experiment we have observed very high truthfulness and high reasoning capabilities.
Evals
Runs of QuixiAI laserxtral on huggingface.co
43
Total runs
0
24-hour runs
0
3-day runs
4
7-day runs
24
30-day runs
More Information About laserxtral huggingface.co Model
Url of laserxtral
laserxtral huggingface.co Url
Provider of laserxtral huggingface.co
Other API from QuixiAI
Updated:June 03 2024
Total runs:
8.9K
Run Growth:
330
Growth Rate:
3.71%
Total runs:
8.2K
Run Growth:
528
Growth Rate:
6.47%
Total runs:
8.1K
Run Growth:
522
Growth Rate:
6.43%
Total runs:
4.9K
Run Growth:
1.1K
Growth Rate:
22.69%
Total runs:
1.6K
Run Growth:
1.6K
Growth Rate:
94.70%
Total runs:
1.1K
Run Growth:
-44.8K
Growth Rate:
-3951.28%
Total runs:
941
Run Growth:
-441
Growth Rate:
-46.87%
Total runs:
839
Run Growth:
259
Growth Rate:
30.87%
Total runs:
790
Run Growth:
-431
Growth Rate:
-54.56%
Total runs:
783
Run Growth:
741
Growth Rate:
94.64%
Total runs:
755
Run Growth:
-477
Growth Rate:
-63.18%
Total runs:
740
Run Growth:
-440
Growth Rate:
-59.46%
Total runs:
645
Run Growth:
218
Growth Rate:
33.80%
Total runs:
433
Run Growth:
99
Growth Rate:
22.86%
Total runs:
351
Run Growth:
242
Growth Rate:
68.95%
Total runs:
262
Run Growth:
-23
Growth Rate:
-8.78%
Total runs:
211
Run Growth:
62
Growth Rate:
29.38%
Total runs:
184
Run Growth:
38
Growth Rate:
20.65%
Total runs:
154
Run Growth:
-698
Growth Rate:
-453.25%
Total runs:
136
Run Growth:
107
Growth Rate:
78.68%
Total runs:
117
Run Growth:
41
Growth Rate:
35.04%
Total runs:
108
Run Growth:
-320
Growth Rate:
-296.30%
Total runs:
106
Run Growth:
43
Growth Rate:
40.19%
Total runs:
89
Run Growth:
36
Growth Rate:
40.45%
Total runs:
68
Run Growth:
32
Growth Rate:
47.06%
Total runs:
58
Run Growth:
-61
Growth Rate:
-105.17%
Total runs:
57
Run Growth:
13
Growth Rate:
22.81%
Total runs:
55
Run Growth:
-2
Growth Rate:
-3.64%
Total runs:
50
Run Growth:
36
Growth Rate:
72.00%
Total runs:
45
Run Growth:
6
Growth Rate:
13.33%
Total runs:
44
Run Growth:
-83
Growth Rate:
-188.64%
Total runs:
40
Run Growth:
4
Growth Rate:
10.00%
Total runs:
38
Run Growth:
7
Growth Rate:
18.42%
Total runs:
32
Run Growth:
26
Growth Rate:
81.25%
Total runs:
28
Run Growth:
19
Growth Rate:
67.86%
Total runs:
26
Run Growth:
19
Growth Rate:
73.08%
Total runs:
23
Run Growth:
10
Growth Rate:
43.48%
Total runs:
22
Run Growth:
18
Growth Rate:
81.82%
Total runs:
22
Run Growth:
5
Growth Rate:
22.73%
Total runs:
20
Run Growth:
-9
Growth Rate:
-45.00%
Total runs:
18
Run Growth:
6
Growth Rate:
33.33%
Total runs:
16
Run Growth:
-5
Growth Rate:
-31.25%
Total runs:
16
Run Growth:
-53
Growth Rate:
-331.25%
Total runs:
14
Run Growth:
2
Growth Rate:
14.29%
Total runs:
14
Run Growth:
6
Growth Rate:
42.86%
Total runs:
12
Run Growth:
3
Growth Rate:
25.00%
Total runs:
12
Run Growth:
3
Growth Rate:
25.00%
Total runs:
11
Run Growth:
0
Growth Rate:
0.00%
Total runs:
11
Run Growth:
-44
Growth Rate:
-400.00%
Total runs:
10
Run Growth:
-4
Growth Rate:
-40.00%
Total runs:
8
Run Growth:
-34
Growth Rate:
-425.00%
Total runs:
7
Run Growth:
-31
Growth Rate:
-442.86%
Total runs:
4
Run Growth:
3
Growth Rate:
75.00%
Total runs:
3
Run Growth:
1
Growth Rate:
33.33%
Total runs:
2
Run Growth:
1
Growth Rate:
50.00%
Total runs:
2
Run Growth:
-8
Growth Rate:
-400.00%
Total runs:
1
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1
Run Growth:
-6
Growth Rate:
-600.00%
Total runs:
1
Run Growth:
-4
Growth Rate:
-400.00%