Total runs:
533.2K
Run Growth:
-258.0K
Growth Rate:
-48.38%
Sponsored by
Vmake Labs Video Enhancer
FINAL-Bench / AETHER-7B-7Attn-base
Model's Last Updated: July 22 2026
text-generation
Introduction of AETHER-7B-7Attn-base
Model Details of AETHER-7B-7Attn-base
AETHER-7B-7Attn-base
Open-weight release — model weights only.
To our knowledge, the first foundation model to implement seven heterogeneous attention mechanisms within a single architecture.
Attention layout
Seven distinct attention mechanisms ( A–G ) are distributed across 49 layers in a 7×7 Latin square — every mechanism appears exactly once in each row and each column, so no single mechanism dominates any depth band.
Mechanism identities and the assignment recipe are proprietary and not disclosed.
Model
| Parameters | 6.59B total / ~3B active (Mixture-of-Experts) |
| Type | Decoder-only language model, heterogeneous multi-attention architecture |
| Precision | bfloat16 |
| Languages | Korean, English |
| Stage | Pretrained base (no instruction tuning) |
| Developer | VIDRAFT |
Unlike conventional models that repeat a single attention mechanism across all layers, AETHER-7B-7Attn composes seven distinct attention mechanisms inside one network. This heterogeneous design is the defining characteristic of the AETHER architecture.
Release scope
This repository distributes model weights only .
The following are proprietary and not disclosed :
- the attention composition recipe (which mechanisms, and how they are arranged)
- layer layout and architectural configuration details
- modeling / inference implementation code
- training data, data mixture, and hyperparameters
Loading these weights requires the corresponding architecture implementation, which is not distributed in this repository . For access or licensing inquiries, please contact VIDRAFT.
Intended use
Released for research, evaluation and benchmarking of the released weights . This is a base (pretrained) model — it continues text rather than following instructions.
License
Apache-2.0 — the released weights are free to use, modify and redistribute under the terms of the Apache License 2.0.
Note that the architecture implementation, attention composition recipe and training pipeline are not part of this release and remain proprietary to VIDRAFT.
VIDRAFT · Sovereign AI
Runs of FINAL-Bench AETHER-7B-7Attn-base on huggingface.co
253
Total runs
-13
24-hour runs
-67
3-day runs
-103
7-day runs
-16
30-day runs
More Information About AETHER-7B-7Attn-base huggingface.co Model
Url of AETHER-7B-7Attn-base
AETHER-7B-7Attn-base huggingface.co Url
Provider of AETHER-7B-7Attn-base huggingface.co
Other API from FINAL-Bench
Updated:September 25 2026
Total runs:
271.4K
Run Growth:
-61.7K
Growth Rate:
-22.74%
Total runs:
90.5K
Run Growth:
90.5K
Growth Rate:
100.00%
Total runs:
4.2K
Run Growth:
4.2K
Growth Rate:
98.33%
Total runs:
2.5K
Run Growth:
2.5K
Growth Rate:
100.00%
Total runs:
2.2K
Run Growth:
1.9K
Growth Rate:
86.96%
Total runs:
2.1K
Run Growth:
2.1K
Growth Rate:
100.00%
Total runs:
1.5K
Run Growth:
1.5K
Growth Rate:
100.00%
Total runs:
1.5K
Run Growth:
1.4K
Growth Rate:
97.81%
Total runs:
1.2K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1.1K
Run Growth:
1.1K
Growth Rate:
100.00%
Total runs:
995
Run Growth:
605
Growth Rate:
60.80%
Total runs:
988
Run Growth:
-61
Growth Rate:
-6.17%
Total runs:
912
Run Growth:
497
Growth Rate:
54.50%
Total runs:
806
Run Growth:
535
Growth Rate:
66.38%
Total runs:
600
Run Growth:
-122
Growth Rate:
-20.33%
Total runs:
505
Run Growth:
497
Growth Rate:
100.00%
Total runs:
491
Run Growth:
322
Growth Rate:
65.58%
Total runs:
471
Run Growth:
465
Growth Rate:
98.73%
Total runs:
432
Run Growth:
432
Growth Rate:
100.00%
Total runs:
407
Run Growth:
385
Growth Rate:
94.59%
Total runs:
401
Run Growth:
239
Growth Rate:
59.60%
Total runs:
385
Run Growth:
49
Growth Rate:
12.73%
Total runs:
346
Run Growth:
260
Growth Rate:
75.14%
Total runs:
305
Run Growth:
60
Growth Rate:
19.67%
Total runs:
285
Run Growth:
285
Growth Rate:
100.00%
Total runs:
247
Run Growth:
-78
Growth Rate:
-31.08%
Total runs:
231
Run Growth:
53
Growth Rate:
22.94%
Total runs:
191
Run Growth:
191
Growth Rate:
100.00%
Total runs:
165
Run Growth:
-21
Growth Rate:
-12.50%
Total runs:
162
Run Growth:
89
Growth Rate:
54.94%
Total runs:
156
Run Growth:
77
Growth Rate:
49.36%
Total runs:
155
Run Growth:
-57
Growth Rate:
-36.77%
Total runs:
153
Run Growth:
-82
Growth Rate:
-53.59%
Total runs:
127
Run Growth:
114
Growth Rate:
89.76%
Total runs:
117
Run Growth:
117
Growth Rate:
100.00%
Total runs:
109
Run Growth:
35
Growth Rate:
32.11%
Total runs:
102
Run Growth:
86
Growth Rate:
83.50%
Total runs:
101
Run Growth:
41
Growth Rate:
43.62%
Total runs:
72
Run Growth:
-180
Growth Rate:
-250.00%
Total runs:
63
Run Growth:
37
Growth Rate:
58.73%
Total runs:
61
Run Growth:
61
Growth Rate:
100.00%
Total runs:
60
Run Growth:
60
Growth Rate:
100.00%
Total runs:
60
Run Growth:
17
Growth Rate:
28.33%
Total runs:
52
Run Growth:
52
Growth Rate:
100.00%
Total runs:
52
Run Growth:
52
Growth Rate:
100.00%
Total runs:
51
Run Growth:
51
Growth Rate:
100.00%
Total runs:
50
Run Growth:
50
Growth Rate:
100.00%
Total runs:
48
Run Growth:
48
Growth Rate:
100.00%
Total runs:
47
Run Growth:
16
Growth Rate:
34.04%
Total runs:
46
Run Growth:
46
Growth Rate:
100.00%
Total runs:
46
Run Growth:
46
Growth Rate:
100.00%
Total runs:
43
Run Growth:
43
Growth Rate:
100.00%
Total runs:
40
Run Growth:
40
Growth Rate:
100.00%
Total runs:
31
Run Growth:
22
Growth Rate:
70.97%
Total runs:
13
Run Growth:
6
Growth Rate:
46.15%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%