Total runs:
2.0K
Run Growth:
771
Growth Rate:
38.21%
Sponsored by
Vmake Labs Video Enhancer
ethicalabs / Echo-DSRN-114M-v0.1.2-Base
Model's Last Updated: June 19 2026
text-generation
Introduction of Echo-DSRN-114M-v0.1.2-Base
Model Details of Echo-DSRN-114M-v0.1.2-Base
Model Card for ethicalabs/Echo-DSRN-114M-v0.1.2-Base
The
Echo-DSRN(N)
(
Dual State Recurrent Neural Network
, short name:
Echo-DSRN
, also know as
echo
) is a novel architecture specifically designed to be a viable alternative for low-resource tasks that are currently being inefficiently handled by the excessive scale of Large Language Models (LLMs) 🌱
⚠️ Important Notice
This is a research prototype and demo model .
- Not production-ready
- Will hallucinate and give incorrect answers
- Do not use for any real-world decisions
- Intended for architecture experimentation only
What Works
- Text generation is fluent
- Memory usage is constant O(1)
- Runs on CPUs, NPUs, GPUs (Tested on AMD's ROCm and Apple's MPS)
What Doesn't Work
- Factual accuracy
- Instruction following
- Common sense reasoning
🏗️ Architecture Details
| Property | Value |
|---|---|
| Model Type | echo_dsrn |
| Layers | 8 |
| Hidden Dim | 512 |
| Attention Heads | 4 |
| MLP Ratio | 8.0 |
| Vocab Size | 32011 |
| Hybrid Attention | True |
| RMSNorm | True |
📊 Parameter Breakdown
| Component | Parameters | % of Total |
|---|---|---|
| Total | 114.69M (114,687,488) | 100% |
| Embeddings | 16.39M | 14.29% |
| DSRN Blocks (Aggregate) | 81.91M | 71.42% |
| LM Head | 16.39M | 14.29% |
🧩 Internal Block Structure (Per Layer)
| Sub-Component | Parameters | Description |
|---|---|---|
| MLP (Feed-Forward) | 4.20M | Upscaled hidden layers |
| DSRN Slow State | 3.15M | Constant-time memory gates |
| GRU Fast State | 1.58M | Recurrent fast path |
| Surprise Gating | 264,192 | Dynamic focus mechanism |
| Normalization | 1,024 | LayerNorm / RMSNorm |
Pre-Training
Truncated Backpropagation Through Time (TBPTT) on Fineweb-EDU + Smoltalk2 (no think) (6BT)
1 epoch on a single AMD Instinct MI300X 192 GB
Evaluation
| Tasks | Version | Filter | n-shot | Metric | Value | Stderr | ||
|---|---|---|---|---|---|---|---|---|
| piqa | 1 | none | 0 | acc | ↑ | 0.5789 | ± | 0.0115 |
| none | 0 | acc_norm | ↑ | 0.5718 | ± | 0.0115 | ||
| sciq | 1 | none | 0 | acc | ↑ | 0.5830 | ± | 0.0156 |
| none | 0 | acc_norm | ↑ | 0.5250 | ± | 0.0158 |
| Tasks | Version | Filter | n-shot | Metric | Value | Stderr | ||
|---|---|---|---|---|---|---|---|---|
| piqa | 1 | none | 5 | acc | ↑ | 0.5773 | ± | 0.0115 |
| none | 5 | acc_norm | ↑ | 0.5729 | ± | 0.0115 | ||
| sciq | 1 | none | 5 | acc | ↑ | 0.5700 | ± | 0.0157 |
| none | 5 | acc_norm | ↑ | 0.5140 | ± | 0.0158 |
Gradio App - Next Word Prediction
Runs of ethicalabs Echo-DSRN-114M-v0.1.2-Base on huggingface.co
44
Total runs
0
24-hour runs
-2
3-day runs
-5
7-day runs
7
30-day runs
More Information About Echo-DSRN-114M-v0.1.2-Base huggingface.co Model
Url of Echo-DSRN-114M-v0.1.2-Base
Echo-DSRN-114M-v0.1.2-Base huggingface.co Url
Provider of Echo-DSRN-114M-v0.1.2-Base huggingface.co
Other API from ethicalabs
Updated:August 23 2026
Total runs:
294
Run Growth:
-91
Growth Rate:
-30.95%
Total runs:
229
Run Growth:
-56
Growth Rate:
-24.45%
Total runs:
181
Run Growth:
-1.7K
Growth Rate:
-918.78%
Total runs:
136
Run Growth:
64
Growth Rate:
47.06%
Total runs:
107
Run Growth:
-95
Growth Rate:
-88.79%
Total runs:
60
Run Growth:
0
Growth Rate:
0.00%
Total runs:
42
Run Growth:
3
Growth Rate:
7.14%
Total runs:
40
Run Growth:
-35
Growth Rate:
-87.50%
Total runs:
40
Run Growth:
15
Growth Rate:
35.71%
Total runs:
39
Run Growth:
-179
Growth Rate:
-458.97%
Total runs:
38
Run Growth:
24
Growth Rate:
61.54%
Total runs:
37
Run Growth:
6
Growth Rate:
16.22%
Total runs:
37
Run Growth:
16
Growth Rate:
44.44%
Total runs:
36
Run Growth:
23
Growth Rate:
65.71%
Total runs:
35
Run Growth:
20
Growth Rate:
57.14%
Total runs:
35
Run Growth:
-244
Growth Rate:
-697.14%
Total runs:
34
Run Growth:
25
Growth Rate:
73.53%
Total runs:
33
Run Growth:
-20
Growth Rate:
-60.61%
Total runs:
33
Run Growth:
17
Growth Rate:
51.52%
Total runs:
33
Run Growth:
4
Growth Rate:
12.12%
Total runs:
31
Run Growth:
-68
Growth Rate:
-219.35%
Total runs:
31
Run Growth:
16
Growth Rate:
51.61%
Total runs:
31
Run Growth:
13
Growth Rate:
41.94%
Total runs:
31
Run Growth:
-33
Growth Rate:
-106.45%
Total runs:
30
Run Growth:
20
Growth Rate:
66.67%
Total runs:
29
Run Growth:
11
Growth Rate:
37.93%
Total runs:
29
Run Growth:
6
Growth Rate:
20.69%
Total runs:
29
Run Growth:
8
Growth Rate:
27.59%
Total runs:
29
Run Growth:
21
Growth Rate:
70.00%
Total runs:
28
Run Growth:
14
Growth Rate:
51.85%
Total runs:
28
Run Growth:
13
Growth Rate:
46.43%
Total runs:
28
Run Growth:
18
Growth Rate:
64.29%
Total runs:
28
Run Growth:
4
Growth Rate:
13.33%
Total runs:
27
Run Growth:
-4
Growth Rate:
-14.81%
Total runs:
27
Run Growth:
20
Growth Rate:
74.07%
Total runs:
27
Run Growth:
-2
Growth Rate:
-7.41%
Total runs:
27
Run Growth:
16
Growth Rate:
59.26%
Total runs:
27
Run Growth:
12
Growth Rate:
44.44%
Total runs:
26
Run Growth:
13
Growth Rate:
52.00%
Total runs:
25
Run Growth:
-32
Growth Rate:
-128.00%
Total runs:
25
Run Growth:
14
Growth Rate:
56.00%
Total runs:
25
Run Growth:
3
Growth Rate:
12.00%
Total runs:
25
Run Growth:
-79
Growth Rate:
-316.00%
Total runs:
24
Run Growth:
17
Growth Rate:
70.83%
Total runs:
24
Run Growth:
16
Growth Rate:
66.67%
Total runs:
23
Run Growth:
15
Growth Rate:
65.22%
Total runs:
23
Run Growth:
12
Growth Rate:
52.17%
Total runs:
23
Run Growth:
20
Growth Rate:
86.96%
Total runs:
22
Run Growth:
18
Growth Rate:
78.26%
Total runs:
22
Run Growth:
-32
Growth Rate:
-145.45%
Total runs:
21
Run Growth:
13
Growth Rate:
61.90%
Total runs:
20
Run Growth:
0
Growth Rate:
0.00%
Total runs:
19
Run Growth:
3
Growth Rate:
15.79%
Total runs:
19
Run Growth:
-2
Growth Rate:
-10.53%
Total runs:
18
Run Growth:
14
Growth Rate:
77.78%
Total runs:
18
Run Growth:
9
Growth Rate:
50.00%
Total runs:
18
Run Growth:
13
Growth Rate:
72.22%
Total runs:
18
Run Growth:
10
Growth Rate:
55.56%
Total runs:
17
Run Growth:
9
Growth Rate:
52.94%
Total runs:
17
Run Growth:
-7
Growth Rate:
-46.67%
Total runs:
17
Run Growth:
8
Growth Rate:
47.06%
Total runs:
17
Run Growth:
11
Growth Rate:
61.11%
Total runs:
17
Run Growth:
0
Growth Rate:
0.00%
Total runs:
17
Run Growth:
4
Growth Rate:
23.53%
Total runs:
16
Run Growth:
4
Growth Rate:
25.00%
Total runs:
16
Run Growth:
1
Growth Rate:
6.25%
Total runs:
16
Run Growth:
10
Growth Rate:
62.50%
Total runs:
16
Run Growth:
7
Growth Rate:
43.75%
Total runs:
16
Run Growth:
11
Growth Rate:
68.75%
Total runs:
16
Run Growth:
8
Growth Rate:
50.00%
Total runs:
16
Run Growth:
-6
Growth Rate:
-35.29%
Total runs:
14
Run Growth:
1
Growth Rate:
7.14%
Total runs:
14
Run Growth:
6
Growth Rate:
42.86%
Total runs:
13
Run Growth:
5
Growth Rate:
38.46%
Total runs:
13
Run Growth:
9
Growth Rate:
69.23%
Total runs:
13
Run Growth:
5
Growth Rate:
38.46%
Total runs:
12
Run Growth:
0
Growth Rate:
0.00%
Total runs:
10
Run Growth:
0
Growth Rate:
0.00%
Total runs:
10
Run Growth:
-2
Growth Rate:
-20.00%
Total runs:
10
Run Growth:
2
Growth Rate:
20.00%
Total runs:
9
Run Growth:
5
Growth Rate:
55.56%
Total runs:
9
Run Growth:
4
Growth Rate:
44.44%
Total runs:
8
Run Growth:
-1
Growth Rate:
-12.50%
Total runs:
8
Run Growth:
-1
Growth Rate:
-12.50%
Total runs:
6
Run Growth:
-3
Growth Rate:
-50.00%
Total runs:
2
Run Growth:
2
Growth Rate:
100.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%