Total runs:
2.2K
Run Growth:
1.2K
Growth Rate:
53.36%
Sponsored by
Designkit Free Background Remover
ethicalabs / Echo-DSRN-114M
Model's Last Updated: June 19 2026
text-generation
Introduction of Echo-DSRN-114M
Model Details of Echo-DSRN-114M
Model Card for ethicalabs/Echo-DSRN-114M
The
Echo-DSRN(N)
(
Dual State Recurrent Neural Network
, short name:
Echo-DSRN
, also know as
echo
) is a novel architecture specifically designed to be a viable alternative for low-resource tasks that are currently being inefficiently handled by the excessive scale of Large Language Models (LLMs) 🌱
⚠️ Important Notice
This is a research prototype and demo model .
- Not production-ready
- Will hallucinate and give incorrect answers
- Do not use for any real-world decisions
- Intended for architecture experimentation only
What Works
- Text generation is fluent
- Memory usage is constant O(1)
- Runs on CPUs, NPUs, GPUs (Tested on AMD's ROCm and Apple's MPS)
What Doesn't Work
- Factual accuracy
- Instruction following
- Common sense reasoning
🏗️ Architecture Details
| Property | Value |
|---|---|
| Model Type | echo_dsrn |
| Layers | 8 |
| Hidden Dim | 512 |
| Attention Heads | 4 |
| MLP Ratio | 8.0 |
| Vocab Size | 32011 |
| Hybrid Attention | True |
| RMSNorm | True |
📊 Parameter Breakdown
| Component | Parameters | % of Total |
|---|---|---|
| Total | 114.69M (114,687,488) | 100% |
| Embeddings | 16.39M | 14.29% |
| DSRN Blocks (Aggregate) | 81.91M | 71.42% |
| LM Head | 16.39M | 14.29% |
🧩 Internal Block Structure (Per Layer)
| Sub-Component | Parameters | Description |
|---|---|---|
| MLP (Feed-Forward) | 4.20M | Upscaled hidden layers |
| DSRN Slow State | 3.15M | Constant-time memory gates |
| GRU Fast State | 1.58M | Recurrent fast path |
| Surprise Gating | 264,192 | Dynamic focus mechanism |
| Normalization | 1,024 | LayerNorm / RMSNorm |
Supervised Fine-Tuning (SFTTrainer)
5 epochs on a single AMD Ryzen AI Max+ 395 (128 GB RAM)
Evaluation
Work in progress.
Runs of ethicalabs Echo-DSRN-114M on huggingface.co
28
Total runs
-2
24-hour runs
-3
3-day runs
-12
7-day runs
-10
30-day runs
More Information About Echo-DSRN-114M huggingface.co Model
Url of Echo-DSRN-114M
Echo-DSRN-114M huggingface.co Url
Provider of Echo-DSRN-114M huggingface.co
Other API from ethicalabs
Updated:August 23 2026
Total runs:
348
Run Growth:
171
Growth Rate:
49.14%
Total runs:
168
Run Growth:
100
Growth Rate:
59.52%
Total runs:
163
Run Growth:
-27
Growth Rate:
-16.56%
Total runs:
109
Run Growth:
58
Growth Rate:
58.59%
Total runs:
78
Run Growth:
-37
Growth Rate:
-47.44%
Total runs:
60
Run Growth:
33
Growth Rate:
57.89%
Total runs:
60
Run Growth:
0
Growth Rate:
0.00%
Total runs:
38
Run Growth:
25
Growth Rate:
69.44%
Total runs:
35
Run Growth:
-213
Growth Rate:
-608.57%
Total runs:
34
Run Growth:
22
Growth Rate:
66.67%
Total runs:
34
Run Growth:
20
Growth Rate:
62.50%
Total runs:
32
Run Growth:
-9
Growth Rate:
-28.13%
Total runs:
29
Run Growth:
-24
Growth Rate:
-82.76%
Total runs:
29
Run Growth:
10
Growth Rate:
34.48%
Total runs:
29
Run Growth:
8
Growth Rate:
29.63%
Total runs:
29
Run Growth:
-17
Growth Rate:
-56.67%
Total runs:
28
Run Growth:
-18
Growth Rate:
-66.67%
Total runs:
27
Run Growth:
-11
Growth Rate:
-40.74%
Total runs:
27
Run Growth:
-10
Growth Rate:
-40.00%
Total runs:
27
Run Growth:
4
Growth Rate:
14.29%
Total runs:
27
Run Growth:
7
Growth Rate:
25.93%
Total runs:
25
Run Growth:
-9
Growth Rate:
-36.00%
Total runs:
25
Run Growth:
7
Growth Rate:
26.92%
Total runs:
25
Run Growth:
7
Growth Rate:
28.00%
Total runs:
24
Run Growth:
-5
Growth Rate:
-20.83%
Total runs:
24
Run Growth:
9
Growth Rate:
37.50%
Total runs:
24
Run Growth:
1
Growth Rate:
3.85%
Total runs:
24
Run Growth:
1
Growth Rate:
4.17%
Total runs:
24
Run Growth:
-13
Growth Rate:
-50.00%
Total runs:
23
Run Growth:
-1
Growth Rate:
-4.35%
Total runs:
23
Run Growth:
-7
Growth Rate:
-30.43%
Total runs:
23
Run Growth:
2
Growth Rate:
8.70%
Total runs:
23
Run Growth:
-90
Growth Rate:
-391.30%
Total runs:
22
Run Growth:
5
Growth Rate:
22.73%
Total runs:
21
Run Growth:
3
Growth Rate:
13.64%
Total runs:
21
Run Growth:
5
Growth Rate:
23.81%
Total runs:
21
Run Growth:
-7
Growth Rate:
-31.82%
Total runs:
21
Run Growth:
-1
Growth Rate:
-4.76%
Total runs:
20
Run Growth:
-20
Growth Rate:
-100.00%
Total runs:
20
Run Growth:
1
Growth Rate:
4.76%
Total runs:
20
Run Growth:
5
Growth Rate:
20.83%
Total runs:
19
Run Growth:
9
Growth Rate:
47.37%
Total runs:
19
Run Growth:
-11
Growth Rate:
-57.89%
Total runs:
18
Run Growth:
6
Growth Rate:
37.50%
Total runs:
18
Run Growth:
3
Growth Rate:
16.67%
Total runs:
18
Run Growth:
-18
Growth Rate:
-100.00%
Total runs:
18
Run Growth:
-3
Growth Rate:
-15.79%
Total runs:
18
Run Growth:
-2
Growth Rate:
-11.11%
Total runs:
18
Run Growth:
6
Growth Rate:
33.33%
Total runs:
18
Run Growth:
-10
Growth Rate:
-55.56%
Total runs:
17
Run Growth:
-37
Growth Rate:
-176.19%
Total runs:
17
Run Growth:
2
Growth Rate:
11.76%
Total runs:
17
Run Growth:
7
Growth Rate:
41.18%
Total runs:
16
Run Growth:
-42
Growth Rate:
-262.50%
Total runs:
16
Run Growth:
2
Growth Rate:
12.50%
Total runs:
16
Run Growth:
-10
Growth Rate:
-62.50%
Total runs:
16
Run Growth:
0
Growth Rate:
0.00%
Total runs:
16
Run Growth:
-11
Growth Rate:
-68.75%
Total runs:
16
Run Growth:
-6
Growth Rate:
-35.29%
Total runs:
15
Run Growth:
-17
Growth Rate:
-113.33%
Total runs:
15
Run Growth:
-1
Growth Rate:
-6.67%
Total runs:
15
Run Growth:
4
Growth Rate:
26.67%
Total runs:
14
Run Growth:
-6
Growth Rate:
-42.86%
Total runs:
13
Run Growth:
-3
Growth Rate:
-23.08%
Total runs:
13
Run Growth:
0
Growth Rate:
0.00%
Total runs:
13
Run Growth:
3
Growth Rate:
23.08%
Total runs:
13
Run Growth:
-8
Growth Rate:
-61.54%
Total runs:
13
Run Growth:
4
Growth Rate:
30.77%
Total runs:
12
Run Growth:
2
Growth Rate:
16.67%
Total runs:
12
Run Growth:
0
Growth Rate:
0.00%
Total runs:
12
Run Growth:
-4
Growth Rate:
-28.57%
Total runs:
11
Run Growth:
0
Growth Rate:
0.00%
Total runs:
11
Run Growth:
-7
Growth Rate:
-63.64%
Total runs:
10
Run Growth:
0
Growth Rate:
0.00%
Total runs:
10
Run Growth:
-6
Growth Rate:
-60.00%
Total runs:
10
Run Growth:
-4
Growth Rate:
-40.00%
Total runs:
9
Run Growth:
3
Growth Rate:
30.00%
Total runs:
9
Run Growth:
-7
Growth Rate:
-77.78%
Total runs:
9
Run Growth:
-2
Growth Rate:
-22.22%
Total runs:
8
Run Growth:
-29
Growth Rate:
-362.50%
Total runs:
8
Run Growth:
-10
Growth Rate:
-125.00%
Total runs:
8
Run Growth:
-12
Growth Rate:
-150.00%
Total runs:
8
Run Growth:
-8
Growth Rate:
-100.00%
Total runs:
8
Run Growth:
-1
Growth Rate:
-12.50%
Total runs:
7
Run Growth:
-4
Growth Rate:
-57.14%
Total runs:
6
Run Growth:
-4
Growth Rate:
-66.67%
Total runs:
2
Run Growth:
2
Growth Rate:
100.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%