Total runs:
779
Run Growth:
-152
Growth Rate:
-19.51%
Sponsored by
APIMart
ethicalabs / Echo-DSRN-114M-Base
Model's Last Updated: June 19 2026
text-generation
Introduction of Echo-DSRN-114M-Base
Model Details of Echo-DSRN-114M-Base
Model Card for ethicalabs/Echo-DSRN-114M-Base
The
Echo-DSRN(N)
(
Dual State Recurrent Neural Network
, short name:
Echo-DSRN
, also know as
echo
) is a novel architecture specifically designed to be a viable alternative for low-resource tasks that are currently being inefficiently handled by the excessive scale of Large Language Models (LLMs) 🌱
🏗️ Architecture Details
| Property | Value |
|---|---|
| Model Type | echo_dsrn |
| Layers | 8 |
| Hidden Dim | 512 |
| Attention Heads | 4 |
| MLP Ratio | 8.0 |
| Vocab Size | 32011 |
| Hybrid Attention | True |
| RMSNorm | True |
📊 Parameter Breakdown
| Component | Parameters | % of Total |
|---|---|---|
| Total | 114.69M (114,687,488) | 100% |
| Embeddings | 16.39M | 14.29% |
| DSRN Blocks (Aggregate) | 81.91M | 71.42% |
| LM Head | 16.39M | 14.29% |
🧩 Internal Block Structure (Per Layer)
| Sub-Component | Parameters | Description |
|---|---|---|
| MLP (Feed-Forward) | 4.20M | Upscaled hidden layers |
| DSRN Slow State | 3.15M | Constant-time memory gates |
| GRU Fast State | 1.58M | Recurrent fast path |
| Surprise Gating | 264,192 | Dynamic focus mechanism |
| Normalization | 1,024 | LayerNorm / RMSNorm |
Pre-Training
Truncated Backpropagation Through Time (TBPTT) on Fineweb-EDU (10BT)
Continued Pre-Training (SFTTrainer)
coming soon
Evaluation
uv run lm_eval --model hf --model_args pretrained=ethicalabs/Echo-DSRN-114M-Base,trust_remote_code=True,device_map="auto" --tasks sciq,piqa --output_path ./results_Echo-DSRN-114M-Base --batch_size 16 --num_fewshot 5 && uv run lm_eval --model hf --model_args pretrained=ethicalabs/Echo-DSRN-114M-Base,trust_remote_code=True,device_map="auto" --tasks sciq,piqa --output_path ./results_Echo-DSRN-114M-Base --batch_size 16 --num_fewshot 5
| Tasks | Version | Filter | n-shot | Metric | Value | Stderr | ||
|---|---|---|---|---|---|---|---|---|
| piqa | 1 | none | 5 | acc | ↑ | 0.6055 | ± | 0.0114 |
| none | 5 | acc_norm | ↑ | 0.6012 | ± | 0.0114 | ||
| sciq | 1 | none | 5 | acc | ↑ | 0.6200 | ± | 0.0154 |
| none | 5 | acc_norm | ↑ | 0.5480 | ± | 0.0157 |
uv run lm_eval --model hf --model_args pretrained=ethicalabs/Echo-DSRN-114M-Base,trust_remote_code=True,device_map="auto" --tasks sciq,piqa --output_path ./results_Echo-DSRN-114M-Base --batch_size 16 --num_fewshot 5 && uv run lm_eval --model hf --model_args pretrained=ethicalabs/Echo-DSRN-114M-Base,trust_remote_code=True,device_map="auto" --tasks sciq,piqa --output_path ./results_Echo-DSRN-114M-Base --batch_size 16 --num_fewshot 10
| Tasks | Version | Filter | n-shot | Metric | Value | Stderr | ||
|---|---|---|---|---|---|---|---|---|
| piqa | 1 | none | 10 | acc | ↑ | 0.6083 | ± | 0.0114 |
| none | 10 | acc_norm | ↑ | 0.6066 | ± | 0.0114 | ||
| sciq | 1 | none | 10 | acc | ↑ | 0.6150 | ± | 0.0154 |
| none | 10 | acc_norm | ↑ | 0.5600 | ± | 0.0157 |
Gradio App - Next Word Prediction
Runs of ethicalabs Echo-DSRN-114M-Base on huggingface.co
28
Total runs
-3
24-hour runs
-3
3-day runs
-2
7-day runs
16
30-day runs
More Information About Echo-DSRN-114M-Base huggingface.co Model
Url of Echo-DSRN-114M-Base
Echo-DSRN-114M-Base huggingface.co Url
Provider of Echo-DSRN-114M-Base huggingface.co
Other API from ethicalabs
Updated:August 23 2026
Total runs:
245
Run Growth:
-703
Growth Rate:
-286.94%
Total runs:
189
Run Growth:
-1.6K
Growth Rate:
-850.79%
Total runs:
174
Run Growth:
-242
Growth Rate:
-139.08%
Total runs:
124
Run Growth:
-342
Growth Rate:
-275.81%
Total runs:
116
Run Growth:
-569
Growth Rate:
-490.52%
Total runs:
60
Run Growth:
0
Growth Rate:
0.00%
Total runs:
56
Run Growth:
40
Growth Rate:
72.73%
Total runs:
53
Run Growth:
-491
Growth Rate:
-926.42%
Total runs:
53
Run Growth:
-228
Growth Rate:
-430.19%
Total runs:
48
Run Growth:
-11
Growth Rate:
-23.40%
Total runs:
42
Run Growth:
18
Growth Rate:
41.86%
Total runs:
42
Run Growth:
-46
Growth Rate:
-109.52%
Total runs:
42
Run Growth:
24
Growth Rate:
60.00%
Total runs:
40
Run Growth:
1
Growth Rate:
2.50%
Total runs:
39
Run Growth:
26
Growth Rate:
70.27%
Total runs:
35
Run Growth:
-47
Growth Rate:
-134.29%
Total runs:
35
Run Growth:
26
Growth Rate:
76.47%
Total runs:
33
Run Growth:
19
Growth Rate:
57.58%
Total runs:
33
Run Growth:
12
Growth Rate:
36.36%
Total runs:
32
Run Growth:
28
Growth Rate:
87.50%
Total runs:
31
Run Growth:
16
Growth Rate:
51.61%
Total runs:
31
Run Growth:
12
Growth Rate:
38.71%
Total runs:
31
Run Growth:
10
Growth Rate:
31.25%
Total runs:
26
Run Growth:
14
Growth Rate:
53.85%
Total runs:
26
Run Growth:
21
Growth Rate:
84.00%
Total runs:
25
Run Growth:
-66
Growth Rate:
-264.00%
Total runs:
24
Run Growth:
7
Growth Rate:
28.00%
Total runs:
24
Run Growth:
18
Growth Rate:
90.00%
Total runs:
23
Run Growth:
13
Growth Rate:
54.17%
Total runs:
23
Run Growth:
5
Growth Rate:
21.74%
Total runs:
22
Run Growth:
20
Growth Rate:
95.24%
Total runs:
21
Run Growth:
17
Growth Rate:
80.95%
Total runs:
21
Run Growth:
9
Growth Rate:
42.86%
Total runs:
21
Run Growth:
-29
Growth Rate:
-138.10%
Total runs:
21
Run Growth:
15
Growth Rate:
68.18%
Total runs:
20
Run Growth:
14
Growth Rate:
70.00%
Total runs:
20
Run Growth:
9
Growth Rate:
45.00%
Total runs:
20
Run Growth:
-6
Growth Rate:
-31.58%
Total runs:
19
Run Growth:
-1
Growth Rate:
-5.56%
Total runs:
19
Run Growth:
4
Growth Rate:
21.05%
Total runs:
19
Run Growth:
15
Growth Rate:
78.95%
Total runs:
19
Run Growth:
8
Growth Rate:
44.44%
Total runs:
19
Run Growth:
6
Growth Rate:
30.00%
Total runs:
19
Run Growth:
11
Growth Rate:
57.89%
Total runs:
18
Run Growth:
1
Growth Rate:
5.56%
Total runs:
18
Run Growth:
3
Growth Rate:
16.67%
Total runs:
18
Run Growth:
14
Growth Rate:
77.78%
Total runs:
18
Run Growth:
12
Growth Rate:
66.67%
Total runs:
18
Run Growth:
7
Growth Rate:
38.89%
Total runs:
18
Run Growth:
9
Growth Rate:
50.00%
Total runs:
16
Run Growth:
11
Growth Rate:
68.75%
Total runs:
16
Run Growth:
11
Growth Rate:
68.75%
Total runs:
16
Run Growth:
14
Growth Rate:
87.50%
Total runs:
16
Run Growth:
13
Growth Rate:
81.25%
Total runs:
16
Run Growth:
14
Growth Rate:
87.50%
Total runs:
16
Run Growth:
11
Growth Rate:
68.75%
Total runs:
16
Run Growth:
10
Growth Rate:
62.50%
Total runs:
15
Run Growth:
9
Growth Rate:
60.00%
Total runs:
15
Run Growth:
0
Growth Rate:
0.00%
Total runs:
15
Run Growth:
13
Growth Rate:
86.67%
Total runs:
15
Run Growth:
7
Growth Rate:
46.67%
Total runs:
14
Run Growth:
8
Growth Rate:
57.14%
Total runs:
14
Run Growth:
8
Growth Rate:
57.14%
Total runs:
13
Run Growth:
12
Growth Rate:
92.31%
Total runs:
12
Run Growth:
-3
Growth Rate:
-23.08%
Total runs:
12
Run Growth:
0
Growth Rate:
0.00%
Total runs:
12
Run Growth:
-16
Growth Rate:
-133.33%
Total runs:
11
Run Growth:
9
Growth Rate:
90.00%
Total runs:
11
Run Growth:
8
Growth Rate:
72.73%
Total runs:
11
Run Growth:
7
Growth Rate:
70.00%
Total runs:
11
Run Growth:
1
Growth Rate:
9.09%
Total runs:
11
Run Growth:
7
Growth Rate:
70.00%
Total runs:
11
Run Growth:
7
Growth Rate:
63.64%
Total runs:
10
Run Growth:
0
Growth Rate:
0.00%
Total runs:
10
Run Growth:
6
Growth Rate:
60.00%
Total runs:
10
Run Growth:
9
Growth Rate:
90.00%
Total runs:
10
Run Growth:
2
Growth Rate:
20.00%
Total runs:
9
Run Growth:
9
Growth Rate:
100.00%
Total runs:
9
Run Growth:
8
Growth Rate:
88.89%
Total runs:
8
Run Growth:
5
Growth Rate:
62.50%
Total runs:
8
Run Growth:
5
Growth Rate:
62.50%
Total runs:
8
Run Growth:
0
Growth Rate:
0.00%
Total runs:
6
Run Growth:
-1
Growth Rate:
-20.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%