Total runs:
779
Run Growth:
-152
Growth Rate:
-19.51%
Sponsored by
APIMaster
ethicalabs / Echo-DSRN-v0.1.4-Research-Intent-CLF
Model's Last Updated: August 31 2026
text-classification
Introduction of Echo-DSRN-v0.1.4-Research-Intent-CLF
Model Details of Echo-DSRN-v0.1.4-Research-Intent-CLF
Model Card for ethicalabs/Echo-DSRN-v0.1.4-Research-Intent-CLF
6-class research paper intent classifier built on the Echo-DSRN architecture (98.3M params), fine-tuned from
ethicalabs/Echo-DSRN-v0.1.3-Research-Intent-CLF
(5-class).
Labels: Methodology · Dataset · Review · Applied · Theoretical · Unclassifiable
The
Unclassifiable
class is new in v0.1.4 — papers flagged by >1 LLM judge as garbled / non-English / non-academic.
Training
-
Data:
ethicalabs/Research-Intent-Collab(10,001 papers, LLM-judge majority consensus + human curation). Officialtrain(7,999) /validation(1,001) /test(1,001) splits. -
Recipe:
head swap 5→6, differential AdamW (backbone
2e-5, head2e-4), batch 16, 3 epochs (1,500 steps), bf16, cosine LR + 5% warmup, early stopping on the official validation split.
Results (official
test
split, 1,001 rows)
| Label | Precision | Recall | F1 | Support |
|---|---|---|---|---|
| Methodology | 0.8140 | 0.7883 | 0.8009 | 222 |
| Dataset | 0.7097 | 1.0000 | 0.8302 | 22 |
| Review | 0.6400 | 0.5845 | 0.6110 | 219 |
| Applied | 0.7162 | 0.8112 | 0.7608 | 392 |
| Theoretical | 0.7333 | 0.7500 | 0.7416 | 44 |
| Unclassifiable | 0.9091 | 0.5882 | 0.7143 | 102 |
| Macro avg | 0.7537 | 0.7537 | 0.7431 | 1001 |
Accuracy: 0.7353 (736/1001).
Comparison with v0.1.3 (same official
test
split)
v0.1.3 (5-class) evaluates on 899 rows only — its head cannot produce
Unclassifiable
, so all 102 such test rows would be misclassified.
v0.1.4 covers all 1,001 rows and catches 60 of the 102 with 91% precision.
| Metric | v0.1.3 (5-class) | v0.1.4 (6-class) |
|---|---|---|
| Accuracy, all evaluated rows | 0.7197 (647/899) | 0.7353 (736/1001) |
| Accuracy, 5-class subset | 0.7197 (647/899) | 0.7519 (676/899) |
| Macro F1, 5-class subset | 0.7328 | 0.7489 |
| Macro F1, all 6 classes | — | 0.7431 |
| Unclassifiable | — (all 102 misclassified) | F1 0.7143 (P 0.909) |
Per-class F1 (test split):
| Label | v0.1.3 | v0.1.4 | Δ |
|---|---|---|---|
| Methodology | 0.7563 | 0.8009 | +0.045 |
| Dataset | 0.8627 | 0.8302 | −0.033 |
| Review | 0.5876 | 0.6110 | +0.023 |
| Applied | 0.7524 | 0.7608 | +0.008 |
| Theoretical | 0.7048 | 0.7416 | +0.037 |
| Unclassifiable | — | 0.7143 | new |
v0.1.4 gains accuracy on the original classes (+3.2 pts on the 5-class subset) and adds the
Unclassifiable
safety class.
Review remains the weakest class for both models (mostly confused with Applied).
Usage
from echo_dsrn import pipeline
# Requires echo_dsrn >= 0.1.6 (chat-template support for
# text-classification pipelines). Tiny model — CPU load + inference
# is faster than GPU for this size.
pipe = pipeline(
"text-classification",
model="ethicalabs/Echo-DSRN-v0.1.4-Research-Intent-CLF",
trust_remote_code=True,
device="cpu",
)
# Raw title+abstract string — the pipeline applies the model's chat
# template (system prompt + user phrasing) automatically.
pipe(
"Title: Attention Is All You Need\n"
"Abstract: The dominant sequence transduction models are based on complex "
"recurrent or convolutional neural networks that include an encoder and a "
"decoder. The best performing models also connect the encoder and decoder "
"through an attention mechanism. We propose a new simple network "
"architecture, the Transformer, based solely on attention mechanisms, "
"dispensing with recurrence and convolutions entirely. Experiments on two "
"machine translation tasks show these models to be superior in quality "
"while being more parallelizable and requiring significantly less time to "
"train. Our model achieves 28.4 BLEU on the WMT 2014 English-to-German "
"translation task, improving over the existing best results, including "
"ensembles, by over 2 BLEU."
)
# [{'label': 'Methodology', 'score': 0.9518}]
Made in 🇪🇺 with 💗 for Open Science 🤗 - github.com/ethicalabs-ai/OpenAIRE-AI-Research-Evaluator
Runs of ethicalabs Echo-DSRN-v0.1.4-Research-Intent-CLF on huggingface.co
124
Total runs
1
24-hour runs
3
3-day runs
-56
7-day runs
-342
30-day runs
More Information About Echo-DSRN-v0.1.4-Research-Intent-CLF huggingface.co Model
Url of Echo-DSRN-v0.1.4-Research-Intent-CLF
Echo-DSRN-v0.1.4-Research-Intent-CLF huggingface.co Url
Provider of Echo-DSRN-v0.1.4-Research-Intent-CLF huggingface.co
Other API from ethicalabs
Updated:August 23 2026
Total runs:
245
Run Growth:
-703
Growth Rate:
-286.94%
Total runs:
189
Run Growth:
-1.6K
Growth Rate:
-850.79%
Total runs:
174
Run Growth:
-242
Growth Rate:
-139.08%
Total runs:
116
Run Growth:
-569
Growth Rate:
-490.52%
Total runs:
60
Run Growth:
0
Growth Rate:
0.00%
Total runs:
56
Run Growth:
40
Growth Rate:
72.73%
Total runs:
53
Run Growth:
-491
Growth Rate:
-926.42%
Total runs:
53
Run Growth:
-228
Growth Rate:
-430.19%
Total runs:
48
Run Growth:
-11
Growth Rate:
-23.40%
Total runs:
42
Run Growth:
18
Growth Rate:
41.86%
Total runs:
42
Run Growth:
-46
Growth Rate:
-109.52%
Total runs:
42
Run Growth:
24
Growth Rate:
60.00%
Total runs:
40
Run Growth:
1
Growth Rate:
2.50%
Total runs:
39
Run Growth:
26
Growth Rate:
70.27%
Total runs:
35
Run Growth:
-47
Growth Rate:
-134.29%
Total runs:
35
Run Growth:
26
Growth Rate:
76.47%
Total runs:
33
Run Growth:
19
Growth Rate:
57.58%
Total runs:
33
Run Growth:
12
Growth Rate:
36.36%
Total runs:
32
Run Growth:
28
Growth Rate:
87.50%
Total runs:
31
Run Growth:
16
Growth Rate:
51.61%
Total runs:
31
Run Growth:
12
Growth Rate:
38.71%
Total runs:
31
Run Growth:
10
Growth Rate:
31.25%
Total runs:
28
Run Growth:
16
Growth Rate:
57.14%
Total runs:
26
Run Growth:
14
Growth Rate:
53.85%
Total runs:
26
Run Growth:
21
Growth Rate:
84.00%
Total runs:
25
Run Growth:
-66
Growth Rate:
-264.00%
Total runs:
24
Run Growth:
7
Growth Rate:
28.00%
Total runs:
24
Run Growth:
18
Growth Rate:
90.00%
Total runs:
23
Run Growth:
13
Growth Rate:
54.17%
Total runs:
23
Run Growth:
5
Growth Rate:
21.74%
Total runs:
22
Run Growth:
20
Growth Rate:
95.24%
Total runs:
21
Run Growth:
17
Growth Rate:
80.95%
Total runs:
21
Run Growth:
9
Growth Rate:
42.86%
Total runs:
21
Run Growth:
-29
Growth Rate:
-138.10%
Total runs:
21
Run Growth:
15
Growth Rate:
68.18%
Total runs:
20
Run Growth:
14
Growth Rate:
70.00%
Total runs:
20
Run Growth:
9
Growth Rate:
45.00%
Total runs:
20
Run Growth:
-6
Growth Rate:
-31.58%
Total runs:
19
Run Growth:
-1
Growth Rate:
-5.56%
Total runs:
19
Run Growth:
4
Growth Rate:
21.05%
Total runs:
19
Run Growth:
15
Growth Rate:
78.95%
Total runs:
19
Run Growth:
8
Growth Rate:
44.44%
Total runs:
19
Run Growth:
6
Growth Rate:
30.00%
Total runs:
19
Run Growth:
11
Growth Rate:
57.89%
Total runs:
18
Run Growth:
1
Growth Rate:
5.56%
Total runs:
18
Run Growth:
3
Growth Rate:
16.67%
Total runs:
18
Run Growth:
14
Growth Rate:
77.78%
Total runs:
18
Run Growth:
12
Growth Rate:
66.67%
Total runs:
18
Run Growth:
7
Growth Rate:
38.89%
Total runs:
18
Run Growth:
9
Growth Rate:
50.00%
Total runs:
16
Run Growth:
11
Growth Rate:
68.75%
Total runs:
16
Run Growth:
11
Growth Rate:
68.75%
Total runs:
16
Run Growth:
14
Growth Rate:
87.50%
Total runs:
16
Run Growth:
13
Growth Rate:
81.25%
Total runs:
16
Run Growth:
14
Growth Rate:
87.50%
Total runs:
16
Run Growth:
11
Growth Rate:
68.75%
Total runs:
16
Run Growth:
10
Growth Rate:
62.50%
Total runs:
15
Run Growth:
9
Growth Rate:
60.00%
Total runs:
15
Run Growth:
0
Growth Rate:
0.00%
Total runs:
15
Run Growth:
13
Growth Rate:
86.67%
Total runs:
15
Run Growth:
7
Growth Rate:
46.67%
Total runs:
14
Run Growth:
8
Growth Rate:
57.14%
Total runs:
14
Run Growth:
8
Growth Rate:
57.14%
Total runs:
13
Run Growth:
12
Growth Rate:
92.31%
Total runs:
12
Run Growth:
-3
Growth Rate:
-23.08%
Total runs:
12
Run Growth:
0
Growth Rate:
0.00%
Total runs:
12
Run Growth:
-16
Growth Rate:
-133.33%
Total runs:
11
Run Growth:
9
Growth Rate:
90.00%
Total runs:
11
Run Growth:
8
Growth Rate:
72.73%
Total runs:
11
Run Growth:
7
Growth Rate:
70.00%
Total runs:
11
Run Growth:
1
Growth Rate:
9.09%
Total runs:
11
Run Growth:
7
Growth Rate:
70.00%
Total runs:
11
Run Growth:
7
Growth Rate:
63.64%
Total runs:
10
Run Growth:
0
Growth Rate:
0.00%
Total runs:
10
Run Growth:
6
Growth Rate:
60.00%
Total runs:
10
Run Growth:
9
Growth Rate:
90.00%
Total runs:
10
Run Growth:
2
Growth Rate:
20.00%
Total runs:
9
Run Growth:
9
Growth Rate:
100.00%
Total runs:
9
Run Growth:
8
Growth Rate:
88.89%
Total runs:
8
Run Growth:
5
Growth Rate:
62.50%
Total runs:
8
Run Growth:
5
Growth Rate:
62.50%
Total runs:
8
Run Growth:
0
Growth Rate:
0.00%
Total runs:
6
Run Growth:
-1
Growth Rate:
-20.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%