Total runs:
2.3K
Run Growth:
-2.6K
Growth Rate:
-113.99%
Sponsored by
Vmake Labs Video Enhancer
pszemraj / long-t5-tglobal-base-sci-simplify
Model's Last Updated: December 29 2025
summarization
Introduction of long-t5-tglobal-base-sci-simplify
Model Details of long-t5-tglobal-base-sci-simplify
long-t5-tglobal-base-sci-simplify
Exploring how well long-document models trained on "lay summaries" of scientific papers generalize.
A lay summary is a summary of a research paper or scientific study that is written in plain language, without the use of technical jargon, and is designed to be easily understood by non-experts.
Model description
This model is a fine-tuned version of
google/long-t5-tglobal-base
on the
pszemraj/scientific_lay_summarisation-plos-norm
dataset for two epochs.
- The variant trained on the ELIFE subset can be found here
Usage
It's recommended to use this model with
beam search decoding
. If you are interested, you can also use the
textsum
util repo to have most of this abstracted for you:
Install with
pip
:
pip install -U textsum
Use in python:
from textsum.summarize import Summarizer
summarizer = Summarizer('pszemraj/long-t5-tglobal-base-sci-simplify')
text = "put the text you don't want to read here"
summary = summarizer.summarize_string(text)
print(summary)
Intended uses & limitations
- Ability to generalize outside of the dataset domain (pubmed/bioscience type papers) has to be evaluated.
Training procedure
Eval results
It achieves the following results on the evaluation set:
- Loss: 1.6778
- Rouge1: 49.1475
- Rouge2: 18.9281
- Rougel: 26.9893
- Rougelsum: 45.0973
- Gen Len: 399.4125
Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 0.0004
- train_batch_size: 4
- eval_batch_size: 2
- seed: 42
- distributed_type: multi-GPU
- gradient_accumulation_steps: 16
- total_train_batch_size: 64
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: cosine
- lr_scheduler_warmup_ratio: 0.01
- num_epochs: 2.0
Training results
| Training Loss | Epoch | Step | Validation Loss | Rouge1 | Rouge2 | Rougel | Rougelsum | Gen Len |
|---|---|---|---|---|---|---|---|---|
| 1.966 | 0.52 | 200 | 1.7171 | 48.6521 | 18.427 | 26.7726 | 44.3947 | 376.335 |
| 1.877 | 1.03 | 400 | 1.6909 | 49.3263 | 18.7945 | 27.0741 | 45.1737 | 382.205 |
| 1.9007 | 1.55 | 600 | 1.6778 | 49.1475 | 18.9281 | 26.9893 | 45.0973 | 399.4125 |
Runs of pszemraj long-t5-tglobal-base-sci-simplify on huggingface.co
70
Total runs
0
24-hour runs
0
3-day runs
-8
7-day runs
20
30-day runs
More Information About long-t5-tglobal-base-sci-simplify huggingface.co Model
Url of long-t5-tglobal-base-sci-simplify
long-t5-tglobal-base-sci-simplify huggingface.co Url
Provider of long-t5-tglobal-base-sci-simplify huggingface.co
Other API from pszemraj
Updated:December 29 2025
Total runs:
1.9K
Run Growth:
-237
Growth Rate:
-11.73%
Total runs:
1.2K
Run Growth:
-25.8K
Growth Rate:
-2174.62%
Total runs:
1.0K
Run Growth:
-895
Growth Rate:
-93.52%
Total runs:
697
Run Growth:
-206
Growth Rate:
-29.56%
Total runs:
670
Run Growth:
-230
Growth Rate:
-34.33%
Total runs:
669
Run Growth:
-205
Growth Rate:
-30.64%
Total runs:
665
Run Growth:
-233
Growth Rate:
-35.04%
Total runs:
648
Run Growth:
-266
Growth Rate:
-41.05%
Total runs:
516
Run Growth:
388
Growth Rate:
77.29%
Total runs:
442
Run Growth:
75
Growth Rate:
17.36%
Total runs:
423
Run Growth:
-499
Growth Rate:
-117.97%
Total runs:
272
Run Growth:
145
Growth Rate:
54.92%
Total runs:
237
Run Growth:
192
Growth Rate:
83.84%
Total runs:
231
Run Growth:
-257
Growth Rate:
-111.26%
Total runs:
217
Run Growth:
31
Growth Rate:
14.35%
Total runs:
140
Run Growth:
120
Growth Rate:
85.71%
Total runs:
117
Run Growth:
-208
Growth Rate:
-176.27%
Total runs:
114
Run Growth:
2
Growth Rate:
1.75%
Total runs:
107
Run Growth:
33
Growth Rate:
31.73%
Total runs:
91
Run Growth:
0
Growth Rate:
0.00%
Total runs:
88
Run Growth:
68
Growth Rate:
77.27%
Total runs:
86
Run Growth:
44
Growth Rate:
51.16%
Total runs:
85
Run Growth:
8
Growth Rate:
9.41%
Total runs:
82
Run Growth:
52
Growth Rate:
65.00%
Total runs:
74
Run Growth:
16
Growth Rate:
21.62%
Total runs:
73
Run Growth:
65
Growth Rate:
89.04%
Total runs:
71
Run Growth:
51
Growth Rate:
71.83%
Total runs:
71
Run Growth:
48
Growth Rate:
71.64%
Total runs:
68
Run Growth:
28
Growth Rate:
41.18%
Total runs:
67
Run Growth:
34
Growth Rate:
50.75%
Total runs:
61
Run Growth:
33
Growth Rate:
54.10%
Total runs:
60
Run Growth:
21
Growth Rate:
38.89%
Total runs:
59
Run Growth:
18
Growth Rate:
30.51%
Total runs:
55
Run Growth:
16
Growth Rate:
29.09%
Total runs:
55
Run Growth:
23
Growth Rate:
44.23%
Total runs:
54
Run Growth:
42
Growth Rate:
77.78%
Total runs:
54
Run Growth:
8
Growth Rate:
14.81%
Total runs:
51
Run Growth:
21
Growth Rate:
42.00%
Total runs:
49
Run Growth:
27
Growth Rate:
56.25%
Total runs:
47
Run Growth:
36
Growth Rate:
76.60%
Total runs:
45
Run Growth:
21
Growth Rate:
46.67%
Total runs:
45
Run Growth:
15
Growth Rate:
34.09%
Total runs:
44
Run Growth:
23
Growth Rate:
52.27%
Total runs:
43
Run Growth:
30
Growth Rate:
66.67%
Total runs:
43
Run Growth:
-16
Growth Rate:
-37.21%
Total runs:
42
Run Growth:
32
Growth Rate:
74.42%
Total runs:
42
Run Growth:
25
Growth Rate:
59.52%
Total runs:
41
Run Growth:
24
Growth Rate:
58.54%
Total runs:
40
Run Growth:
26
Growth Rate:
65.00%
Total runs:
40
Run Growth:
14
Growth Rate:
35.00%
Total runs:
39
Run Growth:
9
Growth Rate:
24.32%
Total runs:
37
Run Growth:
17
Growth Rate:
47.22%
Total runs:
37
Run Growth:
22
Growth Rate:
59.46%
Total runs:
36
Run Growth:
18
Growth Rate:
50.00%
Total runs:
36
Run Growth:
25
Growth Rate:
69.44%
Total runs:
36
Run Growth:
18
Growth Rate:
50.00%
Total runs:
34
Run Growth:
15
Growth Rate:
45.45%
Total runs:
33
Run Growth:
20
Growth Rate:
57.14%
Total runs:
33
Run Growth:
26
Growth Rate:
72.22%
Total runs:
33
Run Growth:
31
Growth Rate:
93.94%
Total runs:
32
Run Growth:
17
Growth Rate:
51.52%
Total runs:
31
Run Growth:
15
Growth Rate:
48.39%
Total runs:
31
Run Growth:
10
Growth Rate:
34.48%
Total runs:
30
Run Growth:
22
Growth Rate:
73.33%
Total runs:
30
Run Growth:
23
Growth Rate:
76.67%
Total runs:
28
Run Growth:
28
Growth Rate:
100.00%
Total runs:
28
Run Growth:
15
Growth Rate:
55.56%
Total runs:
28
Run Growth:
11
Growth Rate:
39.29%
Total runs:
27
Run Growth:
-5
Growth Rate:
-18.52%
Total runs:
27
Run Growth:
15
Growth Rate:
55.56%
Total runs:
25
Run Growth:
12
Growth Rate:
42.86%
Total runs:
24
Run Growth:
13
Growth Rate:
50.00%
Total runs:
23
Run Growth:
13
Growth Rate:
56.52%
Total runs:
23
Run Growth:
9
Growth Rate:
39.13%
Total runs:
23
Run Growth:
14
Growth Rate:
60.87%
Total runs:
23
Run Growth:
15
Growth Rate:
65.22%
Total runs:
22
Run Growth:
14
Growth Rate:
60.87%
Total runs:
22
Run Growth:
6
Growth Rate:
26.09%
Total runs:
22
Run Growth:
1
Growth Rate:
4.76%
Total runs:
22
Run Growth:
3
Growth Rate:
13.64%
Total runs:
22
Run Growth:
6
Growth Rate:
26.09%
Total runs:
21
Run Growth:
8
Growth Rate:
38.10%
Total runs:
21
Run Growth:
5
Growth Rate:
25.00%
Total runs:
21
Run Growth:
13
Growth Rate:
61.90%
Total runs:
20
Run Growth:
8
Growth Rate:
40.00%
Total runs:
20
Run Growth:
9
Growth Rate:
52.94%
Total runs:
20
Run Growth:
11
Growth Rate:
57.89%
Total runs:
20
Run Growth:
10
Growth Rate:
50.00%
Total runs:
19
Run Growth:
16
Growth Rate:
84.21%
Total runs:
19
Run Growth:
9
Growth Rate:
47.37%
Total runs:
18
Run Growth:
5
Growth Rate:
27.78%
Total runs:
18
Run Growth:
-13
Growth Rate:
-72.22%
Total runs:
18
Run Growth:
2
Growth Rate:
11.76%
Total runs:
18
Run Growth:
6
Growth Rate:
28.57%
Total runs:
18
Run Growth:
5
Growth Rate:
23.81%
Total runs:
18
Run Growth:
11
Growth Rate:
61.11%