Total runs:
345.6K
Run Growth:
166.8K
Growth Rate:
47.55%
Sponsored by
YouArt
mrm8488 / t5-base-finetuned-common_gen
Model's Last Updated: March 17 2023
text-generation
Introduction of t5-base-finetuned-common_gen
Model Details of t5-base-finetuned-common_gen
T5-base fine-tuned on CommonGen
Google's T5 fine-tuned on CommonGen for Generative Commonsense Reasoning .
Details of T5
The T5 model was presented in Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer by Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, Peter J. Liu in Here the abstract:
Transfer learning, where a model is first pre-trained on a data-rich task before being fine-tuned on a downstream task, has emerged as a powerful technique in natural language processing (NLP). The effectiveness of transfer learning has given rise to a diversity of approaches, methodology, and practice. In this paper, we explore the landscape of transfer learning techniques for NLP by introducing a unified framework that converts every language problem into a text-to-text format. Our systematic study compares pre-training objectives, architectures, unlabeled datasets, transfer approaches, and other factors on dozens of language understanding tasks. By combining the insights from our exploration with scale and our new “Colossal Clean Crawled Corpus”, we achieve state-of-the-art results on many benchmarks covering summarization, question answering, text classification, and more. To facilitate future work on transfer learning for NLP, we release our dataset, pre-trained models, and code.
Details of the dataset 📚
CommonGen is a constrained text generation task, associated with a benchmark dataset, to explicitly test machines for the ability of generative commonsense reasoning. Given a set of common concepts; the task is to generate a coherent sentence describing an everyday scenario using these concepts.
CommonGen is challenging because it inherently requires 1) relational reasoning using background commonsense knowledge, and 2) compositional generalization ability to work on unseen concept combinations. Our dataset, constructed through a combination of crowd-sourcing from AMT and existing caption corpora, consists of 30k concept-sets and 50k sentences in total.
| Dataset | Split | # samples |
|---|---|---|
| common_gen | train | 67389 |
| common_gen | valid | 4018 |
| common_gen | test | 1497 |
Model fine-tuning 🏋️
The training script is a slightly modified version of this awesome one by Suraj Patil
Metrics 📋
| Metric | Score |
|---|---|
| ROUGE-2 | 17.10 |
| ROUGE-L | 39.47 |
| BLEU | WIP |
The metrics above slightly improves results shown in the paper for the same model and metrics.
Model in Action 🚀
from transformers import AutoModelWithLMHead, AutoTokenizer
tokenizer = AutoTokenizer.from_pretrained("mrm8488/t5-base-finetuned-common_gen")
model = AutoModelWithLMHead.from_pretrained("mrm8488/t5-base-finetuned-common_gen")
def gen_sentence(words, max_length=32):
input_text = words
features = tokenizer([input_text], return_tensors='pt')
output = model.generate(input_ids=features['input_ids'],
attention_mask=features['attention_mask'],
max_length=max_length)
return tokenizer.decode(output[0], skip_special_tokens=True)
words = "tree plant ground hole dig"
gen_sentence(words)
# output: digging a hole in the ground to plant trees
Created by Manuel Romero/@mrm8488 | LinkedIn
Made with ♥ in Spain
Runs of mrm8488 t5-base-finetuned-common_gen on huggingface.co
310
Total runs
0
24-hour runs
12
3-day runs
47
7-day runs
-326
30-day runs
More Information About t5-base-finetuned-common_gen huggingface.co Model
Url of t5-base-finetuned-common_gen
t5-base-finetuned-common_gen huggingface.co Url
Provider of t5-base-finetuned-common_gen huggingface.co
Other API from mrm8488
Updated:January 21 2024
Total runs:
32.3K
Run Growth:
320
Growth Rate:
0.99%
Total runs:
16.5K
Run Growth:
-62.5K
Growth Rate:
-378.74%
Total runs:
13.4K
Run Growth:
1.8K
Growth Rate:
13.31%
Total runs:
12.1K
Run Growth:
5.5K
Growth Rate:
45.47%
Total runs:
9.5K
Run Growth:
4.9K
Growth Rate:
50.91%
Total runs:
8.7K
Run Growth:
5.7K
Growth Rate:
65.22%
Total runs:
8.1K
Run Growth:
6.0K
Growth Rate:
72.75%
Total runs:
5.9K
Run Growth:
150
Growth Rate:
2.54%
Total runs:
4.6K
Run Growth:
-34.4K
Growth Rate:
-746.66%
Total runs:
3.7K
Run Growth:
2.8K
Growth Rate:
74.19%
Total runs:
2.9K
Run Growth:
2.6K
Growth Rate:
87.56%
Total runs:
2.3K
Run Growth:
-3.1K
Growth Rate:
-136.27%
Total runs:
1.9K
Run Growth:
1.5K
Growth Rate:
77.56%
Total runs:
1.4K
Run Growth:
-1.3K
Growth Rate:
-92.30%
Total runs:
1.3K
Run Growth:
-34
Growth Rate:
-2.55%
Total runs:
967
Run Growth:
374
Growth Rate:
38.68%
Total runs:
960
Run Growth:
-1.0K
Growth Rate:
-105.21%
Total runs:
821
Run Growth:
284
Growth Rate:
34.59%
Total runs:
814
Run Growth:
-101
Growth Rate:
-12.41%
Total runs:
744
Run Growth:
-111
Growth Rate:
-14.92%
Total runs:
734
Run Growth:
-94
Growth Rate:
-12.81%
Total runs:
682
Run Growth:
335
Growth Rate:
49.12%
Total runs:
542
Run Growth:
66
Growth Rate:
12.18%
Total runs:
506
Run Growth:
57
Growth Rate:
10.69%
Total runs:
467
Run Growth:
404
Growth Rate:
86.51%
Total runs:
464
Run Growth:
366
Growth Rate:
78.88%
Total runs:
452
Run Growth:
-357
Growth Rate:
-78.98%
Total runs:
378
Run Growth:
75
Growth Rate:
19.84%
Total runs:
366
Run Growth:
57
Growth Rate:
15.57%
Total runs:
344
Run Growth:
169
Growth Rate:
49.13%
Total runs:
326
Run Growth:
88
Growth Rate:
26.99%
Total runs:
300
Run Growth:
-48
Growth Rate:
-16.00%
Total runs:
269
Run Growth:
24
Growth Rate:
8.92%
Total runs:
260
Run Growth:
255
Growth Rate:
98.08%
Total runs:
255
Run Growth:
177
Growth Rate:
69.69%
Total runs:
250
Run Growth:
-122
Growth Rate:
-48.80%
Total runs:
242
Run Growth:
-17
Growth Rate:
-7.02%
Total runs:
227
Run Growth:
-197
Growth Rate:
-86.78%
Total runs:
205
Run Growth:
47
Growth Rate:
22.93%
Total runs:
182
Run Growth:
-38
Growth Rate:
-20.88%
Total runs:
165
Run Growth:
-117
Growth Rate:
-70.91%
Total runs:
164
Run Growth:
-81
Growth Rate:
-49.39%
Total runs:
162
Run Growth:
107
Growth Rate:
66.05%
Total runs:
160
Run Growth:
130
Growth Rate:
81.25%
Total runs:
154
Run Growth:
120
Growth Rate:
77.92%
Total runs:
148
Run Growth:
75
Growth Rate:
51.72%
Total runs:
125
Run Growth:
100
Growth Rate:
81.97%
Total runs:
119
Run Growth:
114
Growth Rate:
95.80%
Total runs:
164
Run Growth:
-11
Growth Rate:
-9.24%
Total runs:
116
Run Growth:
38
Growth Rate:
32.76%
Total runs:
116
Run Growth:
33
Growth Rate:
28.70%
Total runs:
112
Run Growth:
40
Growth Rate:
35.71%
Total runs:
110
Run Growth:
96
Growth Rate:
87.27%
Total runs:
95
Run Growth:
91
Growth Rate:
95.79%
Total runs:
94
Run Growth:
-12
Growth Rate:
-12.77%
Total runs:
92
Run Growth:
68
Growth Rate:
73.91%
Total runs:
92
Run Growth:
-31
Growth Rate:
-33.70%
Total runs:
92
Run Growth:
-33
Growth Rate:
-35.87%
Total runs:
86
Run Growth:
-123
Growth Rate:
-143.02%
Total runs:
85
Run Growth:
77
Growth Rate:
90.59%
Total runs:
84
Run Growth:
-23
Growth Rate:
-27.38%
Total runs:
83
Run Growth:
59
Growth Rate:
71.08%
Total runs:
82
Run Growth:
-40
Growth Rate:
-48.78%
Total runs:
82
Run Growth:
57
Growth Rate:
69.51%
Total runs:
81
Run Growth:
73
Growth Rate:
90.12%
Total runs:
81
Run Growth:
-4
Growth Rate:
-4.94%
Total runs:
80
Run Growth:
-15
Growth Rate:
-18.75%
Total runs:
78
Run Growth:
74
Growth Rate:
94.87%
Total runs:
76
Run Growth:
47
Growth Rate:
61.84%
Total runs:
73
Run Growth:
31
Growth Rate:
42.47%
Total runs:
70
Run Growth:
49
Growth Rate:
70.00%
Total runs:
69
Run Growth:
45
Growth Rate:
65.22%
Total runs:
66
Run Growth:
-8
Growth Rate:
-12.12%
Total runs:
62
Run Growth:
23
Growth Rate:
37.10%
Total runs:
60
Run Growth:
44
Growth Rate:
73.33%
Total runs:
59
Run Growth:
-11
Growth Rate:
-18.64%
Total runs:
59
Run Growth:
35
Growth Rate:
62.50%
Total runs:
56
Run Growth:
52
Growth Rate:
92.86%
Total runs:
55
Run Growth:
47
Growth Rate:
85.45%
Total runs:
53
Run Growth:
49
Growth Rate:
92.45%
Total runs:
51
Run Growth:
32
Growth Rate:
62.75%
Total runs:
51
Run Growth:
-279
Growth Rate:
-547.06%
Total runs:
50
Run Growth:
40
Growth Rate:
80.00%
Total runs:
49
Run Growth:
12
Growth Rate:
24.49%
Total runs:
49
Run Growth:
19
Growth Rate:
38.78%
Total runs:
48
Run Growth:
-2
Growth Rate:
-4.17%
Total runs:
47
Run Growth:
46
Growth Rate:
97.87%
Total runs:
46
Run Growth:
38
Growth Rate:
82.61%
Total runs:
46
Run Growth:
32
Growth Rate:
69.57%
Total runs:
45
Run Growth:
7
Growth Rate:
15.56%
Total runs:
44
Run Growth:
9
Growth Rate:
20.45%
Total runs:
42
Run Growth:
42
Growth Rate:
95.45%