Total runs:
345.6K
Run Growth:
166.8K
Growth Rate:
47.55%
Sponsored by
APIMart
mrm8488 / t5-small-finetuned-squadv2
Model's Last Updated: May 07 2021
text-generation
Introduction of t5-small-finetuned-squadv2
Model Details of t5-small-finetuned-squadv2
T5-small fine-tuned on SQuAD v2
Google's T5 (small) fine-tuned on SQuAD v2 for Q&A downstream task.
Details of T5
The T5 model was presented in Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer by Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, Peter J. Liu in Here the abstract:
Transfer learning, where a model is first pre-trained on a data-rich task before being fine-tuned on a downstream task, has emerged as a powerful technique in natural language processing (NLP). The effectiveness of transfer learning has given rise to a diversity of approaches, methodology, and practice. In this paper, we explore the landscape of transfer learning techniques for NLP by introducing a unified framework that converts every language problem into a text-to-text format. Our systematic study compares pre-training objectives, architectures, unlabeled datasets, transfer approaches, and other factors on dozens of language understanding tasks. By combining the insights from our exploration with scale and our new “Colossal Clean Crawled Corpus”, we achieve state-of-the-art results on many benchmarks covering summarization, question answering, text classification, and more. To facilitate future work on transfer learning for NLP, we release our dataset, pre-trained models, and code.
Details of the downstream task (Q&A) - Dataset 📚 🧐 ❓
Dataset ID:
squad_v2
from
Huggingface/NLP
| Dataset | Split | # samples |
|---|---|---|
| squad_v2 | train | 130319 |
| squad_v2 | valid | 11873 |
How to load it from nlp
train_dataset = nlp.load_dataset('squad_v2', split=nlp.Split.TRAIN)
valid_dataset = nlp.load_dataset('squad_v2', split=nlp.Split.VALIDATION)
Check out more about this dataset and others in NLP Viewer
Model fine-tuning 🏋️
The training script is a slightly modified version of this awesome one by Suraj Patil
Results 📝
| Metric | # Value |
|---|---|
| EM | 69.46 |
| F1 | 73.01 |
Model in Action 🚀
from transformers import AutoModelWithLMHead, AutoTokenizer
tokenizer = AutoTokenizer.from_pretrained("mrm8488/t5-small-finetuned-squadv2")
model = AutoModelWithLMHead.from_pretrained("mrm8488/t5-small-finetuned-squadv2")
def get_answer(question, context):
input_text = "question: %s context: %s </s>" % (question, context)
features = tokenizer([input_text], return_tensors='pt')
output = model.generate(input_ids=features['input_ids'],
attention_mask=features['attention_mask'])
return tokenizer.decode(output[0])
context = "Manuel has created RuPERTa-base (a Spanish RoBERTa) with the support of HF-Transformers and Google"
question = "Who has supported Manuel?"
get_answer(question, context)
# output: 'HF-Transformers and Google'
Created by Manuel Romero/@mrm8488 | LinkedIn
Made with ♥ in Spain
Runs of mrm8488 t5-small-finetuned-squadv2 on huggingface.co
260
Total runs
0
24-hour runs
7
3-day runs
37
7-day runs
255
30-day runs
More Information About t5-small-finetuned-squadv2 huggingface.co Model
Url of t5-small-finetuned-squadv2
t5-small-finetuned-squadv2 huggingface.co Url
Provider of t5-small-finetuned-squadv2 huggingface.co
Other API from mrm8488
Updated:January 21 2024
Total runs:
32.3K
Run Growth:
320
Growth Rate:
0.99%
Total runs:
16.5K
Run Growth:
-62.5K
Growth Rate:
-378.74%
Total runs:
13.4K
Run Growth:
1.8K
Growth Rate:
13.31%
Total runs:
9.6K
Run Growth:
5.5K
Growth Rate:
45.47%
Total runs:
9.5K
Run Growth:
4.9K
Growth Rate:
50.91%
Total runs:
8.7K
Run Growth:
5.7K
Growth Rate:
65.22%
Total runs:
8.1K
Run Growth:
6.0K
Growth Rate:
72.75%
Total runs:
5.9K
Run Growth:
150
Growth Rate:
2.54%
Total runs:
4.6K
Run Growth:
-34.4K
Growth Rate:
-746.66%
Total runs:
3.7K
Run Growth:
2.8K
Growth Rate:
74.19%
Total runs:
2.9K
Run Growth:
2.6K
Growth Rate:
87.56%
Total runs:
2.3K
Run Growth:
-3.1K
Growth Rate:
-136.27%
Total runs:
1.9K
Run Growth:
1.5K
Growth Rate:
77.56%
Total runs:
1.3K
Run Growth:
-34
Growth Rate:
-2.55%
Total runs:
1.0K
Run Growth:
-1.3K
Growth Rate:
-92.30%
Total runs:
967
Run Growth:
374
Growth Rate:
38.68%
Total runs:
960
Run Growth:
-1.0K
Growth Rate:
-105.21%
Total runs:
821
Run Growth:
284
Growth Rate:
34.59%
Total runs:
802
Run Growth:
-101
Growth Rate:
-12.41%
Total runs:
744
Run Growth:
-111
Growth Rate:
-14.92%
Total runs:
734
Run Growth:
-94
Growth Rate:
-12.81%
Total runs:
682
Run Growth:
335
Growth Rate:
49.12%
Total runs:
554
Run Growth:
66
Growth Rate:
12.18%
Total runs:
506
Run Growth:
57
Growth Rate:
10.69%
Total runs:
477
Run Growth:
404
Growth Rate:
86.51%
Total runs:
464
Run Growth:
366
Growth Rate:
78.88%
Total runs:
452
Run Growth:
-357
Growth Rate:
-78.98%
Total runs:
379
Run Growth:
75
Growth Rate:
19.84%
Total runs:
366
Run Growth:
57
Growth Rate:
15.57%
Total runs:
344
Run Growth:
169
Growth Rate:
49.13%
Total runs:
326
Run Growth:
88
Growth Rate:
26.99%
Total runs:
312
Run Growth:
-326
Growth Rate:
-105.16%
Total runs:
300
Run Growth:
-48
Growth Rate:
-16.00%
Total runs:
269
Run Growth:
24
Growth Rate:
8.92%
Total runs:
255
Run Growth:
177
Growth Rate:
69.69%
Total runs:
250
Run Growth:
-122
Growth Rate:
-48.80%
Total runs:
242
Run Growth:
-17
Growth Rate:
-7.02%
Total runs:
227
Run Growth:
-197
Growth Rate:
-86.78%
Total runs:
205
Run Growth:
47
Growth Rate:
22.93%
Total runs:
182
Run Growth:
-38
Growth Rate:
-20.88%
Total runs:
165
Run Growth:
-117
Growth Rate:
-70.91%
Total runs:
164
Run Growth:
-81
Growth Rate:
-49.39%
Total runs:
164
Run Growth:
-11
Growth Rate:
-9.24%
Total runs:
160
Run Growth:
130
Growth Rate:
81.25%
Total runs:
159
Run Growth:
107
Growth Rate:
66.05%
Total runs:
154
Run Growth:
120
Growth Rate:
77.92%
Total runs:
148
Run Growth:
75
Growth Rate:
51.72%
Total runs:
125
Run Growth:
100
Growth Rate:
81.97%
Total runs:
119
Run Growth:
114
Growth Rate:
95.80%
Total runs:
116
Run Growth:
38
Growth Rate:
32.76%
Total runs:
116
Run Growth:
33
Growth Rate:
28.70%
Total runs:
112
Run Growth:
40
Growth Rate:
35.71%
Total runs:
110
Run Growth:
96
Growth Rate:
87.27%
Total runs:
95
Run Growth:
91
Growth Rate:
95.79%
Total runs:
94
Run Growth:
-12
Growth Rate:
-12.77%
Total runs:
92
Run Growth:
68
Growth Rate:
73.91%
Total runs:
92
Run Growth:
-31
Growth Rate:
-33.70%
Total runs:
92
Run Growth:
-33
Growth Rate:
-35.87%
Total runs:
86
Run Growth:
-123
Growth Rate:
-143.02%
Total runs:
85
Run Growth:
77
Growth Rate:
90.59%
Total runs:
84
Run Growth:
-23
Growth Rate:
-27.38%
Total runs:
83
Run Growth:
59
Growth Rate:
71.08%
Total runs:
82
Run Growth:
-40
Growth Rate:
-48.78%
Total runs:
82
Run Growth:
57
Growth Rate:
69.51%
Total runs:
81
Run Growth:
73
Growth Rate:
90.12%
Total runs:
81
Run Growth:
-4
Growth Rate:
-4.94%
Total runs:
80
Run Growth:
-15
Growth Rate:
-18.75%
Total runs:
78
Run Growth:
74
Growth Rate:
94.87%
Total runs:
76
Run Growth:
47
Growth Rate:
61.84%
Total runs:
73
Run Growth:
31
Growth Rate:
42.47%
Total runs:
71
Run Growth:
45
Growth Rate:
65.22%
Total runs:
70
Run Growth:
49
Growth Rate:
70.00%
Total runs:
66
Run Growth:
-8
Growth Rate:
-12.12%
Total runs:
62
Run Growth:
23
Growth Rate:
37.10%
Total runs:
60
Run Growth:
44
Growth Rate:
73.33%
Total runs:
59
Run Growth:
-11
Growth Rate:
-18.64%
Total runs:
59
Run Growth:
35
Growth Rate:
62.50%
Total runs:
56
Run Growth:
52
Growth Rate:
92.86%
Total runs:
55
Run Growth:
47
Growth Rate:
85.45%
Total runs:
53
Run Growth:
49
Growth Rate:
92.45%
Total runs:
51
Run Growth:
32
Growth Rate:
62.75%
Total runs:
51
Run Growth:
-279
Growth Rate:
-547.06%
Total runs:
50
Run Growth:
40
Growth Rate:
80.00%
Total runs:
49
Run Growth:
12
Growth Rate:
24.49%
Total runs:
49
Run Growth:
19
Growth Rate:
38.78%
Total runs:
48
Run Growth:
-2
Growth Rate:
-4.17%
Total runs:
47
Run Growth:
46
Growth Rate:
97.87%
Total runs:
46
Run Growth:
38
Growth Rate:
82.61%
Total runs:
46
Run Growth:
32
Growth Rate:
69.57%
Total runs:
45
Run Growth:
7
Growth Rate:
15.56%
Total runs:
44
Run Growth:
9
Growth Rate:
20.45%
Total runs:
42
Run Growth:
42
Growth Rate:
95.45%