Total runs:
21.0K
Run Growth:
12.9K
Growth Rate:
62.91%
Sponsored by
Vmake Labs Video Enhancer
valhalla / electra-base-discriminator-finetuned_squadv1
Model's Last Updated: December 12 2020
question-answering
Introduction of electra-base-discriminator-finetuned_squadv1
Model Details of electra-base-discriminator-finetuned_squadv1
ELECTRA-BASE-DISCRIMINATOR finetuned on SQuADv1
This is electra-base-discriminator model finetuned on SQuADv1 dataset for for question answering task.
Model details
As mentioned in the original paper: ELECTRA is a new method for self-supervised language representation learning. It can be used to pre-train transformer networks using relatively little compute. ELECTRA models are trained to distinguish "real" input tokens vs "fake" input tokens generated by another neural network, similar to the discriminator of a GAN. At small scale, ELECTRA achieves strong results even when trained on a single GPU. At large scale, ELECTRA achieves state-of-the-art results on the SQuAD 2.0 dataset.
| Param | #Value |
|---|---|
| layers | 12 |
| hidden size | 768 |
| num attetion heads | 12 |
| on disk size | 436MB |
Model training
This model was trained on google colab v100 GPU.
You can find the fine-tuning colab here
.
Results
The results are actually slightly better than given in the paper. In the paper the authors mentioned that electra-base achieves 84.5 EM and 90.8 F1
| Metric | #Value |
|---|---|
| EM | 85.0520 |
| F1 | 91.6050 |
Model in Action 🚀
from transformers import pipeline
nlp = pipeline('question-answering', model='valhalla/electra-base-discriminator-finetuned_squadv1')
nlp({
'question': 'What is the answer to everything ?',
'context': '42 is the answer to life the universe and everything'
})
=> {'answer': '42', 'end': 2, 'score': 0.981274963050339, 'start': 0}
Created with ❤️ by Suraj Patil
Runs of valhalla electra-base-discriminator-finetuned_squadv1 on huggingface.co
34
Total runs
5
24-hour runs
4
3-day runs
5
7-day runs
-1
30-day runs
More Information About electra-base-discriminator-finetuned_squadv1 huggingface.co Model
Url of electra-base-discriminator-finetuned_squadv1
electra-base-discriminator-finetuned_squadv1 huggingface.co Url
Provider of electra-base-discriminator-finetuned_squadv1 huggingface.co
Other API from valhalla
Updated:April 08 2021
Total runs:
16.1K
Run Growth:
-34.2K
Growth Rate:
-212.56%
Total runs:
14.2K
Run Growth:
-22.6K
Growth Rate:
-158.87%
Total runs:
3.8K
Run Growth:
2.3K
Growth Rate:
60.52%
Total runs:
3.6K
Run Growth:
-22.7K
Growth Rate:
-623.39%
Total runs:
1.4K
Run Growth:
-1.1K
Growth Rate:
-78.48%
Total runs:
901
Run Growth:
-50.4K
Growth Rate:
-5589.79%
Total runs:
693
Run Growth:
111
Growth Rate:
16.02%
Total runs:
674
Run Growth:
-365
Growth Rate:
-54.15%
Total runs:
437
Run Growth:
203
Growth Rate:
46.88%
Total runs:
243
Run Growth:
-387
Growth Rate:
-159.26%
Total runs:
178
Run Growth:
-45
Growth Rate:
-25.28%
Total runs:
168
Run Growth:
42
Growth Rate:
25.00%
Total runs:
145
Run Growth:
62
Growth Rate:
42.76%
Total runs:
116
Run Growth:
24
Growth Rate:
20.69%
Total runs:
67
Run Growth:
59
Growth Rate:
88.06%
Total runs:
26
Run Growth:
16
Growth Rate:
61.54%
Total runs:
23
Run Growth:
21
Growth Rate:
91.30%
Total runs:
21
Run Growth:
16
Growth Rate:
76.19%
Total runs:
18
Run Growth:
2
Growth Rate:
11.11%
Total runs:
16
Run Growth:
12
Growth Rate:
75.00%
Total runs:
14
Run Growth:
3
Growth Rate:
21.43%
Total runs:
14
Run Growth:
-7
Growth Rate:
-50.00%
Total runs:
12
Run Growth:
3
Growth Rate:
25.00%
Total runs:
11
Run Growth:
3
Growth Rate:
27.27%
Total runs:
11
Run Growth:
2
Growth Rate:
18.18%
Total runs:
11
Run Growth:
3
Growth Rate:
27.27%
Total runs:
11
Run Growth:
4
Growth Rate:
36.36%
Total runs:
10
Run Growth:
0
Growth Rate:
0.00%
Total runs:
10
Run Growth:
-2
Growth Rate:
-20.00%
Total runs:
10
Run Growth:
0
Growth Rate:
0.00%
Total runs:
10
Run Growth:
4
Growth Rate:
40.00%
Total runs:
10
Run Growth:
2
Growth Rate:
20.00%
Total runs:
10
Run Growth:
-12
Growth Rate:
-133.33%
Total runs:
10
Run Growth:
-1
Growth Rate:
-10.00%
Total runs:
9
Run Growth:
6
Growth Rate:
66.67%
Total runs:
9
Run Growth:
2
Growth Rate:
22.22%
Total runs:
9
Run Growth:
7
Growth Rate:
77.78%
Total runs:
9
Run Growth:
2
Growth Rate:
22.22%
Total runs:
9
Run Growth:
2
Growth Rate:
22.22%
Total runs:
9
Run Growth:
-2
Growth Rate:
-22.22%
Total runs:
9
Run Growth:
7
Growth Rate:
77.78%
Total runs:
9
Run Growth:
1
Growth Rate:
11.11%
Total runs:
9
Run Growth:
2
Growth Rate:
22.22%
Total runs:
9
Run Growth:
6
Growth Rate:
66.67%
Total runs:
8
Run Growth:
-1
Growth Rate:
-12.50%
Total runs:
8
Run Growth:
-4
Growth Rate:
-50.00%
Total runs:
8
Run Growth:
7
Growth Rate:
87.50%
Total runs:
8
Run Growth:
-2
Growth Rate:
-25.00%
Total runs:
8
Run Growth:
2
Growth Rate:
25.00%
Total runs:
8
Run Growth:
1
Growth Rate:
12.50%
Total runs:
8
Run Growth:
0
Growth Rate:
0.00%
Total runs:
8
Run Growth:
1
Growth Rate:
12.50%
Total runs:
8
Run Growth:
-2
Growth Rate:
-25.00%
Total runs:
8
Run Growth:
2
Growth Rate:
25.00%
Total runs:
8
Run Growth:
1
Growth Rate:
12.50%
Total runs:
7
Run Growth:
-3
Growth Rate:
-42.86%
Total runs:
7
Run Growth:
2
Growth Rate:
28.57%
Total runs:
7
Run Growth:
5
Growth Rate:
71.43%
Total runs:
7
Run Growth:
0
Growth Rate:
0.00%
Total runs:
6
Run Growth:
-3
Growth Rate:
-50.00%