Total runs:
50.4K
Run Growth:
40.4K
Growth Rate:
80.12%
Sponsored by
YouArt
valhalla / bart-large-finetuned-squadv1
Model's Last Updated: June 14 2021
question-answering
Introduction of bart-large-finetuned-squadv1
Model Details of bart-large-finetuned-squadv1
BART-LARGE finetuned on SQuADv1
This is bart-large model finetuned on SQuADv1 dataset for question answering task
Model details
BART was propsed in the paper BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension . BART is a seq2seq model intended for both NLG and NLU tasks.
To use BART for question answering tasks, we feed the complete document into the encoder and decoder, and use the top hidden state of the decoder as a representation for each word. This representation is used to classify the token. As given in the paper bart-large achives comparable to ROBERTa on SQuAD. Another notable thing about BART is that it can handle sequences with upto 1024 tokens.
| Param | #Value |
|---|---|
| encoder layers | 12 |
| decoder layers | 12 |
| hidden size | 4096 |
| num attetion heads | 16 |
| on disk size | 1.63GB |
Model training
This model was trained on google colab v100 GPU.
You can find the fine-tuning colab here
.
Results
The results are actually slightly worse than given in the paper. In the paper the authors mentioned that bart-large achieves 88.8 EM and 94.6 F1
| Metric | #Value |
|---|---|
| EM | 86.8022 |
| F1 | 92.7342 |
Model in Action 🚀
from transformers import BartTokenizer, BartForQuestionAnswering
import torch
tokenizer = BartTokenizer.from_pretrained('valhalla/bart-large-finetuned-squadv1')
model = BartForQuestionAnswering.from_pretrained('valhalla/bart-large-finetuned-squadv1')
question, text = "Who was Jim Henson?", "Jim Henson was a nice puppet"
encoding = tokenizer(question, text, return_tensors='pt')
input_ids = encoding['input_ids']
attention_mask = encoding['attention_mask']
start_scores, end_scores = model(input_ids, attention_mask=attention_mask, output_attentions=False)[:2]
all_tokens = tokenizer.convert_ids_to_tokens(input_ids[0])
answer = ' '.join(all_tokens[torch.argmax(start_scores) : torch.argmax(end_scores)+1])
answer = tokenizer.convert_tokens_to_ids(answer.split())
answer = tokenizer.decode(answer)
#answer => 'a nice puppet'
Created with ❤️ by Suraj Patil
Runs of valhalla bart-large-finetuned-squadv1 on huggingface.co
88
Total runs
-5
24-hour runs
-55
3-day runs
-115
7-day runs
-185
30-day runs
More Information About bart-large-finetuned-squadv1 huggingface.co Model
Url of bart-large-finetuned-squadv1
bart-large-finetuned-squadv1 huggingface.co Url
Provider of bart-large-finetuned-squadv1 huggingface.co
Other API from valhalla
Updated:June 14 2021
Total runs:
37.7K
Run Growth:
-59.8K
Growth Rate:
-158.77%
Total runs:
6.0K
Run Growth:
3.6K
Growth Rate:
60.06%
Total runs:
3.6K
Run Growth:
-22.7K
Growth Rate:
-623.39%
Total runs:
1.4K
Run Growth:
-1.1K
Growth Rate:
-78.48%
Total runs:
1.3K
Run Growth:
-334
Growth Rate:
-26.05%
Total runs:
901
Run Growth:
-50.4K
Growth Rate:
-5589.79%
Total runs:
693
Run Growth:
111
Growth Rate:
16.02%
Total runs:
674
Run Growth:
-365
Growth Rate:
-54.15%
Total runs:
243
Run Growth:
-387
Growth Rate:
-159.26%
Total runs:
186
Run Growth:
137
Growth Rate:
86.71%
Total runs:
178
Run Growth:
-45
Growth Rate:
-25.28%
Total runs:
168
Run Growth:
42
Growth Rate:
25.00%
Total runs:
90
Run Growth:
-162
Growth Rate:
-180.00%
Total runs:
31
Run Growth:
14
Growth Rate:
45.16%
Total runs:
22
Run Growth:
14
Growth Rate:
63.64%
Total runs:
17
Run Growth:
11
Growth Rate:
64.71%
Total runs:
16
Run Growth:
12
Growth Rate:
75.00%
Total runs:
15
Run Growth:
-224
Growth Rate:
-1317.65%
Total runs:
14
Run Growth:
7
Growth Rate:
50.00%
Total runs:
12
Run Growth:
8
Growth Rate:
66.67%
Total runs:
11
Run Growth:
5
Growth Rate:
45.45%
Total runs:
10
Run Growth:
5
Growth Rate:
50.00%
Total runs:
10
Run Growth:
-3
Growth Rate:
-25.00%
Total runs:
10
Run Growth:
3
Growth Rate:
30.00%
Total runs:
9
Run Growth:
6
Growth Rate:
66.67%
Total runs:
9
Run Growth:
2
Growth Rate:
22.22%
Total runs:
9
Run Growth:
7
Growth Rate:
77.78%
Total runs:
9
Run Growth:
5
Growth Rate:
55.56%
Total runs:
9
Run Growth:
7
Growth Rate:
77.78%
Total runs:
9
Run Growth:
3
Growth Rate:
33.33%
Total runs:
9
Run Growth:
6
Growth Rate:
66.67%
Total runs:
8
Run Growth:
3
Growth Rate:
33.33%
Total runs:
8
Run Growth:
5
Growth Rate:
62.50%
Total runs:
8
Run Growth:
7
Growth Rate:
87.50%
Total runs:
8
Run Growth:
-2
Growth Rate:
-25.00%
Total runs:
8
Run Growth:
1
Growth Rate:
12.50%
Total runs:
8
Run Growth:
2
Growth Rate:
25.00%
Total runs:
7
Run Growth:
4
Growth Rate:
57.14%
Total runs:
7
Run Growth:
-2
Growth Rate:
-28.57%
Total runs:
7
Run Growth:
2
Growth Rate:
28.57%
Total runs:
7
Run Growth:
2
Growth Rate:
28.57%
Total runs:
7
Run Growth:
6
Growth Rate:
85.71%
Total runs:
7
Run Growth:
5
Growth Rate:
71.43%
Total runs:
7
Run Growth:
-5
Growth Rate:
-71.43%
Total runs:
7
Run Growth:
0
Growth Rate:
0.00%
Total runs:
6
Run Growth:
1
Growth Rate:
16.67%
Total runs:
6
Run Growth:
1
Growth Rate:
16.67%
Total runs:
6
Run Growth:
4
Growth Rate:
66.67%
Total runs:
6
Run Growth:
2
Growth Rate:
33.33%
Total runs:
6
Run Growth:
3
Growth Rate:
50.00%
Total runs:
6
Run Growth:
1
Growth Rate:
16.67%
Total runs:
6
Run Growth:
-1
Growth Rate:
-16.67%
Total runs:
6
Run Growth:
1
Growth Rate:
16.67%
Total runs:
5
Run Growth:
4
Growth Rate:
80.00%
Total runs:
5
Run Growth:
0
Growth Rate:
0.00%
Total runs:
5
Run Growth:
1
Growth Rate:
20.00%
Total runs:
5
Run Growth:
1
Growth Rate:
20.00%
Total runs:
5
Run Growth:
0
Growth Rate:
0.00%
Total runs:
5
Run Growth:
1
Growth Rate:
20.00%