This is a finetuned MPnet model with a classification head designed to predict whether a short answer is correct.
Training
This model was trained on the MultiRC dataset, a corpus of 20,422 answers to 5,130 questions about 456 source texts. Before training, chatGPT was used to generate correct answers to each question given the source. This was used as the reference answer. The model takes the reference answer together with the target answer and predicts whether the target answer is correct.
15% of sources along with all of their questions and answers were withheld from the training data and used to evaluate the model. The model had an F1 of 0.81 on the test set.
Input sequences to the model should follow this pattern:
{target_answer} </s> {reference_answer}
Contact
This model was developed by LEAR Lab at Vanderbilt University.
For questions or comments about this model, please contact
[email protected]
.
Runs of tiedaar short-answer-classification on huggingface.co
16
Total runs
0
24-hour runs
0
3-day runs
0
7-day runs
0
30-day runs
More Information About short-answer-classification huggingface.co Model
More short-answer-classification license Visit here:
short-answer-classification huggingface.co is an AI model on huggingface.co that provides short-answer-classification's model effect (), which can be used instantly with this tiedaar short-answer-classification model. huggingface.co supports a free trial of the short-answer-classification model, and also provides paid use of the short-answer-classification. Support call short-answer-classification model through api, including Node.js, Python, http.
short-answer-classification huggingface.co is an online trial and call api platform, which integrates short-answer-classification's modeling effects, including api services, and provides a free online trial of short-answer-classification, you can try short-answer-classification online for free by clicking the link below.
tiedaar short-answer-classification online free url in huggingface.co:
short-answer-classification is an open source model from GitHub that offers a free installation service, and any user can find short-answer-classification on GitHub to install. At the same time, huggingface.co provides the effect of short-answer-classification install, users can directly use short-answer-classification installed effect in huggingface.co for debugging and trial. It also supports api for free installation.
short-answer-classification install url in huggingface.co: