Sentence Split is the task of dividing a long sentence into multiple sentences.
E.g.:
Mary likes to play football in her freetime whenever she meets with her friends that are very nice people.
could be split into
Mary likes to play football in her freetime whenever she meets with her friends.
Her friends are very nice people.
How to use it in your code:
from transformers import AutoTokenizer, AutoModelForSeq2SeqLM
tokenizer = AutoTokenizer.from_pretrained("flax-community/t5-large-wikisplit")
model = AutoModelForSeq2SeqLM.from_pretrained("flax-community/t5-large-wikisplit")
complex_sentence = "This comedy drama is produced by Tidy , the company she co-founded in 2008 with her husband David Peet , who is managing director ."
sample_tokenized = tokenizer(complex_sentence, return_tensors="pt")
answer = model.generate(sample_tokenized['input_ids'], attention_mask = sample_tokenized['attention_mask'], max_length=256, num_beams=5)
gene_sentence = tokenizer.decode(answer[0], skip_special_tokens=True)
gene_sentence
"""Output:This comedy drama is produced by Tidy. She co-founded Tidy in 2008 with her husband David Peet, who is managing director."""
Runs of flax-community t5-large-wikisplit on huggingface.co
16
Total runs
0
24-hour runs
-3
3-day runs
-6
7-day runs
-4
30-day runs
More Information About t5-large-wikisplit huggingface.co Model
t5-large-wikisplit huggingface.co
t5-large-wikisplit huggingface.co is an AI model on huggingface.co that provides t5-large-wikisplit's model effect (), which can be used instantly with this flax-community t5-large-wikisplit model. huggingface.co supports a free trial of the t5-large-wikisplit model, and also provides paid use of the t5-large-wikisplit. Support call t5-large-wikisplit model through api, including Node.js, Python, http.
t5-large-wikisplit huggingface.co is an online trial and call api platform, which integrates t5-large-wikisplit's modeling effects, including api services, and provides a free online trial of t5-large-wikisplit, you can try t5-large-wikisplit online for free by clicking the link below.
flax-community t5-large-wikisplit online free url in huggingface.co:
t5-large-wikisplit is an open source model from GitHub that offers a free installation service, and any user can find t5-large-wikisplit on GitHub to install. At the same time, huggingface.co provides the effect of t5-large-wikisplit install, users can directly use t5-large-wikisplit installed effect in huggingface.co for debugging and trial. It also supports api for free installation.