flax-community / byt5-base-wikisplit

huggingface.co
Total runs: 18
24-hour runs: 0
7-day runs: 0
30-day runs: 2
Model's Last Updated: July 27 2023
text-generation

Introduction of byt5-base-wikisplit

Model Details of byt5-base-wikisplit

T5 model for sentence splitting in English

Sentence Split is the task of dividing a long sentence into multiple sentences. E.g.:

Mary likes to play football in her freetime whenever she meets with her friends that are very nice people.

could be split into

Mary likes to play football in her freetime whenever she meets with her friends.
Her friends are very nice people.
How to use it in your code:
from transformers import AutoTokenizer, AutoModelForSeq2SeqLM
tokenizer = AutoTokenizer.from_pretrained("flax-community/byt5-base-wikisplit")
model = AutoModelForSeq2SeqLM.from_pretrained("flax-community/byt5-base-wikisplit")
complex_sentence = "This comedy drama is produced by Tidy , the company she co-founded in 2008 with her husband David Peet , who is managing director ."
sample_tokenized = tokenizer(complex_sentence, return_tensors="pt")
answer = model.generate(sample_tokenized['input_ids'], attention_mask = sample_tokenized['attention_mask'], max_length=256, num_beams=5)
gene_sentence = tokenizer.decode(answer[0], skip_special_tokens=True)
gene_sentence
"""
Output:
This comedy drama is produced by Tidy. She co-founded Tidy in 2008 with her husband David Peet, who is managing director.
"""
Datasets:

Wiki_Split

Current Basline from paper

baseline

Our Results:
Model Exact SARI BLEU
t5-base-wikisplit 17.93 67.5438 76.9
t5-v1_1-base-wikisplit 18.1207 67.4873 76.9478
byt5-base-wikisplit 11.3582 67.2685 73.1682
t5-large-wikisplit 18.6632 68.0501 77.1881

Runs of flax-community byt5-base-wikisplit on huggingface.co

18
Total runs
0
24-hour runs
0
3-day runs
0
7-day runs
2
30-day runs

More Information About byt5-base-wikisplit huggingface.co Model

byt5-base-wikisplit huggingface.co

byt5-base-wikisplit huggingface.co is an AI model on huggingface.co that provides byt5-base-wikisplit's model effect (), which can be used instantly with this flax-community byt5-base-wikisplit model. huggingface.co supports a free trial of the byt5-base-wikisplit model, and also provides paid use of the byt5-base-wikisplit. Support call byt5-base-wikisplit model through api, including Node.js, Python, http.

flax-community byt5-base-wikisplit online free

byt5-base-wikisplit huggingface.co is an online trial and call api platform, which integrates byt5-base-wikisplit's modeling effects, including api services, and provides a free online trial of byt5-base-wikisplit, you can try byt5-base-wikisplit online for free by clicking the link below.

flax-community byt5-base-wikisplit online free url in huggingface.co:

https://huggingface.co/flax-community/byt5-base-wikisplit

byt5-base-wikisplit install

byt5-base-wikisplit is an open source model from GitHub that offers a free installation service, and any user can find byt5-base-wikisplit on GitHub to install. At the same time, huggingface.co provides the effect of byt5-base-wikisplit install, users can directly use byt5-base-wikisplit installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

byt5-base-wikisplit install url in huggingface.co:

https://huggingface.co/flax-community/byt5-base-wikisplit

Url of byt5-base-wikisplit

Provider of byt5-base-wikisplit huggingface.co

flax-community
ORGANIZATIONS

Other API from flax-community