Intel / t5-small-xsum-int8-dynamic-inc

huggingface.co
Total runs: 730
24-hour runs: 0
7-day runs: -432
30-day runs: -1.0K
Model's Last Updated: March 21 2024
text-generation

Introduction of t5-small-xsum-int8-dynamic-inc

Model Details of t5-small-xsum-int8-dynamic-inc

INT8 T5 small finetuned on XSum

Post-training dynamic quantization

This is an INT8 PyTorch model quantized with huggingface/optimum-intel through the usage of Intel® Neural Compressor .

The original fp32 model comes from the fine-tuned model adasnew/t5-small-xsum .

The linear modules lm.head , fall back to fp32 for less than 1% relative accuracy loss.

Evaluation result
INT8 FP32
Accuracy (eval-rouge1) 29.9008 29.9592
Model size 154M 242M
Load with optimum:
from optimum.intel import INCModelForSeq2SeqLM

model_id = "Intel/t5-small-xsum-int8-dynamic-inc"
int8_model = INCModelForSeq2SeqLM.from_pretrained(model_id)

Runs of Intel t5-small-xsum-int8-dynamic-inc on huggingface.co

730
Total runs
0
24-hour runs
-80
3-day runs
-432
7-day runs
-1.0K
30-day runs

More Information About t5-small-xsum-int8-dynamic-inc huggingface.co Model

More t5-small-xsum-int8-dynamic-inc license Visit here:

https://choosealicense.com/licenses/apache-2.0

t5-small-xsum-int8-dynamic-inc huggingface.co

t5-small-xsum-int8-dynamic-inc huggingface.co is an AI model on huggingface.co that provides t5-small-xsum-int8-dynamic-inc's model effect (), which can be used instantly with this Intel t5-small-xsum-int8-dynamic-inc model. huggingface.co supports a free trial of the t5-small-xsum-int8-dynamic-inc model, and also provides paid use of the t5-small-xsum-int8-dynamic-inc. Support call t5-small-xsum-int8-dynamic-inc model through api, including Node.js, Python, http.

t5-small-xsum-int8-dynamic-inc huggingface.co Url

https://huggingface.co/Intel/t5-small-xsum-int8-dynamic-inc

Intel t5-small-xsum-int8-dynamic-inc online free

t5-small-xsum-int8-dynamic-inc huggingface.co is an online trial and call api platform, which integrates t5-small-xsum-int8-dynamic-inc's modeling effects, including api services, and provides a free online trial of t5-small-xsum-int8-dynamic-inc, you can try t5-small-xsum-int8-dynamic-inc online for free by clicking the link below.

Intel t5-small-xsum-int8-dynamic-inc online free url in huggingface.co:

https://huggingface.co/Intel/t5-small-xsum-int8-dynamic-inc

t5-small-xsum-int8-dynamic-inc install

t5-small-xsum-int8-dynamic-inc is an open source model from GitHub that offers a free installation service, and any user can find t5-small-xsum-int8-dynamic-inc on GitHub to install. At the same time, huggingface.co provides the effect of t5-small-xsum-int8-dynamic-inc install, users can directly use t5-small-xsum-int8-dynamic-inc installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

t5-small-xsum-int8-dynamic-inc install url in huggingface.co:

https://huggingface.co/Intel/t5-small-xsum-int8-dynamic-inc

Url of t5-small-xsum-int8-dynamic-inc

t5-small-xsum-int8-dynamic-inc huggingface.co Url

Provider of t5-small-xsum-int8-dynamic-inc huggingface.co

Intel
ORGANIZATIONS

Other API from Intel

huggingface.co

Total runs: 785.7K
Run Growth: 432.0K
Growth Rate: 54.99%
Updated:February 09 2024
huggingface.co

Total runs: 41.2K
Run Growth: -4.9K
Growth Rate: -11.92%
Updated:February 24 2024
huggingface.co

Total runs: 27.5K
Run Growth: 4.2K
Growth Rate: 15.16%
Updated:March 29 2024
huggingface.co

Total runs: 15.6K
Run Growth: 3.9K
Growth Rate: 25.10%
Updated:February 24 2025
huggingface.co

Total runs: 2.1K
Run Growth: -1.5K
Growth Rate: -72.80%
Updated:March 26 2024
huggingface.co

Total runs: 1.5K
Run Growth: 284
Growth Rate: 18.92%
Updated:May 20 2024