lewtun / quantized-distilbert-banking77

huggingface.co
Total runs: 24
24-hour runs: -2
7-day runs: -2
30-day runs: 10
Model's Last Updated: October 20 2022
text-classification

Introduction of quantized-distilbert-banking77

Model Details of quantized-distilbert-banking77

Quantized-distilbert-banking77

This model is a dynamically quantized version of optimum/distilbert-base-uncased-finetuned-banking77 on the banking77 dataset.

The model was created using the dynamic-quantization notebook from a workshop presented at MLOps World 2022.

It achieves the following results on the evaluation set:

Accuracy

  • Vanilla model: 92.5%
  • Quantized model: 92.44%

The quantized model achieves 99.93% accuracy of the FP32 model

Latency

Payload sequence length: 128
Instance type: AWS c6i.xlarge

latency vanilla transformers quantized optimum model improvement
p95 63.24ms 37.06ms 1.71x
avg 62.87ms 37.93ms 1.66x
How to use
from optimum.onnxruntime import ORTModelForSequenceClassification
from transformers import pipeline, AutoTokenizer

model = ORTModelForSequenceClassification.from_pretrained("lewtun/quantized-distilbert-banking77")
tokenizer = AutoTokenizer.from_pretrained("lewtun/quantized-distilbert-banking77")

classifier = pipeline("text-classification", model=model, tokenizer=tokenizer)
classifier("What is the exchange rate like on this app?")

Runs of lewtun quantized-distilbert-banking77 on huggingface.co

24
Total runs
-2
24-hour runs
-1
3-day runs
-2
7-day runs
10
30-day runs

More Information About quantized-distilbert-banking77 huggingface.co Model

quantized-distilbert-banking77 huggingface.co

quantized-distilbert-banking77 huggingface.co is an AI model on huggingface.co that provides quantized-distilbert-banking77's model effect (), which can be used instantly with this lewtun quantized-distilbert-banking77 model. huggingface.co supports a free trial of the quantized-distilbert-banking77 model, and also provides paid use of the quantized-distilbert-banking77. Support call quantized-distilbert-banking77 model through api, including Node.js, Python, http.

quantized-distilbert-banking77 huggingface.co Url

https://huggingface.co/lewtun/quantized-distilbert-banking77

lewtun quantized-distilbert-banking77 online free

quantized-distilbert-banking77 huggingface.co is an online trial and call api platform, which integrates quantized-distilbert-banking77's modeling effects, including api services, and provides a free online trial of quantized-distilbert-banking77, you can try quantized-distilbert-banking77 online for free by clicking the link below.

lewtun quantized-distilbert-banking77 online free url in huggingface.co:

https://huggingface.co/lewtun/quantized-distilbert-banking77

quantized-distilbert-banking77 install

quantized-distilbert-banking77 is an open source model from GitHub that offers a free installation service, and any user can find quantized-distilbert-banking77 on GitHub to install. At the same time, huggingface.co provides the effect of quantized-distilbert-banking77 install, users can directly use quantized-distilbert-banking77 installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

quantized-distilbert-banking77 install url in huggingface.co:

https://huggingface.co/lewtun/quantized-distilbert-banking77

Url of quantized-distilbert-banking77

quantized-distilbert-banking77 huggingface.co Url

Provider of quantized-distilbert-banking77 huggingface.co

lewtun
ORGANIZATIONS

Other API from lewtun

huggingface.co

Total runs: 1.5K
Run Growth: -307
Growth Rate: -20.52%
Updated:September 15 2022
huggingface.co

Total runs: 53
Run Growth: 5
Growth Rate: 9.43%
Updated:May 01 2026
huggingface.co

Total runs: 44
Run Growth: 4
Growth Rate: 9.09%
Updated:May 02 2026
huggingface.co

Total runs: 43
Run Growth: -2
Growth Rate: -4.65%
Updated:December 16 2022
huggingface.co

Total runs: 43
Run Growth: -118
Growth Rate: -274.42%
Updated:September 08 2022
huggingface.co

Total runs: 21
Run Growth: 8
Growth Rate: 34.78%
Updated:February 21 2024
huggingface.co

Total runs: 15
Run Growth: 1
Growth Rate: 6.67%
Updated:November 09 2023