pszemraj / deberta-v3-xsmall-CoLA

huggingface.co
Total runs: 20
24-hour runs: 0
7-day runs: 0
30-day runs: -2
Model's Last Updated: December 29 2025
text-classification

Introduction of deberta-v3-xsmall-CoLA

Model Details of deberta-v3-xsmall-CoLA

deberta-v3-xsmall-CoLA

This model is a fine-tuned version of microsoft/deberta-v3-xsmall on the GLUE COLA dataset. It achieves the following results on the evaluation set:

  • Loss: 0.4237
  • Matthews Correlation: 0.5895
Model description

Trying to find a decent optimum between accuracy/quality and inference speed.

{
    "epoch": 3.0,
    "eval_loss": 0.423,
    "eval_matthews_correlation": 0.589,
    "eval_runtime": 5.0422,
    "eval_samples": 1043,
    "eval_samples_per_second": 206.853,
    "eval_steps_per_second": 51.763
}
Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure
Training hyperparameters

The following hyperparameters were used during training:

  • learning_rate: 6e-05
  • train_batch_size: 32
  • eval_batch_size: 4
  • seed: 16105
  • distributed_type: multi-GPU
  • gradient_accumulation_steps: 4
  • total_train_batch_size: 128
  • optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  • lr_scheduler_type: cosine
  • lr_scheduler_warmup_ratio: 0.03
  • num_epochs: 3.0
  • mixed_precision_training: Native AMP
Training results
Training Loss Epoch Step Validation Loss Matthews Correlation
0.3945 1.0 67 0.4323 0.5778
0.3214 2.0 134 0.4237 0.5895
0.3059 3.0 201 0.4636 0.5795
Framework versions
  • Transformers 4.27.0.dev0
  • Pytorch 1.13.1+cu117
  • Datasets 2.8.0
  • Tokenizers 0.13.1

Runs of pszemraj deberta-v3-xsmall-CoLA on huggingface.co

20
Total runs
0
24-hour runs
-1
3-day runs
0
7-day runs
-2
30-day runs

More Information About deberta-v3-xsmall-CoLA huggingface.co Model

More deberta-v3-xsmall-CoLA license Visit here:

https://choosealicense.com/licenses/mit

deberta-v3-xsmall-CoLA huggingface.co

deberta-v3-xsmall-CoLA huggingface.co is an AI model on huggingface.co that provides deberta-v3-xsmall-CoLA's model effect (), which can be used instantly with this pszemraj deberta-v3-xsmall-CoLA model. huggingface.co supports a free trial of the deberta-v3-xsmall-CoLA model, and also provides paid use of the deberta-v3-xsmall-CoLA. Support call deberta-v3-xsmall-CoLA model through api, including Node.js, Python, http.

deberta-v3-xsmall-CoLA huggingface.co Url

https://huggingface.co/pszemraj/deberta-v3-xsmall-CoLA

pszemraj deberta-v3-xsmall-CoLA online free

deberta-v3-xsmall-CoLA huggingface.co is an online trial and call api platform, which integrates deberta-v3-xsmall-CoLA's modeling effects, including api services, and provides a free online trial of deberta-v3-xsmall-CoLA, you can try deberta-v3-xsmall-CoLA online for free by clicking the link below.

pszemraj deberta-v3-xsmall-CoLA online free url in huggingface.co:

https://huggingface.co/pszemraj/deberta-v3-xsmall-CoLA

deberta-v3-xsmall-CoLA install

deberta-v3-xsmall-CoLA is an open source model from GitHub that offers a free installation service, and any user can find deberta-v3-xsmall-CoLA on GitHub to install. At the same time, huggingface.co provides the effect of deberta-v3-xsmall-CoLA install, users can directly use deberta-v3-xsmall-CoLA installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

deberta-v3-xsmall-CoLA install url in huggingface.co:

https://huggingface.co/pszemraj/deberta-v3-xsmall-CoLA

Url of deberta-v3-xsmall-CoLA

deberta-v3-xsmall-CoLA huggingface.co Url

Provider of deberta-v3-xsmall-CoLA huggingface.co

pszemraj
ORGANIZATIONS

Other API from pszemraj