dusersad12 / SweepChampion-Release

SweepChampion

SweepChampion is a product-review classifier fine-tuned from distilbert-base-uncased . This release corresponds to the winning run of our internal hyperparameter sweep ( run_20240902_b7e2 ), selected under the production latency budget.

Training Details

Training Hyperparameters

Training Data

Fine-tuned on the train split of the internal product-reviews-v2 dataset. Model selection used the validation split shared by all runs of the sweep.

Evaluation Results

Final metrics of the selected run (validation split):

Selection Rule

Among the completed runs of the sweep, only runs whose measured p95 latency respected the production budget were eligible; runs without a latency measurement were treated as ineligible. The released run is the eligible run with the highest val_f1.

Usage

from transformers import AutoModelForSequenceClassification, AutoTokenizer

model = AutoModelForSequenceClassification.from_pretrained("SweepChampion-Release")
tokenizer = AutoTokenizer.from_pretrained("SweepChampion-Release")

Limitations

The model was trained on internal product-review data and is intended for sentiment-style classification of similar text. Latency figures were measured on our production serving hardware and may differ on other setups.