Total runs:
3.0K
Run Growth:
-1.3K
Growth Rate:
-44.32%
Sponsored by
APIMart
pszemraj / bigbird-roberta-base-edu-classifier
Model's Last Updated: December 29 2025
text-classification
Introduction of bigbird-roberta-base-edu-classifier
Model Details of bigbird-roberta-base-edu-classifier
bigbird-roberta-base: eduscore
Similar to the original , this model predicts a score of 0 to 5 on 'educational quality' of some text. This model was fine-tuned @ its max context length of 4096 tokens.
Usage
Note this is for CPU, for GPU you will need to make some (small) changes.
# Load model directly
from transformers import AutoTokenizer, AutoModelForSequenceClassification
model_name = "pszemraj/bigbird-roberta-base-edu-classifier"
tokenizer = AutoTokenizer.from_pretrained(model_name)
model = AutoModelForSequenceClassification.from_pretrained(
model_name, attn_implementation="eager"
)
text = "This is a test sentence."
inputs = tokenizer(text, return_tensors="pt", padding="longest", truncation=True)
outputs = model(**inputs)
logits = outputs.logits.squeeze(-1).float().detach().numpy()
score = logits.item()
result = {
"text": text,
"score": score,
"int_score": int(round(max(0, min(score, 5)))),
}
print(result)
# {'text': 'This is a test sentence.', 'score': 0.20170727372169495, 'int_score': 0}
Details
This model is a fine-tuned version of google/bigbird-roberta-base on the HuggingFaceFW/fineweb-edu-llama3-annotations dataset. It achieves the following results on the evaluation set:
- Loss: 0.2176
- Mse: 0.2176
Intended uses & limitations
Refer to the hf classifier's model card for more details
Training procedure
Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 1e-05
- train_batch_size: 4
- eval_batch_size: 4
- seed: 90085
- gradient_accumulation_steps: 32
- total_train_batch_size: 128
- optimizer: Adam with betas=(0.9,0.98) and epsilon=1e-09
- lr_scheduler_type: linear
- lr_scheduler_warmup_ratio: 0.05
- num_epochs: 1.0
Runs of pszemraj bigbird-roberta-base-edu-classifier on huggingface.co
20
Total runs
0
24-hour runs
2
3-day runs
5
7-day runs
13
30-day runs
More Information About bigbird-roberta-base-edu-classifier huggingface.co Model
Url of bigbird-roberta-base-edu-classifier
bigbird-roberta-base-edu-classifier huggingface.co Url
Provider of bigbird-roberta-base-edu-classifier huggingface.co
Other API from pszemraj
Updated:December 29 2025
Total runs:
2.4K
Run Growth:
816
Growth Rate:
33.35%
Total runs:
1.2K
Run Growth:
-20.8K
Growth Rate:
-238.12%
Total runs:
803
Run Growth:
-1.5K
Growth Rate:
-189.17%
Total runs:
697
Run Growth:
-206
Growth Rate:
-29.56%
Total runs:
670
Run Growth:
-230
Growth Rate:
-34.33%
Total runs:
669
Run Growth:
-205
Growth Rate:
-30.64%
Total runs:
665
Run Growth:
-233
Growth Rate:
-35.04%
Total runs:
648
Run Growth:
-266
Growth Rate:
-41.05%
Total runs:
540
Run Growth:
-208
Growth Rate:
-39.10%
Total runs:
419
Run Growth:
348
Growth Rate:
84.88%
Total runs:
353
Run Growth:
-50
Growth Rate:
-14.16%
Total runs:
281
Run Growth:
169
Growth Rate:
61.01%
Total runs:
246
Run Growth:
171
Growth Rate:
69.51%
Total runs:
231
Run Growth:
-257
Growth Rate:
-111.26%
Total runs:
180
Run Growth:
169
Growth Rate:
93.89%
Total runs:
170
Run Growth:
136
Growth Rate:
80.95%
Total runs:
137
Run Growth:
121
Growth Rate:
90.98%
Total runs:
118
Run Growth:
-214
Growth Rate:
-179.83%
Total runs:
95
Run Growth:
1
Growth Rate:
1.03%
Total runs:
91
Run Growth:
0
Growth Rate:
0.00%
Total runs:
86
Run Growth:
44
Growth Rate:
51.16%
Total runs:
84
Run Growth:
75
Growth Rate:
87.21%
Total runs:
83
Run Growth:
23
Growth Rate:
27.38%
Total runs:
74
Run Growth:
16
Growth Rate:
21.62%
Total runs:
73
Run Growth:
40
Growth Rate:
57.14%
Total runs:
73
Run Growth:
65
Growth Rate:
89.04%
Total runs:
73
Run Growth:
50
Growth Rate:
68.49%
Total runs:
71
Run Growth:
51
Growth Rate:
71.83%
Total runs:
70
Run Growth:
20
Growth Rate:
28.57%
Total runs:
69
Run Growth:
42
Growth Rate:
60.87%
Total runs:
67
Run Growth:
52
Growth Rate:
80.00%
Total runs:
64
Run Growth:
26
Growth Rate:
36.11%
Total runs:
63
Run Growth:
47
Growth Rate:
74.60%
Total runs:
61
Run Growth:
33
Growth Rate:
54.10%
Total runs:
58
Run Growth:
41
Growth Rate:
70.69%
Total runs:
58
Run Growth:
26
Growth Rate:
50.98%
Total runs:
55
Run Growth:
42
Growth Rate:
76.36%
Total runs:
55
Run Growth:
39
Growth Rate:
72.22%
Total runs:
50
Run Growth:
36
Growth Rate:
72.00%
Total runs:
47
Run Growth:
33
Growth Rate:
70.21%
Total runs:
44
Run Growth:
-10
Growth Rate:
-22.73%
Total runs:
42
Run Growth:
30
Growth Rate:
71.43%
Total runs:
42
Run Growth:
1
Growth Rate:
2.86%
Total runs:
41
Run Growth:
33
Growth Rate:
80.49%
Total runs:
41
Run Growth:
32
Growth Rate:
78.05%
Total runs:
40
Run Growth:
28
Growth Rate:
70.00%
Total runs:
39
Run Growth:
11
Growth Rate:
28.95%
Total runs:
38
Run Growth:
26
Growth Rate:
68.42%
Total runs:
37
Run Growth:
29
Growth Rate:
78.38%
Total runs:
36
Run Growth:
24
Growth Rate:
68.57%
Total runs:
36
Run Growth:
22
Growth Rate:
61.11%
Total runs:
35
Run Growth:
11
Growth Rate:
29.73%
Total runs:
35
Run Growth:
24
Growth Rate:
70.59%
Total runs:
35
Run Growth:
17
Growth Rate:
51.52%
Total runs:
34
Run Growth:
22
Growth Rate:
64.71%
Total runs:
34
Run Growth:
21
Growth Rate:
65.63%
Total runs:
33
Run Growth:
18
Growth Rate:
58.06%
Total runs:
33
Run Growth:
17
Growth Rate:
54.84%
Total runs:
33
Run Growth:
31
Growth Rate:
93.94%
Total runs:
33
Run Growth:
21
Growth Rate:
63.64%
Total runs:
32
Run Growth:
15
Growth Rate:
51.72%
Total runs:
31
Run Growth:
21
Growth Rate:
67.74%
Total runs:
30
Run Growth:
22
Growth Rate:
73.33%
Total runs:
30
Run Growth:
11
Growth Rate:
40.74%
Total runs:
28
Run Growth:
28
Growth Rate:
100.00%
Total runs:
28
Run Growth:
-97
Growth Rate:
-323.33%
Total runs:
28
Run Growth:
17
Growth Rate:
68.00%
Total runs:
27
Run Growth:
13
Growth Rate:
48.15%
Total runs:
27
Run Growth:
-5
Growth Rate:
-18.52%
Total runs:
27
Run Growth:
18
Growth Rate:
66.67%
Total runs:
26
Run Growth:
15
Growth Rate:
57.69%
Total runs:
26
Run Growth:
15
Growth Rate:
57.69%
Total runs:
26
Run Growth:
20
Growth Rate:
76.92%
Total runs:
25
Run Growth:
14
Growth Rate:
56.00%
Total runs:
23
Run Growth:
14
Growth Rate:
60.87%
Total runs:
22
Run Growth:
8
Growth Rate:
40.00%
Total runs:
22
Run Growth:
3
Growth Rate:
13.64%
Total runs:
21
Run Growth:
13
Growth Rate:
61.90%
Total runs:
21
Run Growth:
7
Growth Rate:
36.84%
Total runs:
21
Run Growth:
7
Growth Rate:
35.00%
Total runs:
20
Run Growth:
6
Growth Rate:
31.58%
Total runs:
19
Run Growth:
12
Growth Rate:
63.16%
Total runs:
19
Run Growth:
9
Growth Rate:
47.37%
Total runs:
19
Run Growth:
10
Growth Rate:
52.63%
Total runs:
19
Run Growth:
9
Growth Rate:
47.37%
Total runs:
19
Run Growth:
10
Growth Rate:
52.63%
Total runs:
19
Run Growth:
5
Growth Rate:
27.78%
Total runs:
18
Run Growth:
16
Growth Rate:
88.89%
Total runs:
18
Run Growth:
9
Growth Rate:
50.00%
Total runs:
18
Run Growth:
11
Growth Rate:
61.11%
Total runs:
18
Run Growth:
7
Growth Rate:
36.84%
Total runs:
18
Run Growth:
9
Growth Rate:
50.00%
Total runs:
17
Run Growth:
6
Growth Rate:
35.29%
Total runs:
17
Run Growth:
7
Growth Rate:
41.18%