Total runs:
22.7K
Run Growth:
-27.8K
Growth Rate:
-122.82%
Sponsored by
iMean AI Trip Planner
pszemraj / opt-peter-2.7B
Model's Last Updated: December 29 2025
text-generation
Introduction of opt-peter-2.7B
Model Details of opt-peter-2.7B
pszemraj/opt-peter-2.7B
This model is a fine-tuned version of facebook/opt-2.7b on about 80k WhatsApp/text messages (mine). Please use responsibly :)
Test it out on Google Colab by clicking the button above.
Model description
- Exploring to see how OPT does in terms of dialogue/conversational applications
- Seems to do a lot better than GPT-Neo with similar training parameters
- you can create your own digital clone and deploy it leveraging this repository I am working on .
sharded checkpoint
As this model file is 10+ GB, it can impose some constraints with lower RAM runtimes and/or download speeds. To help with this issue, a sharded checkpoint of this model is available here .
The
pszemraj/opt-peter-2.7B-sharded
model can be used as a drop-in replacement for this one for all use cases.
Intended uses & limitations
The base model has a custom license that propagates to this one. Most importantly, it cannot be used commercially . Read more here: facebook/opt-2.7b
-
the model is probably too large to use via API here. Use in Python with GPU RAM / CPU RAM > 12 GB, Colab notebook linked above.
- alternatively, you can message a bot on telegram where I test LLMs for dialogue generation
- any statements or claims made by this model do not reflect actual claims/statements by me. Keep in mind it is a fine-tuned version of the model on my data, so things from pre-training are also present in outputs.
Training and evaluation data
WhatsApp & iMessage data were parsed using ai-msgbot and then fed as a text dataset to the HF trainer.
Training procedure
Training hyperparameters
SESSION ONE
The following hyperparameters were used during training:
- learning_rate: 4e-05
- train_batch_size: 8
- eval_batch_size: 8
- seed: 42
- distributed_type: multi-GPU
- gradient_accumulation_steps: 16
- total_train_batch_size: 128
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: cosine
- lr_scheduler_warmup_ratio: 0.01
- num_epochs: 3
SESSION TWO
The following hyperparameters were used during training:
- learning_rate: 1e-05
- train_batch_size: 16
- eval_batch_size: 16
- seed: 42
- distributed_type: multi-GPU
- gradient_accumulation_steps: 4
- total_train_batch_size: 64
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: cosine
- lr_scheduler_warmup_ratio: 0.05
- num_epochs: 4
Framework versions
- Transformers 4.19.2
- Pytorch 1.10.0+cu113
- Datasets 2.2.2
- Tokenizers 0.12.1
Runs of pszemraj opt-peter-2.7B on huggingface.co
17
Total runs
0
24-hour runs
0
3-day runs
0
7-day runs
12
30-day runs
More Information About opt-peter-2.7B huggingface.co Model
Url of opt-peter-2.7B
opt-peter-2.7B huggingface.co Url
Provider of opt-peter-2.7B huggingface.co
Other API from pszemraj
Updated:December 29 2025
Total runs:
3.6K
Run Growth:
302
Growth Rate:
8.43%
Total runs:
2.6K
Run Growth:
1.2K
Growth Rate:
45.89%
Total runs:
1.3K
Run Growth:
-322
Growth Rate:
-24.23%
Total runs:
880
Run Growth:
492
Growth Rate:
54.19%
Total runs:
697
Run Growth:
-206
Growth Rate:
-29.56%
Total runs:
670
Run Growth:
-230
Growth Rate:
-34.33%
Total runs:
669
Run Growth:
-205
Growth Rate:
-30.64%
Total runs:
665
Run Growth:
-233
Growth Rate:
-35.04%
Total runs:
648
Run Growth:
-266
Growth Rate:
-41.05%
Total runs:
330
Run Growth:
238
Growth Rate:
71.47%
Total runs:
325
Run Growth:
11
Growth Rate:
3.38%
Total runs:
246
Run Growth:
106
Growth Rate:
43.80%
Total runs:
231
Run Growth:
-257
Growth Rate:
-111.26%
Total runs:
200
Run Growth:
102
Growth Rate:
64.15%
Total runs:
128
Run Growth:
26
Growth Rate:
20.31%
Total runs:
122
Run Growth:
91
Growth Rate:
77.78%
Total runs:
91
Run Growth:
0
Growth Rate:
0.00%
Total runs:
86
Run Growth:
44
Growth Rate:
51.16%
Total runs:
83
Run Growth:
29
Growth Rate:
34.94%
Total runs:
74
Run Growth:
16
Growth Rate:
21.62%
Total runs:
73
Run Growth:
65
Growth Rate:
89.04%
Total runs:
71
Run Growth:
51
Growth Rate:
71.83%
Total runs:
70
Run Growth:
-38
Growth Rate:
-55.07%
Total runs:
70
Run Growth:
20
Growth Rate:
28.57%
Total runs:
61
Run Growth:
27
Growth Rate:
44.26%
Total runs:
59
Run Growth:
47
Growth Rate:
79.66%
Total runs:
54
Run Growth:
21
Growth Rate:
39.62%
Total runs:
49
Run Growth:
22
Growth Rate:
46.81%
Total runs:
49
Run Growth:
30
Growth Rate:
61.22%
Total runs:
46
Run Growth:
34
Growth Rate:
73.91%
Total runs:
44
Run Growth:
-6
Growth Rate:
-13.33%
Total runs:
43
Run Growth:
25
Growth Rate:
58.14%
Total runs:
42
Run Growth:
33
Growth Rate:
78.57%
Total runs:
38
Run Growth:
16
Growth Rate:
43.24%
Total runs:
37
Run Growth:
20
Growth Rate:
68.97%
Total runs:
37
Run Growth:
16
Growth Rate:
43.24%
Total runs:
37
Run Growth:
-5
Growth Rate:
-13.51%
Total runs:
36
Run Growth:
23
Growth Rate:
76.67%
Total runs:
35
Run Growth:
24
Growth Rate:
68.57%
Total runs:
35
Run Growth:
15
Growth Rate:
42.86%
Total runs:
33
Run Growth:
31
Growth Rate:
93.94%
Total runs:
32
Run Growth:
25
Growth Rate:
78.13%
Total runs:
31
Run Growth:
26
Growth Rate:
83.87%
Total runs:
28
Run Growth:
28
Growth Rate:
100.00%
Total runs:
28
Run Growth:
15
Growth Rate:
53.57%
Total runs:
28
Run Growth:
0
Growth Rate:
0.00%
Total runs:
28
Run Growth:
22
Growth Rate:
78.57%
Total runs:
27
Run Growth:
-5
Growth Rate:
-18.52%
Total runs:
27
Run Growth:
18
Growth Rate:
64.29%
Total runs:
26
Run Growth:
6
Growth Rate:
23.08%
Total runs:
26
Run Growth:
13
Growth Rate:
50.00%
Total runs:
26
Run Growth:
8
Growth Rate:
30.77%
Total runs:
25
Run Growth:
11
Growth Rate:
52.38%
Total runs:
24
Run Growth:
13
Growth Rate:
54.17%
Total runs:
24
Run Growth:
6
Growth Rate:
35.29%
Total runs:
24
Run Growth:
12
Growth Rate:
50.00%
Total runs:
23
Run Growth:
11
Growth Rate:
47.83%
Total runs:
23
Run Growth:
9
Growth Rate:
40.91%
Total runs:
23
Run Growth:
7
Growth Rate:
35.00%
Total runs:
22
Run Growth:
12
Growth Rate:
54.55%
Total runs:
22
Run Growth:
13
Growth Rate:
59.09%
Total runs:
22
Run Growth:
16
Growth Rate:
72.73%
Total runs:
22
Run Growth:
3
Growth Rate:
13.64%
Total runs:
21
Run Growth:
12
Growth Rate:
57.14%
Total runs:
21
Run Growth:
13
Growth Rate:
61.90%
Total runs:
21
Run Growth:
9
Growth Rate:
42.86%
Total runs:
21
Run Growth:
13
Growth Rate:
61.90%
Total runs:
21
Run Growth:
10
Growth Rate:
50.00%
Total runs:
20
Run Growth:
-154
Growth Rate:
-770.00%
Total runs:
20
Run Growth:
14
Growth Rate:
66.67%
Total runs:
20
Run Growth:
9
Growth Rate:
47.37%
Total runs:
20
Run Growth:
8
Growth Rate:
40.00%
Total runs:
20
Run Growth:
11
Growth Rate:
55.00%
Total runs:
19
Run Growth:
12
Growth Rate:
60.00%
Total runs:
18
Run Growth:
4
Growth Rate:
22.22%
Total runs:
18
Run Growth:
11
Growth Rate:
61.11%
Total runs:
18
Run Growth:
4
Growth Rate:
28.57%
Total runs:
17
Run Growth:
6
Growth Rate:
35.29%
Total runs:
17
Run Growth:
13
Growth Rate:
76.47%
Total runs:
17
Run Growth:
9
Growth Rate:
56.25%
Total runs:
17
Run Growth:
6
Growth Rate:
35.29%
Total runs:
17
Run Growth:
10
Growth Rate:
58.82%
Total runs:
16
Run Growth:
6
Growth Rate:
35.29%
Total runs:
16
Run Growth:
11
Growth Rate:
68.75%
Total runs:
15
Run Growth:
11
Growth Rate:
73.33%
Total runs:
15
Run Growth:
4
Growth Rate:
25.00%
Total runs:
15
Run Growth:
8
Growth Rate:
53.33%
Total runs:
15
Run Growth:
10
Growth Rate:
66.67%
Total runs:
15
Run Growth:
8
Growth Rate:
53.33%
Total runs:
15
Run Growth:
-5
Growth Rate:
-33.33%
Total runs:
15
Run Growth:
10
Growth Rate:
66.67%
Total runs:
14
Run Growth:
6
Growth Rate:
42.86%
Total runs:
14
Run Growth:
-24
Growth Rate:
-171.43%