Total runs:
2.5K
Run Growth:
433
Growth Rate:
16.78%
Sponsored by
Vmake Labs Video Enhancer
afrideva / phi-2_dolly_instruction_polish-GGUF
Model's Last Updated: December 25 2023
text-generation
Introduction of phi-2_dolly_instruction_polish-GGUF
Model Details of phi-2_dolly_instruction_polish-GGUF
s3nh/phi-2_dolly_instruction_polish-GGUF
Quantized GGUF model files for phi-2_dolly_instruction_polish from s3nh
| Name | Quant method | Size |
|---|---|---|
| phi-2_dolly_instruction_polish.fp16.gguf | fp16 | 5.56 GB |
| phi-2_dolly_instruction_polish.q2_k.gguf | q2_k | 1.17 GB |
| phi-2_dolly_instruction_polish.q3_k_m.gguf | q3_k_m | 1.48 GB |
| phi-2_dolly_instruction_polish.q4_k_m.gguf | q4_k_m | 1.79 GB |
| phi-2_dolly_instruction_polish.q5_k_m.gguf | q5_k_m | 2.07 GB |
| phi-2_dolly_instruction_polish.q6_k.gguf | q6_k | 2.29 GB |
| phi-2_dolly_instruction_polish.q8_0.gguf | q8_0 | 2.96 GB |
Original Model Card:
phi-2-sft-out
This model is a fine-tuned version of microsoft/phi-2 on the None dataset. It achieves the following results on the evaluation set:
- Loss: 1.2813
Model description
More information needed
Intended uses & limitations
More information needed
Training and evaluation data
More information needed
Training procedure
Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 3e-06
- train_batch_size: 1
- eval_batch_size: 1
- seed: 42
- optimizer: Adam with betas=(0.9,0.95) and epsilon=1e-05
- lr_scheduler_type: cosine
- lr_scheduler_warmup_steps: 10
- num_epochs: 4
Training results
| Training Loss | Epoch | Step | Validation Loss |
|---|---|---|---|
| No log | 0.0 | 1 | 1.7973 |
| 1.9767 | 0.25 | 5290 | 1.4832 |
| 1.8474 | 0.5 | 10580 | 1.4356 |
| 1.8121 | 0.75 | 15870 | 1.4022 |
| 1.8333 | 1.0 | 21160 | 1.3678 |
| 1.6601 | 1.25 | 26450 | 1.3508 |
| 1.5452 | 1.5 | 31740 | 1.3357 |
| 1.7381 | 1.75 | 37030 | 1.3191 |
| 1.6256 | 2.0 | 42320 | 1.3090 |
| 1.5521 | 2.25 | 47610 | 1.2961 |
| 1.8318 | 2.5 | 52900 | 1.2910 |
| 1.6761 | 2.75 | 58190 | 1.2901 |
| 1.6312 | 3.0 | 63480 | 1.2879 |
| 1.7003 | 3.25 | 68770 | 1.2820 |
| 1.6915 | 3.5 | 74060 | 1.2814 |
| 1.5757 | 3.75 | 79350 | 1.2813 |
Framework versions
- Transformers 4.37.0.dev0
- Pytorch 2.1.2+cu121
- Datasets 2.16.0
- Tokenizers 0.15.0
Training procedure
The following
bitsandbytes
quantization config was used during training:
- quant_method: bitsandbytes
- load_in_8bit: False
- load_in_4bit: True
- llm_int8_threshold: 6.0
- llm_int8_skip_modules: None
- llm_int8_enable_fp32_cpu_offload: False
- llm_int8_has_fp16_weight: False
- bnb_4bit_quant_type: nf4
- bnb_4bit_use_double_quant: True
- bnb_4bit_compute_dtype: bfloat16
Framework versions
- PEFT 0.6.0
Runs of afrideva phi-2_dolly_instruction_polish-GGUF on huggingface.co
843
Total runs
18
24-hour runs
-9
3-day runs
81
7-day runs
176
30-day runs
More Information About phi-2_dolly_instruction_polish-GGUF huggingface.co Model
Url of phi-2_dolly_instruction_polish-GGUF
phi-2_dolly_instruction_polish-GGUF huggingface.co Url
Provider of phi-2_dolly_instruction_polish-GGUF huggingface.co
Other API from afrideva
Updated:May 12 2024
Total runs:
1.5K
Run Growth:
283
Growth Rate:
18.88%
Total runs:
1.3K
Run Growth:
109
Growth Rate:
8.04%
Total runs:
1.1K
Run Growth:
72
Growth Rate:
6.62%
Total runs:
1.0K
Run Growth:
35
Growth Rate:
3.52%
Total runs:
916
Run Growth:
-111
Growth Rate:
-12.28%
Total runs:
889
Run Growth:
-59
Growth Rate:
-6.77%
Total runs:
852
Run Growth:
-66
Growth Rate:
-7.74%
Total runs:
844
Run Growth:
-97
Growth Rate:
-11.56%
Total runs:
841
Run Growth:
661
Growth Rate:
76.68%
Total runs:
821
Run Growth:
97
Growth Rate:
12.26%
Total runs:
810
Run Growth:
-123
Growth Rate:
-14.95%
Total runs:
810
Run Growth:
192
Growth Rate:
23.59%
Total runs:
799
Run Growth:
233
Growth Rate:
30.14%
Total runs:
769
Run Growth:
173
Growth Rate:
23.10%
Total runs:
758
Run Growth:
-70
Growth Rate:
-9.42%
Total runs:
749
Run Growth:
-36
Growth Rate:
-4.77%
Total runs:
747
Run Growth:
-50
Growth Rate:
-6.77%
Total runs:
745
Run Growth:
13
Growth Rate:
1.71%
Total runs:
742
Run Growth:
-142
Growth Rate:
-19.22%
Total runs:
737
Run Growth:
582
Growth Rate:
75.88%
Total runs:
734
Run Growth:
-39
Growth Rate:
-5.36%
Total runs:
730
Run Growth:
-16
Growth Rate:
-2.19%
Total runs:
715
Run Growth:
-62
Growth Rate:
-8.81%
Total runs:
711
Run Growth:
53
Growth Rate:
7.60%
Total runs:
704
Run Growth:
262
Growth Rate:
37.22%
Total runs:
699
Run Growth:
16
Growth Rate:
2.29%
Total runs:
696
Run Growth:
54
Growth Rate:
7.81%
Total runs:
694
Run Growth:
-51
Growth Rate:
-7.28%
Total runs:
684
Run Growth:
-16
Growth Rate:
-2.32%
Total runs:
682
Run Growth:
-79
Growth Rate:
-11.67%
Total runs:
678
Run Growth:
55
Growth Rate:
8.01%
Total runs:
676
Run Growth:
10
Growth Rate:
1.52%
Total runs:
673
Run Growth:
-74
Growth Rate:
-11.16%
Total runs:
671
Run Growth:
320
Growth Rate:
47.83%
Total runs:
661
Run Growth:
116
Growth Rate:
16.89%
Total runs:
659
Run Growth:
-26
Growth Rate:
-3.92%
Total runs:
655
Run Growth:
582
Growth Rate:
82.55%
Total runs:
649
Run Growth:
219
Growth Rate:
34.65%
Total runs:
646
Run Growth:
-10
Growth Rate:
-1.58%
Total runs:
643
Run Growth:
51
Growth Rate:
7.94%
Total runs:
638
Run Growth:
8
Growth Rate:
1.26%
Total runs:
635
Run Growth:
16
Growth Rate:
2.57%
Total runs:
628
Run Growth:
68
Growth Rate:
11.15%
Total runs:
628
Run Growth:
-61
Growth Rate:
-9.95%
Total runs:
621
Run Growth:
401
Growth Rate:
62.36%
Total runs:
599
Run Growth:
-3
Growth Rate:
-0.50%
Total runs:
588
Run Growth:
-328
Growth Rate:
-55.59%
Total runs:
574
Run Growth:
389
Growth Rate:
67.30%
Total runs:
566
Run Growth:
-66
Growth Rate:
-11.81%
Total runs:
560
Run Growth:
31
Growth Rate:
5.60%
Total runs:
553
Run Growth:
-49
Growth Rate:
-9.25%
Total runs:
547
Run Growth:
368
Growth Rate:
64.00%
Total runs:
545
Run Growth:
104
Growth Rate:
18.94%
Total runs:
538
Run Growth:
63
Growth Rate:
12.19%
Total runs:
532
Run Growth:
117
Growth Rate:
22.03%
Total runs:
531
Run Growth:
419
Growth Rate:
73.90%
Total runs:
531
Run Growth:
-39
Growth Rate:
-7.40%
Total runs:
531
Run Growth:
-6
Growth Rate:
-1.12%
Total runs:
514
Run Growth:
-240
Growth Rate:
-47.24%
Total runs:
512
Run Growth:
-14
Growth Rate:
-2.72%
Total runs:
509
Run Growth:
-54
Growth Rate:
-10.53%
Total runs:
506
Run Growth:
30
Growth Rate:
5.98%
Total runs:
501
Run Growth:
186
Growth Rate:
36.61%
Total runs:
495
Run Growth:
70
Growth Rate:
14.37%
Total runs:
494
Run Growth:
247
Growth Rate:
45.24%
Total runs:
489
Run Growth:
172
Growth Rate:
35.10%
Total runs:
483
Run Growth:
-41
Growth Rate:
-8.42%
Total runs:
480
Run Growth:
22
Growth Rate:
4.59%
Total runs:
478
Run Growth:
-63
Growth Rate:
-13.40%
Total runs:
475
Run Growth:
45
Growth Rate:
9.45%
Total runs:
475
Run Growth:
-17
Growth Rate:
-3.66%
Total runs:
468
Run Growth:
80
Growth Rate:
17.02%
Total runs:
464
Run Growth:
103
Growth Rate:
22.49%
Total runs:
461
Run Growth:
321
Growth Rate:
68.74%
Total runs:
459
Run Growth:
14
Growth Rate:
3.02%
Total runs:
459
Run Growth:
-73
Growth Rate:
-16.26%
Total runs:
458
Run Growth:
-75
Growth Rate:
-16.52%
Total runs:
444
Run Growth:
267
Growth Rate:
57.05%
Total runs:
435
Run Growth:
-37
Growth Rate:
-8.49%
Total runs:
434
Run Growth:
157
Growth Rate:
35.76%
Total runs:
431
Run Growth:
-116
Growth Rate:
-27.04%
Total runs:
407
Run Growth:
92
Growth Rate:
22.49%
Total runs:
402
Run Growth:
-20
Growth Rate:
-4.96%
Total runs:
399
Run Growth:
12
Growth Rate:
3.04%
Total runs:
399
Run Growth:
-28
Growth Rate:
-7.00%
Total runs:
395
Run Growth:
8
Growth Rate:
2.04%
Total runs:
391
Run Growth:
-53
Growth Rate:
-13.95%
Total runs:
391
Run Growth:
285
Growth Rate:
71.61%
Total runs:
386
Run Growth:
295
Growth Rate:
72.84%
Total runs:
381
Run Growth:
94
Growth Rate:
24.29%
Total runs:
375
Run Growth:
91
Growth Rate:
24.40%
Total runs:
371
Run Growth:
-33
Growth Rate:
-8.66%
Total runs:
371
Run Growth:
-86
Growth Rate:
-22.99%
Total runs:
367
Run Growth:
19
Growth Rate:
5.16%