Sponsored by
APIMart
appvoid / no-prompt-1.3b
Model's Last Updated: December 16 2023
text-generation
Introduction of no-prompt-1.3b
Model Details of no-prompt-1.3b
no-prompt
a sheared-llama-1.3b fine-tuning
This model uses an 1.3 billion parameters model as base to be further fine-tuned on the same data as palmer. It works pretty good and even surpasses sota model on
hellaswag
.
evaluation
| Model | ARC_C | HellaSwag | PIQA | Winogrande |
|---|---|---|---|---|
| tinyllama-2t | 0.2807 | 0.5463 | 0.7067 | 0.5683 |
| palmer-001 | 0.2807 | 0.5524 | 0.7106 | 0.5896 |
| sheared-1.3b | 0.2910 | 0.5935 | 0.7339 | 0.5809 |
| no-prompt-1.3b | 0.3157 | 0.6022 | 0.7334 | 0.5864 |
| falcon-rw-1b-instruct-openorca (sota) | 0.3362 | 0.5997 | 0.7394 | 0.6148 |
This model was trained on less than 25% of the dataset yet achieves competitive performance to current sota on open llm leaderboard.
training
Training took ~5 P100 gpu hours. It was trained on 15,000 gpt-4 shuffled samples. no-prompt was fine-tuned using lower learning rates ensuring it keeps as much general knowledge as possible.
prompt
no prompt
limitations
Hallucinations are frequent, just as any transformer model this size.
Runs of appvoid no-prompt-1.3b on huggingface.co
18
Total runs
-1
24-hour runs
-2
3-day runs
0
7-day runs
6
30-day runs
More Information About no-prompt-1.3b huggingface.co Model
Url of no-prompt-1.3b
no-prompt-1.3b huggingface.co Url
Provider of no-prompt-1.3b huggingface.co
Other API from appvoid
Total runs:
122
Run Growth:
20
Growth Rate:
16.39%
Total runs:
58
Run Growth:
37
Growth Rate:
63.79%
Total runs:
33
Run Growth:
22
Growth Rate:
66.67%
Total runs:
27
Run Growth:
3
Growth Rate:
11.11%
Total runs:
25
Run Growth:
16
Growth Rate:
64.00%
Total runs:
24
Run Growth:
19
Growth Rate:
79.17%
Total runs:
24
Run Growth:
14
Growth Rate:
58.33%
Total runs:
22
Run Growth:
15
Growth Rate:
68.18%
Total runs:
20
Run Growth:
10
Growth Rate:
50.00%
Total runs:
20
Run Growth:
9
Growth Rate:
45.00%
Total runs:
19
Run Growth:
13
Growth Rate:
68.42%
Total runs:
19
Run Growth:
15
Growth Rate:
78.95%
Total runs:
19
Run Growth:
9
Growth Rate:
47.37%
Total runs:
18
Run Growth:
8
Growth Rate:
44.44%
Total runs:
18
Run Growth:
10
Growth Rate:
55.56%
Total runs:
18
Run Growth:
4
Growth Rate:
22.22%
Total runs:
17
Run Growth:
2
Growth Rate:
11.76%
Total runs:
15
Run Growth:
15
Growth Rate:
100.00%
Total runs:
15
Run Growth:
8
Growth Rate:
53.33%
Total runs:
14
Run Growth:
8
Growth Rate:
57.14%
Total runs:
14
Run Growth:
5
Growth Rate:
35.71%