Total runs:
6.7K
Run Growth:
6.5K
Growth Rate:
96.68%
Sponsored by
APIMart
brittlewis12 / Phi-3-mini-4k-instruct-GGUF
Model's Last Updated: July 22 2024
text-generation
Introduction of Phi-3-mini-4k-instruct-GGUF
Model Details of Phi-3-mini-4k-instruct-GGUF
Phi 3 Mini 4K Instruct GGUF
Updated with Microsoft’s latest model changes as of July 21, 2024
Original model : Phi-3-mini-4k-instruct
Model creator : Microsoft
This repo contains GGUF format model files for Microsoft’s Phi 3 Mini 4K Instruct.
The Phi-3-Mini-4K-Instruct is a 3.8B parameters, lightweight, state-of-the-art open model trained with the Phi-3 datasets that includes both synthetic data and the filtered publicly available websites data with a focus on high-quality and reasoning dense properties.
Learn more on Microsoft’s Model page .
What is GGUF?
GGUF is a file format for representing AI models. It is the third version of the format, introduced by the llama.cpp team on August 21st 2023. It is a replacement for GGML, which is no longer supported by llama.cpp. Converted with llama.cpp build 3432 (revision 45f2c19 ), using autogguf .
Prompt template
<|system|>
{{system_prompt}}<|end|>
<|user|>
{{prompt}}<|end|>
<|assistant|>
Download & run with cnvrs on iPhone, iPad, and Mac!
cnvrs is the best app for private, local AI on your device:
- create & save Characters with custom system prompts & temperature settings
- download and experiment with any GGUF model you can find on HuggingFace !
- make it your own with custom Theme colors
- powered by Metal ⚡️ & Llama.cpp , with haptics during response streaming!
- try it out yourself today, on Testflight !
- follow cnvrs on twitter to stay up to date
Original Model Evaluation
Comparison of July update vs original April release:
| Benchmarks | Original | June 2024 Update |
|---|---|---|
| Instruction Extra Hard | 5.7 | 6.0 |
| Instruction Hard | 4.9 | 5.1 |
| Instructions Challenge | 24.6 | 42.3 |
| JSON Structure Output | 11.5 | 52.3 |
| XML Structure Output | 14.4 | 49.8 |
| GPQA | 23.7 | 30.6 |
| MMLU | 68.8 | 70.9 |
| Average | 21.9 | 36.7 |
Original April release
As is now standard, we use few-shot prompts to evaluate the models, at temperature 0. The prompts and number of shots are part of a Microsoft internal tool to evaluate language models, and in particular we did no optimization to the pipeline for Phi-3. More specifically, we do not change prompts, pick different few-shot examples, change prompt format, or do any other form of optimization for the model.
The number of k–shot examples is listed per-benchmark.
|
Phi-3-Mini-4K-In
3.8b |
Phi-2
2.7b |
Mistral
7b |
Gemma
7b |
Llama-3-In
8b |
Mixtral
8x7b |
GPT-3.5
version 1106 |
|
|---|---|---|---|---|---|---|---|
|
MMLU
5-Shot |
68.8 | 56.3 | 61.7 | 63.6 | 66.5 | 68.4 | 71.4 |
|
HellaSwag
5-Shot |
76.7 | 53.6 | 58.5 | 49.8 | 71.1 | 70.4 | 78.8 |
|
ANLI
7-Shot |
52.8 | 42.5 | 47.1 | 48.7 | 57.3 | 55.2 | 58.1 |
|
GSM-8K
0-Shot; CoT |
82.5 | 61.1 | 46.4 | 59.8 | 77.4 | 64.7 | 78.1 |
|
MedQA
2-Shot |
53.8 | 40.9 | 49.6 | 50.0 | 60.5 | 62.2 | 63.4 |
|
AGIEval
0-Shot |
37.5 | 29.8 | 35.1 | 42.1 | 42.0 | 45.2 | 48.4 |
|
TriviaQA
5-Shot |
64.0 | 45.2 | 72.3 | 75.2 | 67.7 | 82.2 | 85.8 |
|
Arc-C
10-Shot |
84.9 | 75.9 | 78.6 | 78.3 | 82.8 | 87.3 | 87.4 |
|
Arc-E
10-Shot |
94.6 | 88.5 | 90.6 | 91.4 | 93.4 | 95.6 | 96.3 |
|
PIQA
5-Shot |
84.2 | 60.2 | 77.7 | 78.1 | 75.7 | 86.0 | 86.6 |
|
SociQA
5-Shot |
76.6 | 68.3 | 74.6 | 65.5 | 73.9 | 75.9 | 68.3 |
|
BigBench-Hard
0-Shot |
71.7 | 59.4 | 57.3 | 59.6 | 51.5 | 69.7 | 68.32 |
|
WinoGrande
5-Shot |
70.8 | 54.7 | 54.2 | 55.6 | 65 | 62.0 | 68.8 |
|
OpenBookQA
10-Shot |
83.2 | 73.6 | 79.8 | 78.6 | 82.6 | 85.8 | 86.0 |
|
BoolQ
0-Shot |
77.6 | -- | 72.2 | 66.0 | 80.9 | 77.6 | 79.1 |
|
CommonSenseQA
10-Shot |
80.2 | 69.3 | 72.6 | 76.2 | 79 | 78.1 | 79.6 |
|
TruthfulQA
10-Shot |
65.0 | -- | 52.1 | 53.0 | 63.2 | 60.1 | 85.8 |
|
HumanEval
0-Shot |
59.1 | 47.0 | 28.0 | 34.1 | 60.4 | 37.8 | 62.2 |
|
MBPP
3-Shot |
53.8 | 60.6 | 50.8 | 51.5 | 67.7 | 60.2 | 77.8 |
Runs of brittlewis12 Phi-3-mini-4k-instruct-GGUF on huggingface.co
624
Total runs
-7
24-hour runs
-31
3-day runs
-70
7-day runs
-130
30-day runs
More Information About Phi-3-mini-4k-instruct-GGUF huggingface.co Model
Url of Phi-3-mini-4k-instruct-GGUF
Phi-3-mini-4k-instruct-GGUF huggingface.co Url
Provider of Phi-3-mini-4k-instruct-GGUF huggingface.co
Other API from brittlewis12
Updated:May 04 2026
Total runs:
1.9K
Run Growth:
-1.1K
Growth Rate:
-60.29%
Total runs:
1.5K
Run Growth:
-624
Growth Rate:
-41.24%
Total runs:
1.3K
Run Growth:
-292
Growth Rate:
-23.08%
Total runs:
1.1K
Run Growth:
391
Growth Rate:
35.58%
Total runs:
925
Run Growth:
626
Growth Rate:
67.68%
Total runs:
803
Run Growth:
-956
Growth Rate:
-119.05%
Total runs:
682
Run Growth:
-75
Growth Rate:
-11.00%
Total runs:
675
Run Growth:
-531
Growth Rate:
-78.67%
Total runs:
624
Run Growth:
-202
Growth Rate:
-32.37%
Total runs:
575
Run Growth:
-1.3K
Growth Rate:
-226.26%
Total runs:
548
Run Growth:
-374
Growth Rate:
-68.25%
Total runs:
532
Run Growth:
-277
Growth Rate:
-52.07%
Total runs:
530
Run Growth:
-1.4K
Growth Rate:
-264.72%
Total runs:
476
Run Growth:
-990
Growth Rate:
-207.98%
Total runs:
418
Run Growth:
-7
Growth Rate:
-1.69%
Total runs:
385
Run Growth:
-606
Growth Rate:
-157.40%
Total runs:
383
Run Growth:
-334
Growth Rate:
-87.21%
Total runs:
379
Run Growth:
-972
Growth Rate:
-256.46%
Total runs:
336
Run Growth:
45
Growth Rate:
13.85%
Total runs:
324
Run Growth:
-444
Growth Rate:
-137.04%
Total runs:
318
Run Growth:
-33
Growth Rate:
-9.97%
Total runs:
311
Run Growth:
-169
Growth Rate:
-54.34%
Total runs:
308
Run Growth:
-259
Growth Rate:
-84.09%
Total runs:
304
Run Growth:
-479
Growth Rate:
-157.57%
Total runs:
300
Run Growth:
-655
Growth Rate:
-218.33%
Total runs:
299
Run Growth:
-48
Growth Rate:
-16.05%
Total runs:
298
Run Growth:
-121
Growth Rate:
-40.60%
Total runs:
285
Run Growth:
-605
Growth Rate:
-212.28%
Total runs:
284
Run Growth:
-799
Growth Rate:
-281.34%
Total runs:
280
Run Growth:
131
Growth Rate:
46.79%
Total runs:
277
Run Growth:
-363
Growth Rate:
-126.92%
Total runs:
254
Run Growth:
-700
Growth Rate:
-275.59%
Total runs:
242
Run Growth:
-857
Growth Rate:
-354.13%
Total runs:
241
Run Growth:
47
Growth Rate:
19.26%
Total runs:
210
Run Growth:
-216
Growth Rate:
-102.86%
Total runs:
197
Run Growth:
129
Growth Rate:
65.48%
Total runs:
184
Run Growth:
-235
Growth Rate:
-127.72%
Total runs:
182
Run Growth:
-96
Growth Rate:
-52.75%
Total runs:
181
Run Growth:
-219
Growth Rate:
-120.99%
Total runs:
177
Run Growth:
-963
Growth Rate:
-541.01%
Total runs:
170
Run Growth:
-1.5K
Growth Rate:
-916.57%
Total runs:
161
Run Growth:
-151
Growth Rate:
-93.79%
Total runs:
154
Run Growth:
-130
Growth Rate:
-84.42%
Total runs:
148
Run Growth:
-84
Growth Rate:
-56.76%
Total runs:
146
Run Growth:
-901
Growth Rate:
-617.12%
Total runs:
146
Run Growth:
50
Growth Rate:
34.25%
Total runs:
136
Run Growth:
-302
Growth Rate:
-222.06%
Total runs:
132
Run Growth:
-831
Growth Rate:
-629.55%
Total runs:
131
Run Growth:
-479
Growth Rate:
-365.65%
Total runs:
130
Run Growth:
-533
Growth Rate:
-410.00%
Total runs:
124
Run Growth:
58
Growth Rate:
46.77%
Total runs:
123
Run Growth:
-62
Growth Rate:
-50.41%
Total runs:
121
Run Growth:
-850
Growth Rate:
-702.48%
Total runs:
118
Run Growth:
-275
Growth Rate:
-233.05%
Total runs:
112
Run Growth:
-81
Growth Rate:
-74.31%
Total runs:
107
Run Growth:
-304
Growth Rate:
-284.11%
Total runs:
102
Run Growth:
-123
Growth Rate:
-120.59%
Total runs:
88
Run Growth:
-95
Growth Rate:
-107.95%
Total runs:
88
Run Growth:
-282
Growth Rate:
-320.45%
Total runs:
81
Run Growth:
-88
Growth Rate:
-108.64%
Total runs:
66
Run Growth:
28
Growth Rate:
42.42%
Total runs:
61
Run Growth:
-13
Growth Rate:
-21.31%
Total runs:
61
Run Growth:
-451
Growth Rate:
-739.34%
Total runs:
60
Run Growth:
-191
Growth Rate:
-318.33%
Total runs:
59
Run Growth:
-878
Growth Rate:
-1488.14%
Total runs:
56
Run Growth:
-57
Growth Rate:
-101.79%
Total runs:
56
Run Growth:
-317
Growth Rate:
-566.07%
Total runs:
53
Run Growth:
-89
Growth Rate:
-167.92%
Total runs:
49
Run Growth:
-255
Growth Rate:
-520.41%
Total runs:
45
Run Growth:
-111
Growth Rate:
-246.67%
Total runs:
42
Run Growth:
-43
Growth Rate:
-107.50%
Total runs:
42
Run Growth:
-1.0K
Growth Rate:
-2495.24%
Total runs:
42
Run Growth:
-154
Growth Rate:
-358.14%
Total runs:
42
Run Growth:
-924
Growth Rate:
-2200.00%
Total runs:
41
Run Growth:
-127
Growth Rate:
-309.76%
Total runs:
39
Run Growth:
-400
Growth Rate:
-1025.64%
Total runs:
36
Run Growth:
-92
Growth Rate:
-255.56%
Total runs:
36
Run Growth:
-78
Growth Rate:
-216.67%
Total runs:
36
Run Growth:
-101
Growth Rate:
-280.56%
Total runs:
35
Run Growth:
-20
Growth Rate:
-57.14%
Total runs:
31
Run Growth:
-212
Growth Rate:
-683.87%
Total runs:
31
Run Growth:
1
Growth Rate:
3.23%
Total runs:
28
Run Growth:
3
Growth Rate:
10.71%
Total runs:
23
Run Growth:
-953
Growth Rate:
-4143.48%
Total runs:
23
Run Growth:
-96
Growth Rate:
-417.39%
Total runs:
22
Run Growth:
-110
Growth Rate:
-500.00%
Total runs:
22
Run Growth:
-484
Growth Rate:
-2200.00%
Total runs:
16
Run Growth:
-129
Growth Rate:
-806.25%
Total runs:
16
Run Growth:
-53
Growth Rate:
-331.25%
Total runs:
16
Run Growth:
-399
Growth Rate:
-2493.75%
Total runs:
13
Run Growth:
-42
Growth Rate:
-323.08%
Total runs:
10
Run Growth:
-933
Growth Rate:
-9330.00%
Total runs:
8
Run Growth:
-31
Growth Rate:
-387.50%
Total runs:
7
Run Growth:
-57
Growth Rate:
-814.29%
Total runs:
6
Run Growth:
-77
Growth Rate:
-1283.33%
Total runs:
2
Run Growth:
-94
Growth Rate:
-4700.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%