Total runs:
1.6K
Run Growth:
488
Growth Rate:
30.58%
Sponsored by
iMean AI Trip Planner
gaianet / Phi-3-medium-4k-instruct-GGUF
Model's Last Updated: May 22 2024
text-generation
Introduction of Phi-3-medium-4k-instruct-GGUF
Model Details of Phi-3-medium-4k-instruct-GGUF
Phi-3-medium-4k-instruct-GGUF
Original Model
microsoft/Phi-3-medium-4k-instruct
Run with Gaianet
Prompt template
prompt template:
phi-3-chat
Context size
chat_ctx_size:
5120
Run with GaiaNet
-
Quick start: https://docs.gaianet.ai/node-guide/quick-start
-
Customize your node: https://docs.gaianet.ai/node-guide/customize
Quantized GGUF Models
| Name | Quant method | Bits | Size | Use case |
|---|---|---|---|---|
| Phi-3-medium-4k-instruct-Q2_K.gguf | Q2_K | 2 | 5.14 GB | smallest, significant quality loss - not recommended for most purposes |
| Phi-3-medium-4k-instruct-Q3_K_L.gguf | Q3_K_L | 3 | 7.49 GB | small, substantial quality loss |
| Phi-3-medium-4k-instruct-Q3_K_M.gguf | Q3_K_M | 3 | 6.92 GB | very small, high quality loss |
| Phi-3-medium-4k-instruct-Q3_K_S.gguf | Q3_K_S | 3 | 6.06 GB | very small, high quality loss |
| Phi-3-medium-4k-instruct-Q4_0.gguf | Q4_0 | 4 | 7.9 GB | legacy; small, very high quality loss - prefer using Q3_K_M |
| Phi-3-medium-4k-instruct-Q4_K_M.gguf | Q4_K_M | 4 | 8.57 GB | medium, balanced quality - recommended |
| Phi-3-medium-4k-instruct-Q4_K_S.gguf | Q4_K_S | 4 | 7.95 GB | small, greater quality loss |
| Phi-3-medium-4k-instruct-Q5_0.gguf | Q5_0 | 5 | 9.62 GB | legacy; medium, balanced quality - prefer using Q4_K_M |
| Phi-3-medium-4k-instruct-Q5_K_M.gguf | Q5_K_M | 5 | 10.1 GB | large, very low quality loss - recommended |
| Phi-3-medium-4k-instruct-Q5_K_S.gguf | Q5_K_S | 5 | 9.62 GB | large, low quality loss - recommended |
| Phi-3-medium-4k-instruct-Q6_K.gguf | Q6_K | 6 | 11.5 GB | very large, extremely low quality loss |
| Phi-3-medium-4k-instruct-Q8_0.gguf | Q8_0 | 8 | 14.8 GB | very large, extremely low quality loss - not recommended |
| Phi-3-medium-4k-instruct-f16.gguf | f16 | 16 | 27.9 GB |
Quantized with llama.cpp b2961.
Runs of gaianet Phi-3-medium-4k-instruct-GGUF on huggingface.co
704
Total runs
0
24-hour runs
68
3-day runs
44
7-day runs
223
30-day runs
More Information About Phi-3-medium-4k-instruct-GGUF huggingface.co Model
Url of Phi-3-medium-4k-instruct-GGUF
Phi-3-medium-4k-instruct-GGUF huggingface.co Url
Provider of Phi-3-medium-4k-instruct-GGUF huggingface.co
Other API from gaianet
Updated:August 21 2024
Total runs:
1.2K
Run Growth:
517
Growth Rate:
40.58%
Total runs:
1.3K
Run Growth:
-121
Growth Rate:
-9.68%
Total runs:
1.5K
Run Growth:
880
Growth Rate:
71.90%
Total runs:
1.0K
Run Growth:
452
Growth Rate:
44.49%
Total runs:
1.0K
Run Growth:
491
Growth Rate:
48.86%
Total runs:
935
Run Growth:
394
Growth Rate:
42.18%
Total runs:
944
Run Growth:
759
Growth Rate:
82.68%
Total runs:
893
Run Growth:
342
Growth Rate:
37.38%
Total runs:
889
Run Growth:
487
Growth Rate:
55.09%
Total runs:
966
Run Growth:
257
Growth Rate:
30.13%
Total runs:
860
Run Growth:
397
Growth Rate:
46.60%
Total runs:
827
Run Growth:
445
Growth Rate:
54.67%
Total runs:
820
Run Growth:
360
Growth Rate:
44.39%
Total runs:
804
Run Growth:
523
Growth Rate:
65.21%
Total runs:
778
Run Growth:
347
Growth Rate:
44.49%
Total runs:
808
Run Growth:
618
Growth Rate:
81.32%
Total runs:
740
Run Growth:
312
Growth Rate:
41.88%
Total runs:
740
Run Growth:
368
Growth Rate:
49.66%
Total runs:
816
Run Growth:
528
Growth Rate:
72.03%
Total runs:
719
Run Growth:
214
Growth Rate:
29.27%
Total runs:
689
Run Growth:
496
Growth Rate:
68.60%
Total runs:
749
Run Growth:
433
Growth Rate:
61.07%
Total runs:
703
Run Growth:
227
Growth Rate:
32.11%
Total runs:
686
Run Growth:
530
Growth Rate:
75.82%
Total runs:
694
Run Growth:
436
Growth Rate:
62.73%
Total runs:
703
Run Growth:
363
Growth Rate:
52.38%
Total runs:
691
Run Growth:
515
Growth Rate:
74.75%
Total runs:
664
Run Growth:
344
Growth Rate:
51.81%
Total runs:
663
Run Growth:
390
Growth Rate:
59.00%
Total runs:
668
Run Growth:
515
Growth Rate:
80.09%
Total runs:
637
Run Growth:
146
Growth Rate:
22.96%
Total runs:
637
Run Growth:
356
Growth Rate:
56.15%
Total runs:
641
Run Growth:
372
Growth Rate:
58.68%
Total runs:
621
Run Growth:
-1.1K
Growth Rate:
-170.41%
Total runs:
621
Run Growth:
360
Growth Rate:
58.06%
Total runs:
599
Run Growth:
277
Growth Rate:
45.41%
Total runs:
629
Run Growth:
365
Growth Rate:
60.53%
Total runs:
601
Run Growth:
316
Growth Rate:
52.75%
Total runs:
594
Run Growth:
432
Growth Rate:
73.97%
Total runs:
569
Run Growth:
357
Growth Rate:
62.20%
Total runs:
560
Run Growth:
371
Growth Rate:
64.86%
Total runs:
550
Run Growth:
344
Growth Rate:
60.25%
Total runs:
613
Run Growth:
380
Growth Rate:
67.38%
Total runs:
606
Run Growth:
474
Growth Rate:
84.49%
Total runs:
563
Run Growth:
329
Growth Rate:
58.86%
Total runs:
556
Run Growth:
323
Growth Rate:
58.20%
Total runs:
579
Run Growth:
112
Growth Rate:
20.22%
Total runs:
544
Run Growth:
331
Growth Rate:
60.07%
Total runs:
550
Run Growth:
311
Growth Rate:
56.65%
Total runs:
552
Run Growth:
276
Growth Rate:
50.46%
Total runs:
538
Run Growth:
436
Growth Rate:
80.44%
Total runs:
535
Run Growth:
308
Growth Rate:
57.68%
Total runs:
531
Run Growth:
-1.7K
Growth Rate:
-325.52%
Total runs:
517
Run Growth:
369
Growth Rate:
70.02%
Total runs:
552
Run Growth:
380
Growth Rate:
73.22%
Total runs:
506
Run Growth:
353
Growth Rate:
69.35%
Total runs:
539
Run Growth:
468
Growth Rate:
93.23%
Total runs:
494
Run Growth:
268
Growth Rate:
54.25%
Total runs:
533
Run Growth:
422
Growth Rate:
86.30%
Total runs:
495
Run Growth:
-2.0K
Growth Rate:
-413.46%
Total runs:
494
Run Growth:
227
Growth Rate:
47.49%
Total runs:
407
Run Growth:
266
Growth Rate:
55.88%
Total runs:
450
Run Growth:
113
Growth Rate:
23.94%
Total runs:
466
Run Growth:
-203
Growth Rate:
-43.94%
Total runs:
451
Run Growth:
263
Growth Rate:
58.71%
Total runs:
447
Run Growth:
320
Growth Rate:
73.39%
Total runs:
436
Run Growth:
307
Growth Rate:
71.06%
Total runs:
439
Run Growth:
284
Growth Rate:
66.05%
Total runs:
453
Run Growth:
399
Growth Rate:
93.44%
Total runs:
426
Run Growth:
211
Growth Rate:
51.72%
Total runs:
401
Run Growth:
16
Growth Rate:
3.94%
Total runs:
411
Run Growth:
274
Growth Rate:
67.82%
Total runs:
414
Run Growth:
292
Growth Rate:
72.82%
Total runs:
389
Run Growth:
267
Growth Rate:
67.09%
Total runs:
423
Run Growth:
252
Growth Rate:
64.29%
Total runs:
383
Run Growth:
255
Growth Rate:
65.05%
Total runs:
384
Run Growth:
168
Growth Rate:
43.08%
Total runs:
379
Run Growth:
201
Growth Rate:
51.67%
Total runs:
391
Run Growth:
245
Growth Rate:
64.30%
Total runs:
380
Run Growth:
207
Growth Rate:
55.05%
Total runs:
381
Run Growth:
252
Growth Rate:
72.62%
Total runs:
370
Run Growth:
-17
Growth Rate:
-4.61%
Total runs:
418
Run Growth:
253
Growth Rate:
68.56%
Total runs:
355
Run Growth:
250
Growth Rate:
70.03%
Total runs:
368
Run Growth:
170
Growth Rate:
47.75%
Total runs:
342
Run Growth:
162
Growth Rate:
45.89%
Total runs:
349
Run Growth:
164
Growth Rate:
46.99%
Total runs:
426
Run Growth:
336
Growth Rate:
97.39%
Total runs:
343
Run Growth:
140
Growth Rate:
40.82%
Total runs:
345
Run Growth:
301
Growth Rate:
87.76%
Total runs:
344
Run Growth:
228
Growth Rate:
66.86%