Total runs:
663.2K
Run Growth:
19.8K
Growth Rate:
3.00%
Sponsored by
APIMart
mradermacher / Phi-3.5-Multi-Ability-Chatbot-GGUF
Model's Last Updated: January 15 2025
Introduction of Phi-3.5-Multi-Ability-Chatbot-GGUF
Model Details of Phi-3.5-Multi-Ability-Chatbot-GGUF
About
static quants of https://huggingface.co/ankitruler567/Phi-3.5-Multi-Ability-Chatbot
weighted/imatrix quants seem not to be available (by me) at this time. If they do not show up a week or so after the static ones, I have probably not planned for them. Feel free to request them by opening a Community Discussion.
Usage
If you are unsure how to use GGUF files, refer to one of TheBloke's READMEs for more details, including on how to concatenate multi-part files.
Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|---|---|---|---|
| GGUF | Q2_K | 1.5 | |
| GGUF | Q3_K_S | 1.8 | |
| GGUF | Q3_K_M | 2.1 | lower quality |
| GGUF | IQ4_XS | 2.2 | |
| GGUF | Q3_K_L | 2.2 | |
| GGUF | Q4_K_S | 2.3 | fast, recommended |
| GGUF | Q4_K_M | 2.5 | fast, recommended |
| GGUF | Q5_K_S | 2.7 | |
| GGUF | Q5_K_M | 2.9 | |
| GGUF | Q6_K | 3.2 | very good quality |
| GGUF | Q8_0 | 4.2 | fast, best quality |
| GGUF | f16 | 7.7 | 16 bpw, overkill |
Here is a handy graph by ikawrakow comparing some lower-quality quant types (lower is better):
And here are Artefact2's thoughts on the matter: https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to questions you might have and/or if you want some other model quantized.
Thanks
I thank my company, nethype GmbH , for letting me use its servers and providing upgrades to my workstation to enable this work in my free time.
Runs of mradermacher Phi-3.5-Multi-Ability-Chatbot-GGUF on huggingface.co
267
Total runs
14
24-hour runs
35
3-day runs
83
7-day runs
222
30-day runs
More Information About Phi-3.5-Multi-Ability-Chatbot-GGUF huggingface.co Model
Url of Phi-3.5-Multi-Ability-Chatbot-GGUF
Phi-3.5-Multi-Ability-Chatbot-GGUF huggingface.co Url
Provider of Phi-3.5-Multi-Ability-Chatbot-GGUF huggingface.co
Other API from mradermacher
Updated:November 15 2025
Total runs:
276.9K
Run Growth:
254.9K
Growth Rate:
92.04%
Total runs:
276.7K
Run Growth:
256.1K
Growth Rate:
92.56%
Total runs:
195.7K
Run Growth:
-26.4K
Growth Rate:
-12.64%
Total runs:
149.2K
Run Growth:
42.8K
Growth Rate:
28.68%
Total runs:
130.8K
Run Growth:
-159.1K
Growth Rate:
-121.61%
Total runs:
119.6K
Run Growth:
119.6K
Growth Rate:
100.00%
Total runs:
116.8K
Run Growth:
114.5K
Growth Rate:
98.86%
Total runs:
97.3K
Run Growth:
89.3K
Growth Rate:
100.00%
Total runs:
89.0K
Run Growth:
-112.6K
Growth Rate:
-126.49%
Total runs:
77.3K
Run Growth:
-4.5K
Growth Rate:
-5.82%
Total runs:
58.4K
Run Growth:
-96.6K
Growth Rate:
-165.48%
Total runs:
52.3K
Run Growth:
16.5K
Growth Rate:
32.56%
Total runs:
45.5K
Run Growth:
15.2K
Growth Rate:
33.45%
Total runs:
45.4K
Run Growth:
43.8K
Growth Rate:
99.14%
Total runs:
42.1K
Run Growth:
36.1K
Growth Rate:
85.69%
Total runs:
38.3K
Run Growth:
36.7K
Growth Rate:
100.00%
Total runs:
36.8K
Run Growth:
1.2K
Growth Rate:
3.33%
Total runs:
36.3K
Run Growth:
28.8K
Growth Rate:
88.24%
Total runs:
35.6K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
34.1K
Run Growth:
27.7K
Growth Rate:
81.19%
Total runs:
33.1K
Run Growth:
-84.1K
Growth Rate:
-195.05%
Total runs:
32.1K
Run Growth:
32.1K
Growth Rate:
100.00%
Total runs:
31.8K
Run Growth:
6.9K
Growth Rate:
21.87%
Total runs:
31.7K
Run Growth:
31.7K
Growth Rate:
100.00%
Total runs:
30.0K
Run Growth:
2.7K
Growth Rate:
9.29%
Total runs:
29.2K
Run Growth:
29.2K
Growth Rate:
100.00%
Total runs:
28.8K
Run Growth:
276
Growth Rate:
0.96%
Total runs:
28.6K
Run Growth:
-405
Growth Rate:
-1.43%
Total runs:
28.4K
Run Growth:
-90.6K
Growth Rate:
-264.03%
Total runs:
28.2K
Run Growth:
3.8K
Growth Rate:
13.55%
Total runs:
28.0K
Run Growth:
3.6K
Growth Rate:
13.01%
Total runs:
27.9K
Run Growth:
15.1K
Growth Rate:
54.23%
Total runs:
27.3K
Run Growth:
9.5K
Growth Rate:
34.90%
Total runs:
27.2K
Run Growth:
-212
Growth Rate:
-0.79%
Total runs:
27.1K
Run Growth:
22.0K
Growth Rate:
81.43%
Total runs:
26.8K
Run Growth:
26.8K
Growth Rate:
100.00%
Total runs:
26.6K
Run Growth:
11.4K
Growth Rate:
43.00%
Total runs:
26.1K
Run Growth:
2.1K
Growth Rate:
8.10%
Total runs:
26.0K
Run Growth:
25.4K
Growth Rate:
100.00%
Total runs:
25.7K
Run Growth:
113
Growth Rate:
0.44%
Total runs:
25.5K
Run Growth:
10.1K
Growth Rate:
40.25%
Total runs:
24.6K
Run Growth:
606
Growth Rate:
2.47%
Total runs:
24.5K
Run Growth:
134
Growth Rate:
0.55%
Total runs:
24.5K
Run Growth:
258
Growth Rate:
1.05%
Total runs:
24.5K
Run Growth:
24.5K
Growth Rate:
100.00%
Total runs:
24.1K
Run Growth:
401
Growth Rate:
1.66%
Total runs:
24.1K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
23.4K
Run Growth:
17.0K
Growth Rate:
72.68%
Total runs:
23.3K
Run Growth:
17.7K
Growth Rate:
58.34%
Total runs:
23.1K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
22.9K
Run Growth:
95
Growth Rate:
0.41%
Total runs:
22.7K
Run Growth:
20.5K
Growth Rate:
90.28%
Total runs:
22.5K
Run Growth:
21.2K
Growth Rate:
94.32%
Total runs:
22.5K
Run Growth:
3.9K
Growth Rate:
17.33%
Total runs:
22.3K
Run Growth:
22.3K
Growth Rate:
100.00%
Total runs:
22.3K
Run Growth:
277
Growth Rate:
1.24%
Total runs:
22.3K
Run Growth:
7.3K
Growth Rate:
32.71%
Total runs:
22.3K
Run Growth:
19.3K
Growth Rate:
86.84%
Total runs:
22.2K
Run Growth:
19.0K
Growth Rate:
85.31%
Total runs:
22.0K
Run Growth:
19.4K
Growth Rate:
66.36%
Total runs:
22.0K
Run Growth:
21.6K
Growth Rate:
98.11%
Total runs:
21.9K
Run Growth:
1.6K
Growth Rate:
7.54%
Total runs:
21.8K
Run Growth:
6.9K
Growth Rate:
31.44%
Total runs:
21.8K
Run Growth:
297
Growth Rate:
1.36%
Total runs:
21.6K
Run Growth:
18.9K
Growth Rate:
87.53%
Total runs:
21.1K
Run Growth:
4.2K
Growth Rate:
19.78%
Total runs:
20.9K
Run Growth:
20.8K
Growth Rate:
99.62%
Total runs:
20.8K
Run Growth:
20.8K
Growth Rate:
99.98%
Total runs:
20.7K
Run Growth:
-4.0K
Growth Rate:
-19.14%
Total runs:
20.6K
Run Growth:
20.6K
Growth Rate:
100.00%
Total runs:
20.5K
Run Growth:
100
Growth Rate:
0.49%
Total runs:
20.4K
Run Growth:
18.5K
Growth Rate:
91.04%
Total runs:
20.4K
Run Growth:
18.8K
Growth Rate:
92.19%
Total runs:
20.1K
Run Growth:
5.3K
Growth Rate:
26.50%
Total runs:
19.7K
Run Growth:
6.3K
Growth Rate:
32.18%
Total runs:
19.6K
Run Growth:
-12.1K
Growth Rate:
-61.83%
Total runs:
19.5K
Run Growth:
974
Growth Rate:
5.05%
Total runs:
19.4K
Run Growth:
19.4K
Growth Rate:
100.00%
Total runs:
19.0K
Run Growth:
17.6K
Growth Rate:
92.36%
Total runs:
19.0K
Run Growth:
14.2K
Growth Rate:
74.92%
Total runs:
18.9K
Run Growth:
18.3K
Growth Rate:
96.89%
Total runs:
18.5K
Run Growth:
130
Growth Rate:
0.70%
Total runs:
18.4K
Run Growth:
18.4K
Growth Rate:
100.00%
Total runs:
18.4K
Run Growth:
278
Growth Rate:
1.51%
Total runs:
18.3K
Run Growth:
764
Growth Rate:
4.16%
Total runs:
18.3K
Run Growth:
-16.0K
Growth Rate:
-86.21%
Total runs:
17.9K
Run Growth:
16.1K
Growth Rate:
89.94%
Total runs:
17.7K
Run Growth:
366
Growth Rate:
2.07%
Total runs:
17.6K
Run Growth:
11.0K
Growth Rate:
62.31%
Total runs:
17.6K
Run Growth:
9.8K
Growth Rate:
55.61%
Total runs:
17.5K
Run Growth:
546
Growth Rate:
3.12%
Total runs:
17.3K
Run Growth:
3
Growth Rate:
0.02%
Total runs:
17.3K
Run Growth:
1.9K
Growth Rate:
10.76%
Total runs:
16.9K
Run Growth:
952
Growth Rate:
5.63%
Total runs:
16.8K
Run Growth:
265
Growth Rate:
1.57%
Total runs:
16.7K
Run Growth:
383
Growth Rate:
2.29%
Total runs:
16.7K
Run Growth:
493
Growth Rate:
2.96%