|
Llama-4-Scout-17B-16E-Instruct-Q2_K.gguf
|
Q2_K
|
2
|
39.6 GB
|
smallest, significant quality loss - not recommended for most purposes
|
|
Llama-4-Scout-17B-16E-Instruct-Q3_K_L-00001-of-00002.gguf
|
Q3_K_L
|
3
|
29.8 GB
|
small, substantial quality loss
|
|
Llama-4-Scout-17B-16E-Instruct-Q3_K_L-00002-of-00002.gguf
|
Q3_K_L
|
3
|
26.1 GB
|
small, substantial quality loss
|
|
Llama-4-Scout-17B-16E-Instruct-Q3_K_M-00001-of-00002.gguf
|
Q3_K_M
|
3
|
29.8 GB
|
very small, high quality loss
|
|
Llama-4-Scout-17B-16E-Instruct-Q3_K_M-00002-of-00002.gguf
|
Q3_K_M
|
3
|
21.9 GB
|
very small, high quality loss
|
|
Llama-4-Scout-17B-16E-Instruct-Q3_K_S-00001-of-00002.gguf
|
Q3_K_S
|
3
|
29.7 GB
|
very small, high quality loss
|
|
Llama-4-Scout-17B-16E-Instruct-Q3_K_S-00002-of-00002.gguf
|
Q3_K_S
|
3
|
17.0 GB
|
very small, high quality loss
|
|
Llama-4-Scout-17B-16E-Instruct-Q4_0-00001-of-00003.gguf
|
Q4_0
|
4
|
30.0 GB
|
legacy; small, very high quality loss - prefer using Q3_K_M
|
|
Llama-4-Scout-17B-16E-Instruct-Q4_0-00002-of-00003.gguf
|
Q4_0
|
4
|
29.7 GB
|
legacy; small, very high quality loss - prefer using Q3_K_M
|
|
Llama-4-Scout-17B-16E-Instruct-Q4_0-00003-of-00003.gguf
|
Q4_0
|
4
|
1.20 GB
|
legacy; small, very high quality loss - prefer using Q3_K_M
|
|
Llama-4-Scout-17B-16E-Instruct-Q4_K_M-00001-of-00003.gguf
|
Q4_K_M
|
4
|
29.9 GB
|
medium, balanced quality - recommended
|
|
Llama-4-Scout-17B-16E-Instruct-Q4_K_M-00002-of-00003.gguf
|
Q4_K_M
|
4
|
29.8 GB
|
medium, balanced quality - recommended
|
|
Llama-4-Scout-17B-16E-Instruct-Q4_K_M-00003-of-00003.gguf
|
Q4_K_M
|
4
|
5.66 GB
|
medium, balanced quality - recommended
|
|
Llama-4-Scout-17B-16E-Instruct-Q4_K_S-00001-of-00003.gguf
|
Q4_K_S
|
4
|
29.7 GB
|
small, greater quality loss
|
|
Llama-4-Scout-17B-16E-Instruct-Q4_K_S-00002-of-00003.gguf
|
Q4_K_S
|
4
|
29.7 GB
|
small, greater quality loss
|
|
Llama-4-Scout-17B-16E-Instruct-Q4_K_S-00003-of-00003.gguf
|
Q4_K_S
|
4
|
2.04 GB
|
small, greater quality loss
|
|
Llama-4-Scout-17B-16E-Instruct-Q5_0-00001-of-00003.gguf
|
Q5_0
|
5
|
29.9 GB
|
legacy; medium, balanced quality - prefer using Q4_K_M
|
|
Llama-4-Scout-17B-16E-Instruct-Q5_0-00002-of-00003.gguf
|
Q5_0
|
5
|
29.8 GB
|
legacy; medium, balanced quality - prefer using Q4_K_M
|
|
Llama-4-Scout-17B-16E-Instruct-Q5_0-00003-of-00003.gguf
|
Q5_0
|
5
|
14.6 GB
|
legacy; medium, balanced quality - prefer using Q4_K_M
|
|
Llama-4-Scout-17B-16E-Instruct-Q5_K_M-00001-of-00003.gguf
|
Q5_K_M
|
5
|
29.8 GB
|
large, very low quality loss - recommended
|
|
Llama-4-Scout-17B-16E-Instruct-Q5_K_M-00002-of-00003.gguf
|
Q5_K_M
|
5
|
29.8 GB
|
large, very low quality loss - recommended
|
|
Llama-4-Scout-17B-16E-Instruct-Q5_K_M-00003-of-00003.gguf
|
Q5_K_M
|
5
|
16.9 GB
|
large, very low quality loss - recommended
|
|
Llama-4-Scout-17B-16E-Instruct-Q5_K_S-00001-of-00003.gguf
|
Q5_K_S
|
5
|
29.9 GB
|
large, low quality loss - recommended
|
|
Llama-4-Scout-17B-16E-Instruct-Q5_K_S-00002-of-00003.gguf
|
Q5_K_S
|
5
|
29.8 GB
|
large, low quality loss - recommended
|
|
Llama-4-Scout-17B-16E-Instruct-Q5_K_S-00003-of-00003.gguf
|
Q5_K_S
|
5
|
14.6 GB
|
large, low quality loss - recommended
|
|
Llama-4-Scout-17B-16E-Instruct-Q6_K-00001-of-00003.gguf
|
Q6_K
|
6
|
30.0 GB
|
very large, extremely low quality loss
|
|
Llama-4-Scout-17B-16E-Instruct-Q6_K-00002-of-00003.gguf
|
Q6_K
|
6
|
29.6 GB
|
very large, extremely low quality loss
|
|
Llama-4-Scout-17B-16E-Instruct-Q6_K-00003-of-00003.gguf
|
Q6_K
|
6
|
28.9 GB
|
very large, extremely low quality loss
|
|
Llama-4-Scout-17B-16E-Instruct-Q8_0-00001-of-00004.gguf
|
Q8_0
|
8
|
29.5 GB
|
very large, extremely low quality loss - not recommended
|
|
Llama-4-Scout-17B-16E-Instruct-Q8_0-00002-of-00004.gguf
|
Q8_0
|
8
|
29.7 GB
|
very large, extremely low quality loss - not recommended
|
|
Llama-4-Scout-17B-16E-Instruct-Q8_0-00003-of-00004.gguf
|
Q8_0
|
8
|
29.7 GB
|
very large, extremely low quality loss - not recommended
|
|
Llama-4-Scout-17B-16E-Instruct-Q8_0-00004-of-00004.gguf
|
Q8_0
|
8
|
25.7 GB
|
very large, extremely low quality loss - not recommended
|
|
Llama-4-Scout-17B-16E-Instruct-f16-00001-of-00008.gguf
|
f16
|
16
|
30.0 GB
|
|
|
Llama-4-Scout-17B-16E-Instruct-f16-00002-of-00008.gguf
|
f16
|
16
|
29.5 GB
|
|
|
Llama-4-Scout-17B-16E-Instruct-f16-00003-of-00008.gguf
|
f16
|
16
|
29.1 GB
|
|
|
Llama-4-Scout-17B-16E-Instruct-f16-00004-of-00008.gguf
|
f16
|
16
|
29.5 GB
|
|
|
Llama-4-Scout-17B-16E-Instruct-f16-00005-of-00008.gguf
|
f16
|
16
|
29.5 GB
|
|
|
Llama-4-Scout-17B-16E-Instruct-f16-00006-of-00008.gguf
|
f16
|
16
|
29.1 GB
|
|
|
Llama-4-Scout-17B-16E-Instruct-f16-00007-of-00008.gguf
|
f16
|
16
|
29.5 GB
|
|
|
Llama-4-Scout-17B-16E-Instruct-f16-00008-of-00008.gguf
|
f16
|
16
|
9.41 GB
|
|