ComputerScience-v1-2B-GGUF-BF16.gguf
|
BF16
|
ComputerScience-v1-2B-GGUF-Q8_0.gguf
|
8-bit — near-lossless, larger file
|
ComputerScience-v1-2B-GGUF-Q6_K.gguf
|
6-bit — high quality
|
ComputerScience-v1-2B-GGUF-Q5_K_M.gguf
|
5-bit medium — good quality/size balance
|
ComputerScience-v1-2B-GGUF-Q5_K_S.gguf
|
Q5_K_S
|
ComputerScience-v1-2B-GGUF-Q4_K_M.gguf
|
4-bit medium — recommended for most use cases
|
ComputerScience-v1-2B-GGUF-Q4_K_S.gguf
|
Q4_K_S
|
ComputerScience-v1-2B-GGUF-Q3_K_L.gguf
|
Q3_K_L
|
ComputerScience-v1-2B-GGUF-Q3_K_M.gguf
|
Q3_K_M
|
ComputerScience-v1-2B-GGUF-Q3_K_S.gguf
|
Q3_K_S
|
ComputerScience-v1-2B-GGUF-Q2_K.gguf
|
2-bit — smallest size, lowest quality
|
ComputerScience-v1-2B-GGUF-IQ4_XS.gguf
|
IQ4_XS
|
ComputerScience-v1-2B-GGUF-IQ4_NL.gguf
|
IQ4_NL
|
ComputerScience-v1-2B-GGUF-TQ2_0.gguf
|
TQ2_0
|