|
LightOnOCR-3-4B.BF16.gguf
|
BF16
|
8.42 GB
|
Link
|
Full BF16 weights. Highest quality, largest file size.
|
|
LightOnOCR-3-4B.Q3_K_L.gguf
|
Q3_K_L
|
2.42 GB
|
Link
|
Lower quality but usable, good for low RAM availability.
|
|
LightOnOCR-3-4B.Q3_K_M.gguf
|
Q3_K_M
|
2.26 GB
|
Link
|
Low quality.
|
|
LightOnOCR-3-4B.Q4_K_M.gguf
|
Q4_K_M
|
2.71 GB
|
Link
|
Good quality, default size for most use cases,
recommended
.
|
|
LightOnOCR-3-4B.Q4_K_S.gguf
|
Q4_K_S
|
2.56 GB
|
Link
|
Slightly lower quality with more space savings,
recommended
.
|
|
LightOnOCR-3-4B.Q5_K_M.gguf
|
Q5_K_M
|
3.07 GB
|
Link
|
High quality,
recommended
.
|
|
LightOnOCR-3-4B.Q5_K_S.gguf
|
Q5_K_S
|
2.99 GB
|
Link
|
High quality,
recommended
.
|
|
LightOnOCR-3-4B.Q6_K.gguf
|
Q6_K
|
3.46 GB
|
Link
|
Very high quality, near perfect,
recommended
.
|
|
LightOnOCR-3-4B.Q8_0.gguf
|
Q8_0
|
4.48 GB
|
Link
|
Extremely high quality, generally unneeded but max available quant.
|
|
LightOnOCR-3-4B.mmproj-bf16.gguf
|
mmproj-bf16
|
676 MB
|
Link
|
Multimodal projection file in BF16 format. Used for vision/language models.
|
|
LightOnOCR-3-4B.mmproj-q8_0.gguf
|
mmproj-q8_0
|
367 MB
|
Link
|
Multimodal projection file in Q8_0 quantization. Smaller size for vision capabilities.
|