prithivMLmods / LightOnOCR-3-4B-GGUF

huggingface.co
Total runs: 2.9K
24-hour runs: 0
7-day runs: 2.6K
30-day runs: 2.6K
Model's Last Updated: October 09 2026
image-text-to-text

Introduction of LightOnOCR-3-4B-GGUF

Model Details of LightOnOCR-3-4B-GGUF

LightOnOCR-3-4B-GGUF

LightOnOCR-3-4B , developed by lightonai , is the largest and most accurate model in the LightOnOCR-3 family of end-to-end OCR vision-language models, built on the Qwen3.5-4B architecture and released under the Apache 2.0 license. Recommended for most OCR tasks, it serves as a powerful, single-model alternative to complex document understanding pipelines by combining high-quality text transcription (triggered by an empty prompt) with advanced visual understanding features. When used with the grounding prompt, the model outputs labeled bounding boxes for all document elements, generates short descriptions for images, and extracts numerical data from charts into structured HTML tables. Highly versatile and optimized for seamless integration with Transformers and vLLM, it excels at processing complex layouts—including tables, receipts, forms, multi-column documents, and math notation—and performs best when documents are preprocessed at 400 DPI with a target longest dimension of 2048px.

  • Speculative Decoding — No
Model Files
File Name Quant Type File Size File Link Description
LightOnOCR-3-4B.BF16.gguf BF16 8.42 GB Link Full BF16 weights. Highest quality, largest file size.
LightOnOCR-3-4B.Q3_K_L.gguf Q3_K_L 2.42 GB Link Lower quality but usable, good for low RAM availability.
LightOnOCR-3-4B.Q3_K_M.gguf Q3_K_M 2.26 GB Link Low quality.
LightOnOCR-3-4B.Q4_K_M.gguf Q4_K_M 2.71 GB Link Good quality, default size for most use cases, recommended .
LightOnOCR-3-4B.Q4_K_S.gguf Q4_K_S 2.56 GB Link Slightly lower quality with more space savings, recommended .
LightOnOCR-3-4B.Q5_K_M.gguf Q5_K_M 3.07 GB Link High quality, recommended .
LightOnOCR-3-4B.Q5_K_S.gguf Q5_K_S 2.99 GB Link High quality, recommended .
LightOnOCR-3-4B.Q6_K.gguf Q6_K 3.46 GB Link Very high quality, near perfect, recommended .
LightOnOCR-3-4B.Q8_0.gguf Q8_0 4.48 GB Link Extremely high quality, generally unneeded but max available quant.
LightOnOCR-3-4B.mmproj-bf16.gguf mmproj-bf16 676 MB Link Multimodal projection file in BF16 format. Used for vision/language models.
LightOnOCR-3-4B.mmproj-q8_0.gguf mmproj-q8_0 367 MB Link Multimodal projection file in Q8_0 quantization. Smaller size for vision capabilities.
llama.cpp

LLM inference in C/C++ — https://github.com/ggml-org/llama.cpp

Runs of prithivMLmods LightOnOCR-3-4B-GGUF on huggingface.co

2.9K
Total runs
0
24-hour runs
628
3-day runs
2.6K
7-day runs
2.6K
30-day runs

More Information About LightOnOCR-3-4B-GGUF huggingface.co Model

More LightOnOCR-3-4B-GGUF license Visit here:

https://choosealicense.com/licenses/apache-2.0

LightOnOCR-3-4B-GGUF huggingface.co

LightOnOCR-3-4B-GGUF huggingface.co is an AI model on huggingface.co that provides LightOnOCR-3-4B-GGUF's model effect (), which can be used instantly with this prithivMLmods LightOnOCR-3-4B-GGUF model. huggingface.co supports a free trial of the LightOnOCR-3-4B-GGUF model, and also provides paid use of the LightOnOCR-3-4B-GGUF. Support call LightOnOCR-3-4B-GGUF model through api, including Node.js, Python, http.

prithivMLmods LightOnOCR-3-4B-GGUF online free

LightOnOCR-3-4B-GGUF huggingface.co is an online trial and call api platform, which integrates LightOnOCR-3-4B-GGUF's modeling effects, including api services, and provides a free online trial of LightOnOCR-3-4B-GGUF, you can try LightOnOCR-3-4B-GGUF online for free by clicking the link below.

prithivMLmods LightOnOCR-3-4B-GGUF online free url in huggingface.co:

https://huggingface.co/prithivMLmods/LightOnOCR-3-4B-GGUF

LightOnOCR-3-4B-GGUF install

LightOnOCR-3-4B-GGUF is an open source model from GitHub that offers a free installation service, and any user can find LightOnOCR-3-4B-GGUF on GitHub to install. At the same time, huggingface.co provides the effect of LightOnOCR-3-4B-GGUF install, users can directly use LightOnOCR-3-4B-GGUF installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

LightOnOCR-3-4B-GGUF install url in huggingface.co:

https://huggingface.co/prithivMLmods/LightOnOCR-3-4B-GGUF

Url of LightOnOCR-3-4B-GGUF

LightOnOCR-3-4B-GGUF huggingface.co Url

Provider of LightOnOCR-3-4B-GGUF huggingface.co

prithivMLmods
ORGANIZATIONS

Other API from prithivMLmods