ds4sd / CodeFormulaV2

Code Formula Model

The Code Formula Model processes an image of a code snippet or formula at 120 DPI and outputs its content.

• Code Snippets :
  The model identifies the programming language and outputs the code repsecting the indendation shown in the given image. The output format will be:
  "<_<programming language>_> <content of the image>"
  Example:
  "<_Java_> System.out.println("Hello World.");"

• Formulas :
  The model generates the corresponding LaTeX code.

This model was trained using the following two datasets:

1. https://huggingface.co/datasets/ds4sd/SynthFormulaNet
2. https://huggingface.co/datasets/ds4sd/SynthCodeNet

References

@techreport{Docling,
  author = {Deep Search Team},
  month = {8},
  title = {{Docling Technical Report}},
  url={https://arxiv.org/abs/2408.09869},
  eprint={2408.09869},
  doi = "10.48550/arXiv.2408.09869",
  version = {1.0.0},
  year = {2024}
}

@article{nassar2025smoldocling,
  title={SmolDocling: An ultra-compact vision-language model for end-to-end multi-modal document conversion},
  author={Nassar, Ahmed and Marafioti, Andres and Omenetti, Matteo and Lysak, Maksym and Livathinos, Nikolaos and Auer, Christoph and Morin, Lucas and de Lima, Rafael Teixeira and Kim, Yusik and Gurbuz, A Said and others},
  journal={arXiv preprint arXiv:2503.11576},
  year={2025}
}