impresso-project / language-identifier

huggingface.co
Total runs: 18
24-hour runs: 0
7-day runs: -45
30-day runs: -42
Model's Last Updated: November 19 2025
token-classification

Introduction of language-identifier

Model Details of language-identifier

Model Card for impresso-project/language-identifier

Overview

impresso-project/language-identifier is a multilingual language identification model fine-tuned for use on historical newspaper content. It supports German (de), French (fr), Italian (it), English (en), and Luxembourgish (lb) — the core languages of the Impresso Project , which focuses on analyzing historical media across national and linguistic borders.

This model has been adapted for short, OCR-noisy and fragmentary inputs typical of historical digitized texts.

Model Details
Model Description
  • Developed by: University of Zurich (UZH) from the Impresso team . The project is an interdisciplinary project focused on historical media analysis across languages, time, and modalities. Funded by the Swiss National Science Foundation ( CRSII5_173719 , CRSII5_213585 ) and the Luxembourg National Research Fund (grant No. 17498891).
  • Model type: Language identification using a transformer-based classification architecture
  • Languages: French, German, English, Italian, Luxembourgish
  • License: AGPL-3.0
  • Finetuned from: Custom model trained on historical newspaper data from the Impresso corpus
How to Use
from transformers import pipeline

MODEL_NAME = "impresso-project/language-identifier"

lang_pipeline = pipeline(
    "langident",
    model=MODEL_NAME,
    trust_remote_code=True,
    device="cpu",
)

text = """En l'an 1348, au plus fort des ravages de la peste noire à travers
l'Europe, le Royaume de France se trouvait à la fois au bord du désespoir et
face à une opportunité."""

langs = lang_pipeline(text)
print(langs)
Output Format

The output is a single dictionary with the predicted language and confidence score:

{
  "language": "fr",
  "score": 1.0
}
Use Cases
  • Preprocessing for OCR and NLP tasks on historical corpora
  • Document and segment-level language tagging
  • Filtering and sorting multilingual newspaper archives
Limitations
  • Works best on sentence- or paragraph-length texts
  • May struggle with code-switching or OCR-degraded text that mixes languages
  • Primarily optimized for Impresso-like sources (19th–20th century newspapers)
Installation
pip install transformers floret
Contact

Impresso Logo

Runs of impresso-project language-identifier on huggingface.co

18
Total runs
0
24-hour runs
2
3-day runs
-45
7-day runs
-42
30-day runs

More Information About language-identifier huggingface.co Model

More language-identifier license Visit here:

https://choosealicense.com/licenses/agpl-3.0

language-identifier huggingface.co

language-identifier huggingface.co is an AI model on huggingface.co that provides language-identifier's model effect (), which can be used instantly with this impresso-project language-identifier model. huggingface.co supports a free trial of the language-identifier model, and also provides paid use of the language-identifier. Support call language-identifier model through api, including Node.js, Python, http.

impresso-project language-identifier online free

language-identifier huggingface.co is an online trial and call api platform, which integrates language-identifier's modeling effects, including api services, and provides a free online trial of language-identifier, you can try language-identifier online for free by clicking the link below.

impresso-project language-identifier online free url in huggingface.co:

https://huggingface.co/impresso-project/language-identifier

language-identifier install

language-identifier is an open source model from GitHub that offers a free installation service, and any user can find language-identifier on GitHub to install. At the same time, huggingface.co provides the effect of language-identifier install, users can directly use language-identifier installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

language-identifier install url in huggingface.co:

https://huggingface.co/impresso-project/language-identifier

Url of language-identifier

Provider of language-identifier huggingface.co

impresso-project
ORGANIZATIONS

Other API from impresso-project