ufal / clip-historical-page

Image classification using fine-tuned CLIP - for historical document sorting

Goal: solve a task of archive page images sorting (for their further content-based processing)

Scope: Processing of images, training / evaluation of CLIP model, input file/directory processing, class 🪧 (category) results of top N predictions output, predictions summarizing into a tabular format.

Versions 🏁

There are currently 4 version of the model available for download, both of them have the same set of categories, but different data annotations. The latest approved v1.1 is considered to be default and can be found in the main branch of HF 😊 hub ^1 🔗

• transforms.ColorJitter( brightness 0.5)
• transforms.ColorJitter( contrast 0.5)
• transforms.ColorJitter( saturation 0.5)
• transforms.ColorJitter( hue 0.5)
• transforms.Lambda(lambda img: ImageEnhance. Sharpness (img).enhance(random.uniform(0.5, 1.5)))
• transforms.Lambda(lambda img: img.filter(ImageFilter. GaussianBlur (radius=random.uniform(0, 2))))

Contacts 📧

For support write to: [email protected] responsible for this GitHub repository ^8 🔗

Information about the authors of this project, including their names and ORCIDs, can be found in the CITATION.cff 📎 file.

Acknowledgements 🙏

• Developed by UFAL ^7 👥
• Funded by ATRIUM ^4 💰
• Shared by ATRIUM ^4 & UFAL ^7 🔗
• Model type: fine-tuned ViT with a 224x224 ^2 🔗 or 384x384 ^13 ^14 🔗 resolution size

©️ 2022 UFAL & ATRIUM