Skywork / Skywork-R1V-38B

Skywork-R1V

中文 | 📂 GitHub

1. Introduction

We introduce Skywork-R1V, a multimodal reasoning model that extends the R1-series text models to visual modalities through a near-lossless transfer method. Using a lightweight visual projector, Skywork-R1V enables seamless multimodal adaptation without requiring retraining of either the base language model or vision encoder. To enhance visual-text alignment, we developed a hybrid optimization strategy combining Iterative Supervised Fine-Tuning (SFT) with Group Relative Policy Optimization (GRPO), significantly improving cross-modal integration. Additionally, we created an adaptive-length Chain-of-Thought distillation approach for generating reasoning data, which dynamically optimizes reasoning chain lengths to improve inference efficiency and prevent overthinking. The model achieves state-of-the-art performance on key multimodal reasoning benchmarks, scoring 69 on MMMU and 67.5 on MathVista, comparable to leading closed-source models like Gemini 2.0 and Kimi-k1.5. It also maintains strong textual reasoning capabilities, achieving impressive scores of 72.6 on AIME and 94.3 on MATH500.

2. Model Summary

Architecture: Skywork-R1V employs a modular architecture that efficiently combines vision and language capabilities:

• Vision Encoder: Uses Vision Transformer (ViT) as the visual backbone to process image inputs.
• Visual Projector: A lightweight MLP (multilayer perceptron) adapter that serves as the bridge between the vision and language components.
• Language Model: Utilizes R1-distilled-Qwen-32B as the reasoning-capable language model backbone.

The model follows a connection pattern of Vision Encoder → MLP Adapter → Language Model, where the MLP adapter aligns the output space of the vision encoder with the input space of the language model. This design allows for efficient transfer of reasoning capabilities from text to multimodal domains without requiring extensive retraining of either the vision encoder or language model.

Key Designs

• Advanced Multimodal Reasoning
  Excels in complex reasoning across textual and visual modalities.
• Iterative Training Strategies
  Employs iterative supervision and grpo to refine model alignment and performance.
• Adaptive length Chain-of-Thought
  Dynamically adjusts reasoning length to enhance inference efficiency and accuracy.
• Scalable Performance
  Benchmarked to rival proprietary models across mathematics, coding, and multimodal tasks.

3. Evaluation

4. Skywork-R1V Family

5. Quick Start

This section describes how to quickly install, configure, and run the Skywork-R1V model.

Example Steps:

1. Clone GitHub repository

git clone https://github.com/your-repo

1. Install dependencies

cd your-repo
pip install -r requirements.txt

1. Run example code

python demo.py

6. Additional Resources

• 📂 GitHub Repository
• 🗨️ Chat Demo
• 🚀 Quick Start
• 📖 Full Documentation

7. Citation

If you use Skywork-R1V in your research, please cite:

@article{skywork2025r1v,
  title     = {Skywork-R1V: Bridging Vision and Language for Advanced Multimodal Reasoning},
  author    = {SkyworkVL Team},
  year      = {2025},
  journal   = {arXiv preprint arXiv:XXXX.XXXXX},
  url       = {https://github.com/skywork-ai/Skywork-R1V}
}

This project is released under an open-source license.