Total runs:
65.2K
Run Growth:
12.7K
Growth Rate:
19.52%
Sponsored by
ThumbnailCreator.com
Skywork / Matrix-Game
Model's Last Updated: June 26 2025
image-to-video
Introduction of Matrix-Game
Model Details of Matrix-Game
Matrix-Game: Interactive World Foundation Model
📝 Overview
Matrix-Game is a 17B-parameter interactive world foundation model for controllable game world generation.
✨ Key Features
- 🎯 Feature 1 : Interactive Generation. A diffusion-based image-to-world model that generates high-quality videos conditioned on keyboard and mouse inputs, enabling fine-grained control and dynamic scene evolution.
- 🚀 Feature 2 : GameWorld Score. A comprehensive benchmark for evaluating Minecraft world models across four key dimensions, including visual quality, temporal quality, action controllability, and physical rule understanding.
- 💡 Feature 3 : Matrix-Game Dataset A large-scale Minecraft dataset with fine-grained action annotations, supporting scalable training for interactive and physically grounded world modeling.
🔥 Latest Updates
- [2025-05] 🎉 Initial release of Matrix-Game Model
🚀 Performance Comparison
GameWorld Score Benchmark Comparison
| Model | Image Quality ↑ | Aesthetic Quality ↑ | Temporal Cons. ↑ | Motion Smooth. ↑ | Keyboard Acc. ↑ | Mouse Acc. ↑ | 3D Cons. ↑ |
|---|---|---|---|---|---|---|---|
| Oasis | 0.65 | 0.48 | 0.94 | 0.98 | 0.77 | 0.56 | 0.56 |
| MineWorld | 0.69 | 0.47 | 0.95 | 0.98 | 0.86 | 0.64 | 0.51 |
| Ours | 0.72 | 0.49 | 0.97 | 0.98 | 0.95 | 0.95 | 0.76 |
Metric Descriptions :
-
Image Quality / Aesthetic : Visual fidelity and perceptual appeal of generated frames
-
Temporal Consistency / Motion Smoothness : Temporal coherence and smoothness between frames
-
Keyboard Accuracy / Mouse Accuracy : Accuracy in following user control signals
-
3D Consistency : Geometric stability and physical plausibility over time
Please check our GameWorld benchmark for detailed implementation.
Human Evaluation
Double-blind human evaluation by two independent groups across four key dimensions: Overall Quality , Controllability , Visual Quality , and Temporal Consistency .
Scores represent the percentage of pairwise comparisons in which each method was preferred. Matrix-Game consistently outperforms prior models across all metrics and both groups.
🚀 Quick Start
# clone the repository:
git clone https://github.com/SkyworkAI/Matrix-Game.git
cd Matrix-Game
# install dependencies:
pip install -r requirements.txt
# install apex and FlashAttention-3
# Our project also depends on [apex](https://github.com/NVIDIA/apex) and [FlashAttention-3](https://github.com/Dao-AILab/flash-attention)
# inference
bash run_inference.sh
⭐ Acknowledgements
We would like to express our gratitude to:
- Diffusers for their excellent diffusion model framework
- HunyuanVideo for their strong base model
- MineDojo for their Minecraft video dataset
- MineRL for their excellent gym framework
- Video-Pre-Training for their accurate Inverse Dynamics Model
- GameFactory for their idea of action control module
We are grateful to the broader research community for their open exploration and contributions to the field of interactive world generation.
📎 Citation
If you find this project useful, please cite our paper:
@article{zhang2025matrixgame,
title = {Matrix-Game: Interactive World Foundation Model},
author = {Yifan Zhang and Chunli Peng and Boyang Wang and Puyi Wang and Qingcheng Zhu and Zedong Gao and Eric Li and Yang Liu and Yahui Zhou},
journal = {arXiv},
year = {2025}
}
Runs of Skywork Matrix-Game on huggingface.co
54
Total runs
0
24-hour runs
5
3-day runs
-34
7-day runs
-28
30-day runs
More Information About Matrix-Game huggingface.co Model
Url of Matrix-Game
Matrix-Game huggingface.co Url
Provider of Matrix-Game huggingface.co
Other API from Skywork
Updated:October 25 2024
Total runs:
48.9K
Run Growth:
4.0K
Growth Rate:
8.25%
Total runs:
43.1K
Run Growth:
-33.4K
Growth Rate:
-77.56%
Total runs:
17.1K
Run Growth:
2.0K
Growth Rate:
11.49%
Total runs:
6.4K
Run Growth:
-6.0K
Growth Rate:
-94.11%
Total runs:
4.0K
Run Growth:
-8.0K
Growth Rate:
-200.13%
Total runs:
3.6K
Run Growth:
-1.2K
Growth Rate:
-33.26%
Total runs:
3.2K
Run Growth:
-10.3K
Growth Rate:
-324.12%
Total runs:
2.5K
Run Growth:
-4
Growth Rate:
-0.16%
Total runs:
1.5K
Run Growth:
738
Growth Rate:
48.17%
Total runs:
1.5K
Run Growth:
106
Growth Rate:
7.24%
Total runs:
1.2K
Run Growth:
37
Growth Rate:
3.05%
Total runs:
960
Run Growth:
155
Growth Rate:
16.15%
Total runs:
887
Run Growth:
-15.3K
Growth Rate:
-1721.53%
Total runs:
884
Run Growth:
147
Growth Rate:
16.63%
Total runs:
812
Run Growth:
176
Growth Rate:
21.67%
Total runs:
778
Run Growth:
33
Growth Rate:
4.24%
Total runs:
730
Run Growth:
296
Growth Rate:
45.19%
Total runs:
705
Run Growth:
332
Growth Rate:
47.09%
Total runs:
661
Run Growth:
159
Growth Rate:
25.28%
Total runs:
611
Run Growth:
-63
Growth Rate:
-10.31%
Total runs:
598
Run Growth:
123
Growth Rate:
20.57%
Total runs:
500
Run Growth:
-408
Growth Rate:
-81.60%
Total runs:
471
Run Growth:
129
Growth Rate:
27.39%
Total runs:
346
Run Growth:
-1.5K
Growth Rate:
-447.40%
Total runs:
335
Run Growth:
96
Growth Rate:
28.66%
Total runs:
251
Run Growth:
43
Growth Rate:
17.13%
Total runs:
238
Run Growth:
-552
Growth Rate:
-231.93%
Total runs:
220
Run Growth:
13
Growth Rate:
5.91%
Total runs:
214
Run Growth:
98
Growth Rate:
45.79%
Total runs:
163
Run Growth:
15
Growth Rate:
9.20%
Total runs:
127
Run Growth:
-26
Growth Rate:
-20.47%
Total runs:
113
Run Growth:
29
Growth Rate:
25.66%
Total runs:
82
Run Growth:
22
Growth Rate:
26.83%
Total runs:
61
Run Growth:
-9
Growth Rate:
-14.75%
Total runs:
59
Run Growth:
59
Growth Rate:
100.00%
Total runs:
56
Run Growth:
-15
Growth Rate:
-26.79%
Total runs:
56
Run Growth:
-48
Growth Rate:
-85.71%
Total runs:
53
Run Growth:
6
Growth Rate:
11.32%
Total runs:
44
Run Growth:
-25
Growth Rate:
-56.82%
Total runs:
42
Run Growth:
-50
Growth Rate:
-119.05%
Total runs:
37
Run Growth:
9
Growth Rate:
24.32%
Total runs:
35
Run Growth:
-49
Growth Rate:
-140.00%
Total runs:
33
Run Growth:
6
Growth Rate:
18.18%
Total runs:
33
Run Growth:
6
Growth Rate:
18.18%
Total runs:
32
Run Growth:
9
Growth Rate:
28.13%
Total runs:
30
Run Growth:
1
Growth Rate:
3.33%
Total runs:
24
Run Growth:
-7
Growth Rate:
-29.17%
Total runs:
22
Run Growth:
4
Growth Rate:
18.18%
Total runs:
22
Run Growth:
-9
Growth Rate:
-40.91%
Total runs:
21
Run Growth:
0
Growth Rate:
0.00%
Total runs:
18
Run Growth:
1
Growth Rate:
5.56%
Total runs:
18
Run Growth:
-6
Growth Rate:
-33.33%
Total runs:
18
Run Growth:
-20
Growth Rate:
-111.11%
Total runs:
17
Run Growth:
-9
Growth Rate:
-52.94%
Total runs:
16
Run Growth:
6
Growth Rate:
37.50%
Total runs:
14
Run Growth:
-17
Growth Rate:
-121.43%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%