nyu-visionx / solaris

This model repository contains the final model weights of the Solaris Minecraft multiplayer model, along with the intermediate model weights for all training stages and third-party models required for inference and training. All weights are in JAX. Refer to the Solaris GitHub repository for downloading and running instructions.

Below is the description of the model folders:

• solaris : the final multiplayer Solaris model that should be used for inference and evaluation
• clip : Wan 2.1's CLIP model. Required for Solaris inference and training
• vae : Wan 2.1's 3D VAE model. Required for Solaris inference and training
• mp_causal_60000.pt : Multiplayer causal model weights produced by training Stage 3
• mp_bidirectional_120000.pt : Multiplayer bidirectional model weights produced by training Stage 2
• sp_bidirectional_pretrain_120000.pt : Single player bidirectional model weights produced by training Stage 1
• matrix-game-init : Matrix Game 2.0 weights with the keyboard action MLP dimension increased to 23 (randmoly initialized). Used for single player pretraining (Stage 1) initialization

See Solaris repo for a detailed description of the training stages.