Readme
TileMorph
TileMorph creates a tileable animation between two Stable Diffusion prompts. It uses the circular padding trick to generate images that wrap around the edges.
The animation effect is achieved by interpolating both in CLIP embedding space and latent space.
-
The number of CLIP interpolation steps is controlled by the
num_animation_framesinput. Each “animation frame” runs a full Stable Diffusion inference, which makes it slow but interesting. -
The number of latent space interpolation steps between animation frames is controlled by the
num_interpolation_stepsinput. Each interpolation step only runs a VAE inference, and is fast but less interesting. You can trade off interestingness versus prediction time by tweakingnum_animation_framesandnum_interpolation_steps -
num_animation_frames * num_interpolation_steps= number of output frames -
num_animation_frames * num_interpolation_steps / frames_per_second= output video length in seconds
This model supports seamless transitions between different generations. Set
prompt_end
and
seed_end
to the same value of video number
n
as
prompt_start
and
seed_start
of video number
n + 1
.
