camenduru / story-diffusion

StoryDiffusion: Consistent Self-Attention for Long-Range Image and Video Generation

replicate.com
Total runs: 1000
24-hour runs: 0
7-day runs: 0
30-day runs: 0
Github
Model's Last Updated: May 04 2024

Introduction of story-diffusion

Model Details of story-diffusion

Readme

🐣 Please follow me for new updates https://twitter.com/camenduru
🔥 Please join our discord server https://discord.gg/k5BwmmvJJU
🥳 Please join my patreon community https://patreon.com/camenduru

📋 Tutorial
  • Enter a Textual Description for Character, if you add the Ref-Image, making sure to follow the class word you want to customize with the trigger word: img, such as: man img or woman img or girl img .
  • Enter the prompt array, each line corrsponds to one generated image.
  • Choose your preferred style template.
  • If you need to change the caption, add a # at the end of each line. Only the part after the # will be added as a caption to the image.)
  • [NC] symbol (The [NC] symbol is used as a flag to indicate that no characters should be present in the generated scene images. If you want do that, prepend the “[NC]” at the beginning of the line. For example, to generate a scene of falling leaves without any character, write: “[NC] The leaves are falling.”), Currently, support is only using Textual Description
🕸 Replicate

https://replicate.com/camenduru/story-diffusion

🧬 Code

https://github.com/HVision-NKU/StoryDiffusion

📄 Paper

https://arxiv.org/abs/2405.01434

🌐 Page

https://storydiffusion.github.io/

🏢 Sponsor

https://replicate.com

Runs of camenduru story-diffusion on replicate.com

1000
Total runs
0
24-hour runs
0
3-day runs
0
7-day runs
0
30-day runs

More Information About story-diffusion replicate.com Model

More story-diffusion license Visit here:

https://storydiffusion.github.io/

story-diffusion replicate.com

story-diffusion replicate.com is an AI model on replicate.com that provides story-diffusion's model effect (StoryDiffusion: Consistent Self-Attention for Long-Range Image and Video Generation), which can be used instantly with this camenduru story-diffusion model. replicate.com supports a free trial of the story-diffusion model, and also provides paid use of the story-diffusion. Support call story-diffusion model through api, including Node.js, Python, http.

story-diffusion replicate.com Url

https://replicate.com/camenduru/story-diffusion

camenduru story-diffusion online free

story-diffusion replicate.com is an online trial and call api platform, which integrates story-diffusion's modeling effects, including api services, and provides a free online trial of story-diffusion, you can try story-diffusion online for free by clicking the link below.

camenduru story-diffusion online free url in replicate.com:

https://replicate.com/camenduru/story-diffusion

story-diffusion install

story-diffusion is an open source model from GitHub that offers a free installation service, and any user can find story-diffusion on GitHub to install. At the same time, replicate.com provides the effect of story-diffusion install, users can directly use story-diffusion installed effect in replicate.com for debugging and trial. It also supports api for free installation.

story-diffusion install url in replicate.com:

https://replicate.com/camenduru/story-diffusion

story-diffusion install url in github:

https://github.com/camenduru/StoryDiffusion-replicate

Url of story-diffusion

Provider of story-diffusion replicate.com

Other API from camenduru

replicate

MoE-LLaVA

Total runs: 1.4M
Run Growth: 0
Growth Rate: 0.00%
Updated:February 03 2024
replicate

InstantMesh: Efficient 3D Mesh Generation from a Single Image with Sparse-view Large Reconstruction Models

Total runs: 42.0K
Run Growth: 0
Growth Rate: 0.00%
Updated:April 16 2024
replicate

TripoSR: Fast 3D Object Reconstruction from a Single Image

Total runs: 22.1K
Run Growth: 0
Growth Rate: 0.00%
Updated:March 06 2024
replicate

Champ: Controllable and Consistent Human Image Animation with 3D Parametric Guidance

Total runs: 14.0K
Run Growth: 0
Growth Rate: 0.00%
Updated:March 25 2024
replicate

MetaVoice-1B: 1.2B parameter base model trained on 100K hours of speech

Total runs: 11.9K
Run Growth: 0
Growth Rate: 0.00%
Updated:February 07 2024
replicate

Remove background from images using BRIA-RMBG-1.4

Total runs: 11.4K
Run Growth: 0
Growth Rate: 0.00%
Updated:February 07 2024
replicate

Guiding Instruction-based Image Editing via Multimodal Large Language Models

Total runs: 6.8K
Run Growth: 0
Growth Rate: 0.00%
Updated:February 10 2024
replicate

DynamiCrafter: Animating Open-domain Images with Video Diffusion Priors

Total runs: 6.4K
Run Growth: 0
Growth Rate: 0.00%
Updated:December 11 2023
replicate

AniPortrait: Audio-Driven Synthesis of Photorealistic Portrait Animation

Total runs: 4.4K
Run Growth: 0
Growth Rate: 0.00%
Updated:March 28 2024
replicate

LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creation

Total runs: 4.1K
Run Growth: 0
Growth Rate: 0.00%
Updated:February 09 2024
replicate

StreamingT2V: Consistent, Dynamic, and Extendable Long Video Generation from Text

Total runs: 4.0K
Run Growth: 0
Growth Rate: 0.00%
Updated:April 10 2024
replicate

APISR: Anime Production Inspired Real-World Anime Super-Resolution

Total runs: 2.5K
Run Growth: 0
Growth Rate: 0.00%
Updated:March 19 2024
replicate

ZeST: Zero-Shot Material Transfer from a Single Image

Total runs: 1.5K
Run Growth: 0
Growth Rate: 0.00%
Updated:April 16 2024
replicate

Arc2Face: A Foundation Model of Human Faces

Total runs: 1.5K
Run Growth: 0
Growth Rate: 0.00%
Updated:March 31 2024
replicate

Hand Refiner 512x512

Total runs: 1.4K
Run Growth: 0
Growth Rate: 0.00%
Updated:February 10 2024
replicate

AnimateLCM Cartoon3D Model

Total runs: 1.3K
Run Growth: 0
Growth Rate: 0.00%
Updated:February 04 2024
replicate

Open-Sora is a work-in-progress model.

Total runs: 968
Run Growth: 0
Growth Rate: 0.00%
Updated:March 22 2024
replicate

LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creation

Total runs: 885
Run Growth: 0
Growth Rate: 0.00%
Updated:February 18 2024
replicate

MiniGPT4-Video: Advancing Multimodal LLMs for Video Understanding with Interleaved Visual-Textual Tokens

Total runs: 819
Run Growth: 0
Growth Rate: 0.00%
Updated:April 08 2024
replicate

CRM: Single Image to 3D Textured Mesh with Convolutional Reconstruction Model

Total runs: 730
Run Growth: 0
Growth Rate: 0.00%
Updated:March 12 2024
replicate

MagicDance: Realistic Human Dance Video Generation with Motions & Facial Expressions Transfer

Total runs: 643
Run Growth: 0
Growth Rate: 0.00%
Updated:February 16 2024
replicate

GRM: Large Gaussian Reconstruction Model for Efficient 3D Reconstruction and Generation

Total runs: 602
Run Growth: 0
Growth Rate: 0.00%
Updated:March 31 2024
replicate

HairFastGAN: Realistic and Robust Hair Transfer with a Fast Encoder-Based Approach

Total runs: 561
Run Growth: 0
Growth Rate: 0.00%
Updated:April 17 2024
replicate

DUSt3R: Geometric 3D Vision Made Easy

Total runs: 427
Run Growth: 0
Growth Rate: 0.00%
Updated:March 03 2024
replicate

MagicTime: Time-lapse Video Generation Models as Metamorphic Simulators

Total runs: 366
Run Growth: 0
Growth Rate: 0.00%
Updated:April 13 2024
replicate

ReNoise: Real Image Inversion Through Iterative Noising

Total runs: 182
Run Growth: 0
Growth Rate: 0.00%
Updated:March 22 2024
replicate

Continuous, Subject-Specific Attribute Control in T2I Models by Identifying Semantic Directions

Total runs: 106
Run Growth: 0
Growth Rate: 0.00%
Updated:March 31 2024
replicate

EMAGE: Towards Unified Holistic Co-Speech Gesture Generation via Expressive Masked Audio Gesture Modeling

Total runs: 100
Run Growth: 0
Growth Rate: 0.00%
Updated:April 09 2024
replicate

GeoWizard: Unleashing the Diffusion Priors for 3D Geometry Estimation from a Single Image

Total runs: 98
Run Growth: 0
Growth Rate: 0.00%
Updated:March 26 2024
replicate

Rethinking Inductive Biases for Surface Normal Estimation

Total runs: 71
Run Growth: 0
Growth Rate: 0.00%
Updated:March 03 2024
replicate

MotionDirector: Motion Customization of Text-to-Video Diffusion Models

Total runs: 54
Run Growth: 0
Growth Rate: 0.00%
Updated:December 12 2023