camenduru / emage

EMAGE: Towards Unified Holistic Co-Speech Gesture Generation via Expressive Masked Audio Gesture Modeling

replicate.com
Total runs: 100
24-hour runs: 0
7-day runs: 0
30-day runs: 0
Github
Model's Last Updated: April 09 2024

Introduction of emage

Model Details of emage

Readme

🐣 Please follow me for new updates https://twitter.com/camenduru
🔥 Please join our discord server https://discord.gg/k5BwmmvJJU
🥳 Please join my patreon community https://patreon.com/camenduru

🕸 Replicate

https://replicate.com/camenduru/minigpt4-video

📋 Tutorial
  • Register at https://smpl-x.is.tue.mpg.de and download the SMPL-X for Blender add-on. The ZIP release ( https://drive.google.com/drive/folders/1ukbifhHc85qWTzspEgvAxCXwn9mK4ifr ) file (smplx_blender_addon_20230921.zip) will include the required SMPL-X+FLAME model which is not included in the code repository.
  • Blender>Edit>Preferences>Add-ons>Install
  • Select downloaded SMPL-X for Blender add-on ZIP file ( smplx_blender_addon-YYYYMMDD.zip ) and install
  • Enable SMPL-X for Blender add-on
  • Enable sidebar in 3D Viewport>View>Sidebar
  • SMPL-X tool will show up in sidebar
🧬 Code

https://github.com/PantoMatrix/PantoMatrix/tree/main/scripts/EMAGE_2024

📄 Paper

https://arxiv.org/abs/2401.00374

🌐 Page

https://pantomatrix.github.io/EMAGE/

🏢 Sponsor

https://replicate.com

Pricing of emage replicate.com

Run time and cost

This model runs on Nvidia A40 GPU hardware . We don't yet have enough runs of this model to provide performance information.

Runs of camenduru emage on replicate.com

100
Total runs
0
24-hour runs
0
3-day runs
0
7-day runs
0
30-day runs

More Information About emage replicate.com Model

More emage license Visit here:

https://pantomatrix.github.io/EMAGE/

emage replicate.com

emage replicate.com is an AI model on replicate.com that provides emage's model effect (EMAGE: Towards Unified Holistic Co-Speech Gesture Generation via Expressive Masked Audio Gesture Modeling), which can be used instantly with this camenduru emage model. replicate.com supports a free trial of the emage model, and also provides paid use of the emage. Support call emage model through api, including Node.js, Python, http.

camenduru emage online free

emage replicate.com is an online trial and call api platform, which integrates emage's modeling effects, including api services, and provides a free online trial of emage, you can try emage online for free by clicking the link below.

camenduru emage online free url in replicate.com:

https://replicate.com/camenduru/emage

emage install

emage is an open source model from GitHub that offers a free installation service, and any user can find emage on GitHub to install. At the same time, replicate.com provides the effect of emage install, users can directly use emage installed effect in replicate.com for debugging and trial. It also supports api for free installation.

emage install url in replicate.com:

https://replicate.com/camenduru/emage

Url of emage

Provider of emage replicate.com

Other API from camenduru

replicate

MoE-LLaVA

Total runs: 1.4M
Run Growth: 0
Growth Rate: 0.00%
Updated:February 03 2024
replicate

InstantMesh: Efficient 3D Mesh Generation from a Single Image with Sparse-view Large Reconstruction Models

Total runs: 42.0K
Run Growth: 0
Growth Rate: 0.00%
Updated:April 16 2024
replicate

TripoSR: Fast 3D Object Reconstruction from a Single Image

Total runs: 22.1K
Run Growth: 0
Growth Rate: 0.00%
Updated:March 06 2024
replicate

Champ: Controllable and Consistent Human Image Animation with 3D Parametric Guidance

Total runs: 14.0K
Run Growth: 0
Growth Rate: 0.00%
Updated:March 25 2024
replicate

MetaVoice-1B: 1.2B parameter base model trained on 100K hours of speech

Total runs: 11.9K
Run Growth: 0
Growth Rate: 0.00%
Updated:February 07 2024
replicate

Remove background from images using BRIA-RMBG-1.4

Total runs: 11.4K
Run Growth: 0
Growth Rate: 0.00%
Updated:February 07 2024
replicate

Guiding Instruction-based Image Editing via Multimodal Large Language Models

Total runs: 6.8K
Run Growth: 0
Growth Rate: 0.00%
Updated:February 10 2024
replicate

DynamiCrafter: Animating Open-domain Images with Video Diffusion Priors

Total runs: 6.4K
Run Growth: 0
Growth Rate: 0.00%
Updated:December 11 2023
replicate

AniPortrait: Audio-Driven Synthesis of Photorealistic Portrait Animation

Total runs: 4.4K
Run Growth: 0
Growth Rate: 0.00%
Updated:March 28 2024
replicate

LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creation

Total runs: 4.1K
Run Growth: 0
Growth Rate: 0.00%
Updated:February 09 2024
replicate

StreamingT2V: Consistent, Dynamic, and Extendable Long Video Generation from Text

Total runs: 4.0K
Run Growth: 0
Growth Rate: 0.00%
Updated:April 10 2024
replicate

APISR: Anime Production Inspired Real-World Anime Super-Resolution

Total runs: 2.5K
Run Growth: 0
Growth Rate: 0.00%
Updated:March 19 2024
replicate

ZeST: Zero-Shot Material Transfer from a Single Image

Total runs: 1.5K
Run Growth: 0
Growth Rate: 0.00%
Updated:April 16 2024
replicate

Arc2Face: A Foundation Model of Human Faces

Total runs: 1.5K
Run Growth: 0
Growth Rate: 0.00%
Updated:March 31 2024
replicate

Hand Refiner 512x512

Total runs: 1.4K
Run Growth: 0
Growth Rate: 0.00%
Updated:February 10 2024
replicate

AnimateLCM Cartoon3D Model

Total runs: 1.3K
Run Growth: 0
Growth Rate: 0.00%
Updated:February 04 2024
replicate

StoryDiffusion: Consistent Self-Attention for Long-Range Image and Video Generation

Total runs: 1000
Run Growth: 0
Growth Rate: 0.00%
Updated:May 04 2024
replicate

Open-Sora is a work-in-progress model.

Total runs: 968
Run Growth: 0
Growth Rate: 0.00%
Updated:March 22 2024
replicate

LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creation

Total runs: 885
Run Growth: 0
Growth Rate: 0.00%
Updated:February 18 2024
replicate

MiniGPT4-Video: Advancing Multimodal LLMs for Video Understanding with Interleaved Visual-Textual Tokens

Total runs: 819
Run Growth: 0
Growth Rate: 0.00%
Updated:April 08 2024
replicate

CRM: Single Image to 3D Textured Mesh with Convolutional Reconstruction Model

Total runs: 730
Run Growth: 0
Growth Rate: 0.00%
Updated:March 12 2024
replicate

MagicDance: Realistic Human Dance Video Generation with Motions & Facial Expressions Transfer

Total runs: 643
Run Growth: 0
Growth Rate: 0.00%
Updated:February 16 2024
replicate

GRM: Large Gaussian Reconstruction Model for Efficient 3D Reconstruction and Generation

Total runs: 602
Run Growth: 0
Growth Rate: 0.00%
Updated:March 31 2024
replicate

HairFastGAN: Realistic and Robust Hair Transfer with a Fast Encoder-Based Approach

Total runs: 561
Run Growth: 0
Growth Rate: 0.00%
Updated:April 17 2024
replicate

DUSt3R: Geometric 3D Vision Made Easy

Total runs: 427
Run Growth: 0
Growth Rate: 0.00%
Updated:March 03 2024
replicate

MagicTime: Time-lapse Video Generation Models as Metamorphic Simulators

Total runs: 366
Run Growth: 0
Growth Rate: 0.00%
Updated:April 13 2024
replicate

ReNoise: Real Image Inversion Through Iterative Noising

Total runs: 182
Run Growth: 0
Growth Rate: 0.00%
Updated:March 22 2024
replicate

Continuous, Subject-Specific Attribute Control in T2I Models by Identifying Semantic Directions

Total runs: 106
Run Growth: 0
Growth Rate: 0.00%
Updated:March 31 2024
replicate

GeoWizard: Unleashing the Diffusion Priors for 3D Geometry Estimation from a Single Image

Total runs: 98
Run Growth: 0
Growth Rate: 0.00%
Updated:March 26 2024
replicate

Rethinking Inductive Biases for Surface Normal Estimation

Total runs: 71
Run Growth: 0
Growth Rate: 0.00%
Updated:March 03 2024
replicate

MotionDirector: Motion Customization of Text-to-Video Diffusion Models

Total runs: 54
Run Growth: 0
Growth Rate: 0.00%
Updated:December 12 2023