X-Portrait 2: Giving Life to Portraits with AI
From ByteDance comes X-Portrait 2, a highly expressive portrait animation AI that can make any face talk, change facial expressions and add life-like touches to the face with high quality. One of the key aspects of this is its ability to do all this with very little computational power.
This tool needs only one image to do its work, as well as one other reference video to take the characteristics from the new video. The AI, with the help of said video, takes what is already there, and converts it.
While there are other portrait animation software available, this AI agent is able to get a tongue involved, something of which others are not able to do. Although access to it has not yet been published, it will surely come soon with the technology that's been shown.
ReCapture: Changing Camera Angles in Existing Videos with Google's AI
Google has unveiled ReCapture, an AI tool that allows users to manipulate the camera angle in existing videos. This AI promises unprecedented control over video perspectives, allowing you to create new and engaging content from your existing footage.
The tool comes in two primary types: one of which takes your original video and, estimating the distance of certain objects, then creates a 3D environment to rotate and warp a new angle, and the second, that's able to guess multiple target views based on an observed view, and creates an original target view with 3D UNet.
Keep in mind that a lot of people can get this mixed up, but this is different from Google's recaptcha.
Creating Realistic Textures for 3D Models With MVPaint
The Tencent MVPaint AI tool brings lifelike texture creation to the world of 3D modeling. Generating realistic and visually appealing textures for 3D models is challenging. MVPaint tackles this challenge by creating textures that maintain consistency across different viewing angles.
MVPaint is great, as it can create high-quality texturing in a format very accurate and consistent compared to similar programs. To further make this possible, it takes the power of Text-to-3D Diffusion to bring accurate quality to what you are trying to create.
The results that come from MVPaint are highly sought after for games, movies, and other forms of visual media, but can easily be implemented for anything.