Alibaba's Animate Anyone 2 Transforms Character Animation with AI
Alibaba Group Holding’s cloud computing division has launched its new AI model, Animate Anyone 2, revolutionizing character animation with exceptional simplicity. In contrast to other traditional animation methods based solely on motion signals, Animate Anyone 2 enables the creation of high-fidelity animated characters from a simple static image and a video cue. Both motion and environment signals from reference materials such as source videos are processed by this model to produce realistic animations, improving character-environment integration substantially.
The technical report by Tongyi Lab, Alibaba Cloud's research and development center, describes how Animate Anyone 2 accesses environment information from source videos to maintain animation characters' consistency within their natural environment. Such an operation enables hassle-free interaction among the animation characters and the environment, providing a smoother and natural experience in animation.
Animate Anyone 2 is based on its predecessor released in late 2023, which had been created to create character animations from photographs. The new model, however, is more advanced and can substitute characters in a video with great accuracy. For instance, the model can take a picture of Hong Kong director Stephen Chow and replace him with Mr. Bean, played by Rowan Atkinson, on a bicycle. In the same way, it can replace a parkour athlete with a still photo of football icon Cristiano Ronaldo in a video, proving its flexibility.
This AI model is a major breakthrough for Chinese developers in the generative AI field, after the success of models such as Sora by OpenAI. With its sophisticated features, Animate Anyone 2 is poised to shake up the animation and entertainment industries, offering new content creation tools for creators and advertisers alike while also sparking worries about the possible abuse of deepfake technology.
Comments
Post a Comment