Wonder Dynamics has launched Wonder Animation, a new feature within Wonder Studio, its online platform powered by AI, designed to insert 3D characters into video sequences. This tool, currently in beta version, converts live-action videos into 3D animated scenes with computer-generated (CG) characters that interact with the environment.
Transformation of real video into 3D animated scene
The new Wonder Animation feature aims to bring artists closer to producing fully animated films, allowing them to transform live-action video sequences into continuous 3D scenes. This process is carried out through a reconstruction of the scene in a 3D space that follows the position and movement of each camera in relation to the characters and the environment.
Key features of Wonder Animation
- Dynamic 3D reconstruction: Wonder Animation reconstructs scenes containing different types of shots, such as wide shots, medium shots, and close-ups.
- Advanced motion prediction: It uses advanced algorithms to reconstruct character movement, even when they are partially obscured or off-screen.
- Export to 3D applications: The generated data can be exported to tools like Blender, Maya, Unreal Engine, 3ds Max, Houdini, or Unity.
Unlike other generative artificial intelligence approaches, Wonder Animation does not attempt to replace existing workflows, but rather adapts to them, offering fully editable results. Artists can adjust the animation, characters, environment, and lighting, integrating everything into their favorite 3D workflows or game engines.
A flexible and customizable approach
Wonder Animation moves away from the misconception of AI as a one-click solution. Nikola Todorovic, co-founder of Wonder Dynamics, emphasizes that the goal is to empower artists to shape their vision, rather than relying entirely on automated results. This philosophy ensures that the platform offers great flexibility in the creation of animations and visual effects.
Current limitations and possible improvements
Although Wonder Animation is a powerful tool for creating 3D animations, it currently does not convert the video background into the corresponding 3D geometry. Users still need to create the 3D environment separately. Autodesk has indicated that they are working on a possible update to expand the capabilities of this feature.
"Wonder Animation not only converts videos into 3D scenes, but offers artists total control over every aspect of the creative process."