In the movie 'Superman', the volumetric holograms of the protagonist's parents in the Fortress of Solitude are not a traditional effect. Framestore implemented for the first time in a feature film the 4D Gaussian Splatting technology. This process generates three-dimensional representations that look like live photography and offer new flexibility in post-production.
Volumetric Capture and Re-Photography in Post-Production 🎬
The technique starts from the simultaneous capture of the performance with nearly 200 cameras. That data is converted into a volumetric point cloud with detailed light and shape information, a 4D model. This allows artists to re-film the performance from any new angle in composition, without needing to shoot again. The model's own structure makes it easy to integrate visual errors, like instabilities, organically to simulate an imperfect hologram.
Goodbye to Reserve Shoots, Hello to the Point Cloud ☁️
With this, the classic just in case we shoot another take from that angle becomes somewhat obsolete. Now the Plan B is to have such a complete 4D model that the director can change their mind about the shot in the editing room. Just hope it doesn't occur to them to ask for an angle from inside the actor's head; even Gaussian Splats have their limits.