What’s Next in Film and TV as 3D Faces the Rise of AI?

"My reaction to 3D is subtly. Things don't come out at you, but rather you - the audience, comes into the film." (Ian McKellen)

Reference: Nik Radzi at Unsplash

The Evolution of 3D and AI in Film and TV

3D Technology

Primitive forms of 3D began to appear in films in the 1950s, such as in House of Wax (1953), where they experimented with stereoscopic 3D. However, 3D technology in Films didn't take off until the 1990s, when Jurassic Park (1993) showcased groundbreaking CGI dinosaur special effects.

The Hobbit (2012) used a combination of 3D technology, CGI, and AI to create high frame rates (48 fps) and cutting-edge motion capture for its Gollum and Smaug characters. It wasn't until The Amazing Spider-Man (2012) that 3D was cemented as a filmmaking medium because the entire movie was created using a native 3D process, meaning it was filmed in 3D rather than converted afterward.

Reference: Jurassic World: Dominion

AI Technology

AI emerged in the 1980s and 1990s with Terminator 2: Judgment Day (1991), which integrated digital characters into live-action footage. Although it was not quintessentially considered AI, the use of automated compositing and digital effects processing with early motion capture paved the way for AI to be used in conjunction with motion capture processing, character animation, and rendering to automate visual effects processes in The Abyss (1989).

In Avengers: Endgame (2019), AI was utilized to create simulations, texture generation, and facial animation. This was pushed even further in The Mandalorian (2019-present), where AI was used for real-time compositing and digital doubles.

Reference: Terminator 2: Judgment Day

How has 3D revolutionized Film and TV?

3D technology has redefined production and audience engagement in Film and TV in multiple ways.

Enhanced Depth and Realism in Cinematography

3D allows filmmakers to speed up production times and create higher quality visuals using innovative camera systems such as the RED camera and virtual production tools like Stagecraft. Using a custom-built, state-of-the-art motion capture system and RED cameras, Gravity (2013) achieved breathtaking visuals that gave the audience a sense of true weightlessness and depth in the vacuum of space. In Interstellar (2014), the visual effects team worked with physicist Kip Thorne to ensure the depiction of the black hole was scientifically accurate, which resulted in a stunningly realistic portrayal that became a benchmark in both science and visual effects.

Reference: Interstellar

Limitless Creativity

3D technology gives artists greater flexibility when they are creating characters, settings, and complex visual effects because the 3D model can be altered, and they can adapt the camera angles. Disney's Moana (2016) used 3D animation techniques to create vibrant, dynamic characters and environments with a high level of textured detail to intensify the feeling of fluidity and movement.

More Intuitive Storytelling

The flexibility of 3D has enabled writers and artists to collaborate to make storylines flow with the 3D animation, by emphasizing significant emotional moments with 3D visual effects. In Toy Story 3 (2010), the creators used 3D to add depth to key emotive character moments.

Reference: Toy Story 3

How has AI reshaped Film and TV?

AI has influenced modern film and TV shows, especially in pre-production, production, and post-production.

In Pre-Production

AI has transformed Film and TV production by streamlining tasks and making processes faster and more efficient. AI can optimize budgets and schedules by predicting costs and streamlining production timelines. In casting decisions, it can predict audience preferences by analyzing actor popularity, audience demographics, and performance history to recommend casting choices likely to succeed commercially. In The Witcher (2019), AI played a role in determining who might be the right fit for key characters like Geralt.

In Production

AI can work in conjunction with 3D designers by analyzing any pre-existing data they put in to generate 3D models automatically. AI-powered cameras and drones can track actors, adjust framing, and capture complex shots, while AI tools can improve lighting, focus, and scene composition. Additionally, real-time AI feedback on footage helps directors and crew make immediate improvements. In Avatar 3 (2025), James Cameron chose not to use generative AI because he wanted to create a film celebrating human creativity.

Reference: Avatar: Fire and Ash

In Post-Production

AI accelerates editing by automatically selecting the best takes and organizing footage. It also enhances visual effects (VFX) by generating CGI, correcting shots, and creating realistic digital elements. AI tools improve sound design by cleaning audio and composing music that fits the emotional tone of scenes. In color grading, AI ensures consistency and enhances image quality, even upscaling footage to higher resolutions. In Martin Scorsese's The Irishman (2019), the film uses AI and deep learning techniques to de-age actors like Robert De Niro, Al Pacino, and Joe Pesci.

Will AI Replace 3D Technology in Film and TV?

It is highly unlikely that AI will fully replace 3D technology in the world of Film and TV. Rather, AI is more likely to act as a supportive tool that enhances the efficiency of the 3D production process, rather than replacing it altogether. The integration of AI will allow for faster workflows and more streamlined production pipelines, which will free up valuable time for 3D artists to focus on the more creative and nuanced aspects of their work.

While AI can assist with repetitive tasks like modeling, texturing, animation, and rendering, it cannot replace the human element of creativity that is vital to the success of 3D productions. These human qualities cannot be replicated by AI, which is still far from understanding or capturing the emotional complexity of human consciousness.

AI tools can help automate routine tasks, enhance visual effects, or assist with decision-making in complex scenes. However, even as AI grows more sophisticated, many aspects of 3D in Film and TV require intuition through imagination.

Moreover, problem-solving remains a distinctly human trait. While AI can be trained to follow patterns and make recommendations based on data, it cannot yet tackle the unpredictable, ever-changing challenges that arise during the creative process. Artists rely on their ability to think outside the box for unexpected technical hurdles or complex narrative decisions.

AI is continually evolving but lacks the emotional understanding and adaptive decision-making capabilities of human consciousness. The unique way humans perceive the world, understand emotions, and inject those feelings into artistic work will always be a key differentiator between what AI can do and what artists can achieve.

Reference: Growika at Unsplash

In conclusion, AI and 3D technology are not in competition with each other; instead, they will continue to always complement each other. AI plays an important role in making 3D production more efficient and giving artists the freedom to focus on their creative work. The future of 3D in film and TV will likely involve a harmonious collaboration between talented human artists and AI technology, each enhancing the other's capabilities in the pursuit of exceptional storytelling and visual 3D experiences. 3D will always capture the basis of human ingenuity, imagination, and innovation.