The Tech Behind the AR-Enabled Short Film, Remembering on Disney+

Technology has always played a crucial role in the transformation of cinema. However, in recent years it's not just about the Special effects (SFX) and visual effects (VFX) that we see on the big screen but inside cinemas too. The arrival of 4D includes three-dimensional movies combined with seat movement, which raised the bar of expectations for the cinema experience.

We have already seen the emergence of 5D, which shows 3D movies, seat movement, and various special effects such as snow, wind, and rain. As we look to the future, we can expect interactive cinema with 360°rotation functions brought to life by immersive glasses. But how is technology also transforming home entertainment?

In my daily tech podcast, I always say that technology works best when it brings people together. This is one of the reasons I am a big fan of filmmaker Elijah Allan-Blitz who first appeared on my radar for wanting to use the same technology that was dividing us to try and use it to bring us closer together. In 2020, he teamed up with Brie Larsen to create a VR experience to put the viewer in the shoes of those from other walks of life.?

The Messy Truth VR Experience is an Emmy-nominated virtual reality series designed to build empathy. Each episode is based on a true story and literally places the viewer in the shoes of those from other walks of life. By leveraging technology, the concept pushed the boundaries of storytelling to create empathy and understanding. But it also resulted in them winning an Emmy.?

Here in 2022, Elijah and Brie found themselves asking where do ideas come from and where do they go when they're forgotten? Children and adults have attempted to find the answers to these questions for thousands of years. But Emmy award-winning director Elijah Allan-Blitz found himself inspired by Elizabeth Gilbert's work and the genesis of ideas. He decided to explore the concept with a short film called Remembering, which is currently available on Disney+.

The story follows a writer (played by Academy Award? winner Brie Larson) who loses an important idea when her phone rings. Personified as golden light, this lost idea is found by the writer's inner child, who takes us on a journey through the world of imagination. It is easy to lose touch with this world, but we can be inspired by it if we remember.?

With a first-of-its-kind AR companion, the film's moving image triggers an AR experience, and Disney+ subscribers in the U.S. can interact with the story by scanning the TV to extend the universe in the film into our living room.

Elijah recently joined me on Tech Talks Daily to discuss how they have created an AR experience that provides audiences with a visual extension of the TV screen via their smartphone or tablet. I learn more about the group of artists and creatives at Disney who are completely immersed in all the newest cutting-edge technology to help support storytellers make the innovative leap to NextGen storytelling.

Elsewhere there are also increasing examples of how rapid progress in machine learning and artificial intelligence is disrupting many aspects of the traditional filmmaking process, both for live-action and for animation productions. Emerging technologies are also transforming every element of the filmmaking process with algorithmic video editing, 3D printing, 3D previsualization, and real-time rendering, all opening up new realities for filmmakers.

For these reasons alone, I suspect we are just scratching the surface of how AR and VR can help filmmakers enhance storytelling as they bravely navigate unchartered digital waters when exploring the art of the possible inside our humble living rooms.

You can listen to the full conversation where we explore the future of storytelling to audiences through innovative technology -- a pillar that is core to their joint production company, The Great Unknown Productions.