Mixing Generative Videos with XR Reality - What Is the Result?

In our last newsletter, I discussed the "Uncanny Valley and the Dangers of Deep Fakes". You can still read it here.

It was about images and how quickly the quality of generated images evolves and that it already really hard to spot if an image is real or not real. That basically means there is no "uncanny valley" anymore.

This week, we go the next step. And that is video.

Most likely, you take a lot of photos. And with devices like the iPhone or other smart phones, most people have now the equipment to produce really good photos. You still have to know what to do, but it has become a lot easier and more convenient.

But creating a video is something completely different.

Today, drones are often used for breath-taking videos and documentaries (and of course for "Hollywood" movies too).

That opened the field for a complete new job - drone pilot. Sadly, this plays also an increasingly important role in the war and in future wars, but we focus here on the creation of movies.

Organising a drone pilot and a location can be costly. But the results are often amazing and still not "common" for the "average" consumer. Having a perspective of a bird is still something which makes you stop and watch, doesn't it?

This space is going to be massively impacted by generative AI. OpenAI just released "Sora" which creates stunning videos just based on a "simple" prompt.

Have a look at the following video - click below.

?

https://openai.com/sora?video=suv-in-the-dust

This is a "typical" drone video where the drone follows a car. Only, this is not a drone video but a generated video. Of course as you know it is generated, you spot the little errors.

But similar to the image newsletter, it is important to notice. The quality will never be worse than today. Using a similar pace like I shared two weeks ago for videos, you can imagine where we are heading.

Does that matter for "normal" people? Maybe not so much. But for this industry of film-makers, drone pilots and others it does. And it does for marketers who have a complete new toolbox at their disposal.

Now, let's put the spotlight on another component of video - XR.

XR: The Canvas of the Future

XR, or Extended Reality, is the umbrella term that encompasses Virtual Reality (VR), Augmented Reality (AR), and Mixed Reality (MR). It's the canvas where digital and physical realities converge, creating immersive experiences that can teleport you to distant worlds or overlay fantastical elements onto our mundane surroundings. XR is not just about what you see; it's about what you feel, believe, and experience.

Why is this relevant today?

Well - Apple just release the Apple Vision PRO. And from first reports, it is another breath-taking product (yes, it also has a proud price tag).

For example, it is possible to record your environment in 3D and then play it again and merge it with your real view of your environment.

If we add generative AI from above to the mix, we are in a world where we do not know what is real and what is not real.

And that moment is approaching very fast.

If you recall, I covered Deep Fakes in the last newsletter. Now, we have Deep Fake Videos. Some of that is already out there - but not yet to the quality level you need to really make an impact.

You have to remind yourself that we are not looking for "fake" or "generated" content when we go through our lives or watch television. We are not trained to be always sceptical and on the lookout.

So, the threshold to convince our brain that something is real is very low.

Of course, I do not want to overstress the risks here, but they are important due to the spee of the development.

The Opportunities: A Creative Renaissance

This fusion heralds a new era of content creation and consumption. For creators, the ability to generate bespoke video content for XR environments opens up a new frontier of storytelling and artistic expression. For industries, from education to entertainment and beyond, the potential applications are as varied as they are impactful. Imagine learning history by walking through generative, lifelike recreations of ancient civilizations, or attending a concert where the visuals are generated in real-time, synced with the music.

The Challenges and Risks: Navigating Unknown Terrain

As with all great advancements, there is a flip-side. The ethical implications of generative content — from deepfakes to copyright issues — are significant hurdles. There's also the technical challenge of seamlessly integrating generative videos with XR environments, ensuring a fluid and coherent experience that doesn't compromise on realism or immersion.

Privacy concerns, especially with AR applications that overlay digital content onto the real world, are paramount. As we blend digital content with physical reality, the line between what's private and what's public becomes increasingly blurred.

The Future is Generative

By now, you should be aware that "the future is generative". We are still at the beginning of the journey but the train is rolling. Reach out how we can support you and your teams with trainings and support on GenAI plus for Executives and Leaders.

Wishing you a great weekend ahead.?

Michael?

P.S.: As always, your thoughts and insights are very welcome. Share your perspective on Generative Videos, Deep Fakes and more in the comments below or reach out directly. Let's keep the conversation going!

And yes, this article was also (a little bit) supported by GenAI.?

Also, subscribe** to "Beyond the Buzzwords" if you have not yet.