What the Heck is Spatial Computing Anyway?

I've been proudly consulting in the Metaverse and Virtual Worlds sector for over 15 years and have seen a lot of phrases, buzzwords, technologies and indeed companies come and go. And, whilst for some people the phrase 'Metaverse' isn't as cool as it used to be, it's still cool for me and has dozens of incredible use cases and applications for both consumers and enterprise organisations.

The new buzzword kid on the block is Spatial Computing, led of course by the launch of the Apple Vision Pro. Is this the new Metaverse? Is it the old XR or MR rebranded? Who cares and does it matter what it's called?

I'm going to attempt to explain what Spatial Computing is and put it in context alongside other related concepts such as Mixed Reality (MR), the Metaverse and Virtual Reality. Probably the best way to make these comparisons is by using a framework called The Virtuality Continuum, which is shown below.

The Virtuality Continuum is a conceptual spectrum that represents the range of immersive experiences from the real world to completely virtual environments and encompasses various degrees of interaction and immersion. At one end lies the physical world, where experiences are entirely grounded in reality. As we move along the continuum, we encounter Augmented Reality (AR). This is effectively a real-world view with digital information, objects and assets added (or augmented) into the field of view.

Moving along the Continuum, the next stage is the inverse of AR, namely Augmented Virtuality (AV), where the balance shifts to an environment that is primarily digital with real-world objects added into the experience. The final stage of the Virtuality Continuum is the virtual world - an environment that is entirely digital with no real-world assets or interactions. Think Roblox, Minecraft or Second Life.

OK. The scene is set. Let's start defining these terms and seeing how they compare to each other. Here's the Virtuality Continuum again, this time with the key concepts and technologies placed accordingly (in my humble opinion of course).

First up, XR, or Extended Reality. XR is pretty much an umbrella term that encompasses the widest range of the Continuum going from AR right through to virtual reality (VR) and virtual worlds. In effect, this is any type of experience that has a degree of digital experience or information within it.

Mixed reality (MR) has a slightly tighter range on the Continuum with a lighter reference to the real-world whilst at the same time not being a completely virtual experience. Whereas an XR application could be accessed via smart glasses or a VR headset, a MR application typically would only accessed with a VR headset.

Virtual reality is a much easier concept to explain. The environment is 100% digital with no view or reference to the real world.

Next up, it's 'that' word, the Metaverse. Metaverse applications range from fully immersive 3D digital environments through to Augmented Virtuality experiences with a small element of the real world injected.

Ok, so it's time for the theme of this article, What the Heck is Spatial Computing Anyway?

At its core, Spatial Computing is about understanding and interacting with physical space in a digital context. It's like giving computers a sixth sense.

They can perceive and make sense of the physical world much like humans do. Spatial Computing applications recognise objects and understand their purpose. The ' 'magic' of Spatial Computing is the ability to add digital layers to the physical environment, enriching interactions and engagement. Here are five applications for Spatial Computing:

1. Navigation and Wayfinding: Spatial Computing can revolutionise navigation and wayfinding systems by providing real-time guidance and information in physical spaces. For instance, overlaying directions onto the user's view, guiding them through complex environments like airports, museums, or shopping centres with ease.
2. Architecture and Design: Spatial computing enables architects and designers to visualise and interact with 3D models in real-world contexts. Using spatial computing tools, professionals can overlay digital models onto physical spaces, allowing them to assess scale, proportions and design elements in real-time.
3. Training and Simulation: Spatial computing offers immersive training and simulation experiences across various industries, from healthcare to manufacturing allowing trainees to practice skills and procedures in realistic environments without real-world consequences. For example, medical students can perform virtual surgeries, while factory workers can undergo safety training in simulated hazardous conditions.
4. Retail and Marketing: Spatial computing enhances the retail and marketing experience by enabling interactive and personalised shopping experiences. Retailers can use Spatial Computing to allow customers to try on virtual clothes or visualise furniture in their homes before making a purchase.
5. Urban Planning and Smart Cities: Spatial computing can play a crucial role in urban planning and the development of smart cities. City planners can use it to visualise proposed infrastructure projects in the context of existing urban environments, allowing for better-informed decision-making and public engagement. Additionally, spatial computing technologies can support the implementation of IoT (Internet of Things) devices for real-time monitoring and management of urban systems like traffic flow, energy usag and waste management.

Whilst some of these use cases can also be achieved using AR hardware and technologies, the primary difference and indeed advantage of Spatial Computing is the ability to understand and interpret the environment that the user is in. AR applications typically only overlay digital assets as opposed to truly and natively embedding them.

Anyway, that's my take on Spatial Computing. Hopefully, that made some sense. If not, what's your opinion?

For me, Spatial Computing is just another facet of what is generally known as immersive experiences. It will have many applications for the Metaverse to lesser and greater extent and at KZero Worldswide we're looking forward to pioneering its use for our clients.