How can you combine AR with other technologies?

GenAI and AR are a perfect pairing. Use GenAI to generate assets, textures, and even code to help accelerate augmented reality development. You can also incorporate GenAI into your AR experience to give your user greater creative control in experience where they can use text-to-image, for example, to change the texture on a virtual object in world space, the background of an image target, or even change the sky using semantics with a simple prompt.

XR and AI are a match made in heaven, not that we're in any way biased at @XRAI. Augmenting the real world with contextually relative information could be AR's killer feature. We call this Augmented Intelligence. Imagine being part of the conversation and having information and responses dynamically suggested around you, based on previous conversations you've had. That's nirvana.

With the advancements of Artificial Intelligence in these last two or three years, specially on Generative AI, humanity is approaching the next level of technological evolution. Combining AI with Augmented Reality can make this process even faster reliable and more useful. As AR is essentially "programmable vision", we can use it with AI to identify and count objects, to locate ourselves and find a guided way to a specific location, see information about something that is at some distance, generate virtual objects and useful information on-the-fly to help us accomplish some tasks and many other innovations that we can benefit from. AI + AR are the foundation of the new computing era and will lead humanity to a promising future.

In my journey with SeaDeep, a startup that leverages AR to augment undersea data for optimizing human performance, the role of AI has been nothing short of transformative. Utilizing frameworks like TensorFlow and PyTorch, we've elevated our AR experiences. These AI integrations enable real-time object recognition and decision support, critically enhancing the performance and safety of divers and marine researchers. It's not just about making your AR experience smarter; it's about making it indispensable for achieving peak human performance in challenging environments. For anyone in the startup world, the AI-AR combination isn't just a nice-to-have; it's the future of user engagement and operational excellence.

AR as a concept is pretty straightforward. Adding detail to the "real-world" through digital tools. The real power of AI as it relates to AR is not only the efficiencies it brings to the content creation side of things, though that can't be discounted. The power really lies in ability for these LLMs to parse massive amounts of data quickly and relay that knowledge contextually as valuable "detail". Schematics, SOPs, manuals, etc. all condensed into knowledge that can be delivered as needed.

Connecting AR glasses to the cloud provides access to limitless resources to offload compute from the glasses or a tethered phone. Transcribing audio around the user or interfacing with LLMs are great examples of combining AR and the Cloud.

Cloud and Edge computing are essential elements of the future Augmented / Spatial Internet. Networks such as 6G and its successors will allow for devices to be smaller, lighter and more accessible, whilst delivering outstanding experiences thanks to technologies such as Pixel Streaming, which will empower users with rich experiences. Data can be processed and delivered entirely via Cloud, or just partially, for those who will prefer to own more powerful hardware. But ideally the networks of the future will allow both use cases. Cloud could be the key to the amount of processing required for seamless massive AR experiences in our daily lives.

Cloud Storage allows for assets to be loaded in from an external server. This can offer the opportunity of a larger file size and more expansive AR experience.

The entry point for AR can be challenging for some users, so WebAR is a great solution. Your audience will find WebAR to be one of the most accessible ways to access augmented applications since it requires the least amount of participation from the user. External app downloads can be a pain point for some users who are already adjusting to the new and innovativie world of AR. Solving for this via 8th Wall and Three.js has proven to work for many e-commerce and online shopping brands such as Ikea, Currys PC World and CartMagician.

I believe that WebAR is reshaping brand storytelling. Combining Augmented Reality with web platforms allows brands to create deeper experiences while capturing new behavior metrics. At my creative brand studio, Epic Playdate, we’ve recently added WebAR Design to our suite of services. One example of our WebAR work is for our hospitality client. We designed an email marketing campaign to introduce 'Happiest Hour'. Leverage email to “meet our guests where they are” is essential for the conversion. To me, it’s about enhancing brand stories, boosting customer loyalty, and leading them directly to our events. WebAR offers an immersive narrative; it's not just storytelling, it's an invite to experience it. #WebAR #EpicPlaydate

If you're going to utilize accessibility, the Web and AR together is your answer. Users only need a working internet connection, a link, and Voila! But it’s a double-edged sword. As much as it’s accessible, there’s a limit to the content you’ll be able to put into your AR experience. The more bytes your Web AR carries, the more it’ll be harder to load. In the end, would it really be accessible to your users? That’s why it’s also important to consider the user experience. I think story-telling plays a big role in making it effective, having the actual website as your foundation of content and adding the AR experience to emphasize important details. Despite the smaller content, you are giving access to your user to see a bigger picture.

Web and AR will certainly continue to walk hand in hand for the next few years given this combination provides a low entry point for new and current users of AR to have their experiences. It provides a seamless and accessible way for users to have their experiences, without needing to install any additional apps or extensions. Since seamless devices such as AR glasses haven't quite catch on just yet (we have some models available, but nothing customer friendly yet), WebAR will continue to be the way to go in the next years.

3D modeling is the first step towards promoting products with AR Shopping experiences such as virtual try on for eyewear, footwear, watches and jewelry in general. The cheaper and easier to create 3D models for this channel, the more penetration we will see for AR shopping tools and usages. The number one reason AR shopping is still not widely adopted is the high cost and complexity of creating these 3D models. At VRee.ai we are dedicated to fix this. Using AI and machine learning we generate 3D models at high quality, saving up to 99% of the cost and time. AR shopping is the future and our 3D modeling solution is here to help.

AR and CAD In the world of design and engineering, the fusion of Augmented Reality (AR) and Computer-Aided Design (CAD) is breaking down barriers and revolutionizing how we create and interact with 3D models. Augmented Reality enriches the CAD experience by overlaying digital designs onto the real world. This integration provides designers, engineers, and architects with a dynamic way to visualize, review, and collaborate on projects.

AI, leveraged properly, can accelerate the 3D modeling process for creating FBX and OBJ files that UNITY can consume. We have automated this creative pipeline bringing weeks down to hours in many cases.

Yes, we can use the 3D representation of an object or a space and add real-time data to the scene from the IoT (IIoT) platform. We will obtain a very useful AR experience suitable for use in any environment, especially in the industrial environment. .

Although 3D is not necessarily essential for an AR experience, it's definitely one of the main characters. When looking at devices such as Meta's Quest, Apple's Vision Pro and others, you can see many of them still adopt many concepts we're familiar with, being Windows the main one. We've always worked in 2D and used windows since the 90s. So 3D is not really needed, however to allow for truly immersive and outstanding experiences, having 3D objects is key: Shopping, Education, Fitness, and more. Having the ability to visualize objects in 3D allows for better, more seamless experiences that recall the real world.

Universal Spatial Anchors are the missing ingredient to realise the full potential of the GenAI+AR revolution. This will allow full deployment of AR overlays in the real world, replacing existing way finding, QR codes and wifi beacons, allowing Municipalities to set rules regarding the safe use of AR in urban environments and opening up a whole new range of services. The spatial anchor ecosystem is converging towards this through various forms of interoperability and translation tools so there is room for optimism

Computer vision when combined with AR is really exciting. Using CV libraries with AR it is possible to detect what is in the scene and then display contextual AR information. Scene understanding allows virtual content to seamlessly blend with the physical world.

Spatial design / building architecture and AR. When thinking of value and digital design i see these elements as some of the “lowest hanging fruits”. Mostly because this is the field i work within every single day. The design process of spatial design and building architecture is almost fully 3d today with focus on digital modelling for both BIM and CAD design that is used for developing blueprints and documentation. Most of this digital material is sketched in 3d for creating renderings or visualisations as a communicative toolset or later a selling point. When adding on the element of costs, there is rarely made physical 1:1 modelling to see the potential space / element. I look forward to follow this field and be apart of the journey.

AR + Blockchain: Blockchain technology enables shared, persistent AR experiences by allowing secure digital ownership of virtual assets. Blockchain also facilitates AR-based transactions, like buying virtual goods tied to a location.

Medical imaging with AR. AR allows medical professionals to overlay real-time or pre-acquired medical images, such as MRI or CT scans, onto a patient's body during surgery or diagnostic procedures. This fusion of data enables surgeons to visualize critical structures, like blood vessels or tumors, with precision, enhancing surgical accuracy and reducing the risk of complications. Moreover, AR-based medical education platforms offer an immersive learning experience for students and practitioners, allowing them to interact with 3D anatomical models and practice complex procedures virtually. This synergy between medical imaging and AR not only improves patient outcomes but also advances medical training and research in profound ways.