How do you choose AR frameworks and libraries?

For choosing the right platform and device, it is important to understand the target audience and type of usage. WebAR If you are building an application for "one-time usage" eg. marketing AR effect, event AR, specific location AR - you want to go for WebAR probably 8thWall, it is super easy to onboard new users without installing the app. App AR On the other hand, if you are building a long-term project or internal application it's best to go with a dedicated application that allows you to use the full power of the device. Usually, build in Unity3D with ARKit/ARCore or Vuforia. SocialAR The third way is the usage of social apps like Snapchat, IG, or FB which allows you to publish AR effects through their platform.

Consider the essential compatibility factor. Does the AR framework align with your target platform—be it mobile, web, or desktop? Furthermore, does it seamlessly integrate with your chosen devices, such as smart glasses, headsets, or cameras? These questions are paramount as they lay the foundation for your project's reach and accessibility.

Selecting the right AR framework or library is a pivotal step in creating immersive digital experiences. It begins with identifying your target platforms and devices. Your choice should align with your audience and use case. Whether it's mobile, web, or specialized devices like smart glasses, each AR tool varies in compatibility and support. Careful scrutiny of documentation and requirements is essential to ensure your chosen framework suits your project's unique needs and goals.

When selecting an AR platform, one factor to consider is "friction." Will your customers readily download a mobile app? Are you providing more than just an AR experience? If you answered "yes", a native AR experience is the way to go. Alternatively, you can explore AR platforms such as SparkAR, TikTok EffectHouse or Lens Studio. They tie you to specific platforms but offer incredible AR resources. Finally, if you prefer the freedom of not being tethered to an AR platform, webAR is the solution. It operates directly within your mobile browser, boasting faster downloads and offering rich AR resources. While it might not be as sophisticated as the other options, webAR excels in providing an instant, frictionless experience to your customers.

I think about accessibility and open standards. Sure I could create content to add value to an existing product, or I could make it available to everyone and reap that value personally. OpenXR, A-Frame, ModelViewer, Glitch

You also have to keep in mind the long-term viability of the tools. In the case of mobile, the only platforms I trust to still be around years from now are the ones made by the actual hardware manufacturers--so ARCore, ARKit. And then any wrapper on top of those--like Unity's AR Foundation.

Choosing the right Augmented Reality (AR) framework or library is a critical decision in AR development. When selecting an AR framework, define project needs, assess platform compatibility, and consider key features like tracking and 3D recognition. Check for community support and documentation. Examine licensing, team skills, and performance. Evaluate integration, debugging, and future support. Prototype for suitability, and prioritize user experience and design.

When selecting an AR framework it is important to check to see if the features that you are interested in using are available on the platform where your audience is. You can have an amazing AR experience, but if you don't have an audience those cool features and capabilities won't be useful.

This is key! Consider your team's skill level and familiarity with the chosen framework. Do you prefer a user-friendly, well-documented tool, or are you more inclined towards a flexible, highly customizable option? The ease of use and learning curve of an AR framework should align with your team's expertise.

Licensing costs are a big part of decision-making when picking the right platform. Free platforms like ARCore/ARKit, SparkAR, Lens Studio, or Adobe Aero offer free tools to create AR effects and filters. Then there are partly free solutions such as Vuforia which offers basic functionalities for free but things like Model Targets are paid. And then fully paid solutions such as 8thWall which requires a development license but also a kind of costly monthly publishing license. The platforms' pricing also sometimes depends on the size of your company and the use case. Especially for not-so-experienced creators I strongly suggest to try first the free platforms.

Here's a few open-source examples to consider for the needs and the ongoing development of your project. ARToolKit+: A solid choice with precise tracking, compatible with Android and iOS. Future-proofing depends on community support. AR.js: Lightweight and efficient for web-based AR, but its future-proofing relies on the pace of web technology. Google's ARCore: Backed by Google, tailored for Android 7.0+, promising strong future-proofing with Android and AR tech advancements. DroidAR: A free and open-source option for Android AR apps, future-proofing linked to community contributions and updates. HoloKit: Open-source, utilizing mobile devices with headset and software, future-proofing tied to mobile tech advancements.

When designing an AR experience that will persist as libraries and frameworks evolve, it is important to think about how you can build some of these designs and features in a way that is agnostic to the underlying technology. When a new device comes a long it will be possible to port to new library's and frameworks. Unity does a great job of making a wide range of platforms and devices accessible to building AR content.

Selecting the right AR framework is akin to laying the cornerstone of a towering skyscraper. This decision is the bedrock upon which your entire AR development journey will rest. In experiences, I've come to understand that it's not merely about selecting a tool; it's about embracing an open-source philosophy. By doing so, you're not simply choosing a framework; you're constructing a dynamic platform with the potential to serve multifarious purposes. In this article, I'll impart my insights on how cultivating an open-source mindset can be a game-changer in the realm of AR development.