How to Create an AR Face Filter Using Unity

Augmented Reality (AR) has become a prominent trend in mobile apps, with applications ranging from fun face filters to interactive learning experiences. In this guide, we’ll walk you through creating a simple AR Face Filter using Unity and the AR Foundation package.

Step 1: Setting Up Unity and AR Foundation

1. Install Unity: Download and install the latest version of Unity Hub. Ensure you have a recent Unity version that supports AR Foundation (2019.4 or later).
2. Create a New Project: In Unity Hub, create a new project, selecting the 3D (URP) template for enhanced rendering. Name it appropriately, like ARFaceFilter.
3. Install AR Foundation Package:

• Go to Window > Package Manager.
• In the Package Manager window, select AR Foundation and Google ARCore XR Plugin(For Android) or Apple ARKit XR Plugin (For Mac). You will need both to track the user's face and apply filter.

4. Set Up XR Plugin Management:

• Go to Edit > Project Settings.
• Select XR Plugin Management and install the plugin.
• Enable ARKit (for iOS) or ARCore (for Android), depending on your target platform.

Step 2: Set Up AR Components in the Scene

1. Create AR Session and AR Origin

• In your Unity scene, right-click in the Hierarchy, go to XR and add an AR Session and an XR Origin.
• AR Session manages the AR lifecycle (like start/stop).
• XR Origin defines the point of origin for AR space.

2. Add AR Face Manager

• Select XR Origin in the Hierarchy.
• In the Inspector, click Add Component and search for AR Face Manager. This component will track the user's face.

Step 3: Create the Face Filter

1. Create the Face Mesh:

• Right-click the Hierarchy panel and go to XR and then Choose AR Default Face.
• Now you can drag that AR Default Face to the Assets Window and Create a Prefab of this AR Default Face.
• Lastly, You can drag this Prefab to the AR Face Manager Component Face Prefab Space.
• You can drag any Customize Materials to the Prefab Mesh Render.

Step 4: Build and Test on a Device

1. Player Settings:

• Go to File > Build Settings.
• Select iOS or Android as your target platform and click Switch Platform.
• Under Player Settings, make sure ARKit/ARCore support is enabled for the respective platform.
• As well as in other Settings, choose untick Auto Graphics API and remove Vulkan Graphics. Because Vulkan Graphics does not Support for AR Application.
• Identification Section Choose Relevant Minimum API Level Configuration section Choose Scripting Backend as IL2CPP.
• Target Architecture you can tick the ARM 64 and then Click Build Button.

Step 5: Fine-Tuning the Face Filter

Once you’ve successfully built and run the AR face filter on a device, you can experiment by adding new elements

• Add animations, and videos to the face filter, such as a mask that moves with facial expressions.
• Create interactive elements like virtual glasses or makeup that respond to touch input

Conclusion

You’ve just created a basic AR face filter in Unity using AR Foundation! From here, you can extend the project by adding more complex features such as facial expression recognition, multiple filters, or even integrating social media sharing functionality.

Feel free to play around and make your filters unique! AR Foundation offers a powerful platform for creating AR experiences on both Android and iOS.

Resources: Unity - Manual: AR development in Unity (unity3d.com)

Happy creating! ???

.