Hugging Face launches iOS app that recognizes objects via camera

Artificial intelligence startup Hugging Face has released an iOS mobile app that can identify objects in real-time using the iPhone camera.

TechCrunch reported this.

We tell you how this technology works and what analogs it has.

How does HuggingSnap work?

The new app, called HuggingSnap, uses Hugging Face’s local smolvlm2 computer vision model to analyze images without having to send data to the cloud, ensuring maximum privacy.

What can HuggingSnap do?

• Recognizes objects and explains what is in the frame.
• Analyzes the context of the scene and describes events in the background.
• Reads text in the image.
• Answers questions about objects in the camera's field of view.

To work with the application, just point the camera at any object and ask the question you are interested in. You may also watch a YouTube video to find more details.

Where can it be used?

HuggingSnap will be useful in various situations:

• When shopping – it will help identify products.
• When traveling – it will identify landmarks and read signs.
• For learning – it will provide explanations for objects or texts.
• For exploring the world – it will help you better understand the environment.

Compatibility

The app runs on iOS 18 and later, and is also supported on macOS and Apple Vision Pro, so you can use it not only on your iPhone but also on your MacBook or mixed reality headset.

The launch of HuggingSnap demonstrates the growing interest in local AI solutions that do not require an internet connection and work directly on users' devices.