Traveling the world: Pokémon Go & Google Gemini help explore and explain the physical world

Summary

In the modern era of travel, traditional tour guides face competition from innovative technologies such as Pokémon Go and Google Gemini. These digital companions offer 24/7 accessibility, vast knowledge, and personalized experiences, transforming the way we explore the world. While traditional guides may struggle with limitations in world knowledge and availability, Pokémon Go and Google Gemini provide seamless access to information and recommendations, tailored to individual interests. From uncovering hidden gems to unraveling cultural mysteries, these technologies enrich the travel experience, offering insights and companionship on every journey. As we look to the future, the integration of LLMs and augmented reality promises even greater possibilities for immersive exploration, bridging the gap between curiosity and understanding in the ever-evolving landscape of travel.

Table of Content:

? Prologue

? Before travel: itinerary planning

??? Itinerary Generation

??? Plan Executions

? During travel: a 24/7 professional guide at your own pace

??? Pokémon Go Helps Travelers Explore the Physical World

????? Unveiling Hidden Gems

????? Exploring Hoàn Ki?m Lake, Hanoi

??? Google Gemini Helps Travelers Explain the Physical World

????? Unveiling Hidden Histories

??? Gemini’s Image Understanding is a Killer Feature

????? Unveiling Mysteries at Tr?n Qu?c Pagoda

????? A Versatile Companion with Limitations

??? An LLM is More Knowledgeable Than Most Humans or Guides

????? Unraveling Culinary Traditions

? Limitations of Pokémon Go and Google Gemini

??? Connectivity Constraints

??? Local LLM Limitations

??? Niche Object Recognition

? Pokémon Go and Google Gemini are your personalized travel guide 24/7

??? Overcoming Traditional Limitations

??? Personalized Experiences

??? Future Possibilities

Prologue

During a recent excursion to Hanoi, Vietnam, I had the opportunity to delve into two distinct approaches to in-travel assistance: relying on human guides and leveraging cutting-edge technology in the form of Pokémon Go and Google Gemini to navigate the city's rich history and vibrant culture.

My exploration involved engaging three human guides, each offering a unique perspective:

1. A knowledgeable student providing a four-hour walking tour of Hanoi.

2. A registered tour guide specializing in catering to foreign visitors, distinguishable by their blue tour guide ID.

3. A professional interpreter facilitating business interactions in the city.

Alongside these human-guided experiences, I also embraced the assistance of digital companions:

1. Pokémon Go – “near me games” help navigate and discover interesting places nearby.

2. Google Gemini – Generative AI helps explain culture and places.

These technological marvels, accessible through my smartphone, offered unparalleled convenience, extensive knowledge, and scene understanding, all available at any time and in any location.?

In the end, I found that most of the time I prefer the digital companions represented by Pokémon Go and Google Gemini. However, it's essential to acknowledge that human tour guides excel in scenarios where internet access is limited or in niche contexts where technology may fall short.

In the following blog, I'll share my reflections and experiences, supplemented by pictures and comparisons captured during my travels. To make this guide complete, first I'll touch upon the role of Generative AI in pre-travel planning. But my focus will primarily be on its impact during-travel. Let's embark on this digital and human-guided exploration together.

Before travel: itinerary planning

As the digital age continues to revolutionize the way we explore the world, Generative AI technology, powered by Large Language Models (LLMs), has emerged as a formidable ally in travel planning. Pre-travel assistance offered by LLMs typically falls into two main categories: itinerary suggestion and plan executions.

Itinerary Generation

In the realm of itinerary generation, LLMs excel in crafting comprehensive travel plans that encompass cultural experiences, culinary delights, accommodation options, and must-visit tourist sites. For instance, Google Gemini's travel itinerary recommendation feature leverages its advanced algorithms to curate personalized travel plans tailored to individual preferences.

Additionally, Microsoft Copilot offers a dedicated vacation planner, further streamlining the itinerary generation process. These tools analyze vast amounts of data to suggest optimal routes, activities, and timelines, ensuring a seamless and enjoyable travel experience from start to finish.

Plan Executions

Beyond itinerary generation, LLMs also function as virtual travel agents, assisting travelers with various planning actions such as ticket booking, hotel reservations, car rentals, and tour arrangements. Through API integrations with third-party systems, these LLM-powered assistants can scour the web for relevant information and seamlessly execute bookings on behalf of travelers.

For example, Google Gemini integrates with Google Flights and Google Hotels, providing users with direct access to flight and accommodation options. Similarly, ChatGPT offers integration with platforms like Expedia and Kayak, allowing travelers to search for and book travel-related services effortlessly.

While meticulous planning before travel is undoubtedly crucial, the journey itself presents its own set of challenges and opportunities. In the subsequent sections, we'll explore how LLMs continue to support travelers throughout their adventures during travel, offering guidance and insights to navigate the world with confidence and ease.

During travel: a 24/7 professional guide at your own pace

During travel, I found that most of the time, the traditional audio guide devices and human tour guides can be replaced or augmented:

1. Audio guide devices commonly used in museums & art galleries
2. A human tour guide

Alternatively, I tried and developed the following system for during-travel assistants:

Pokémon Go: Navigation and Exploration

Pokémon Go emerges as a dynamic alternative to traditional tour guides, offering users a gamified experience that encourages exploration and discovery. By overlaying digital elements onto the physical world, Pokémon Go transforms mundane sightseeing into an interactive adventure, allowing travelers to navigate their surroundings with ease and excitement.

Google Gemini: Verbal and Visual Explanations

For a more comprehensive understanding of points of interest, Google Gemini serves as a versatile companion, capable of providing verbal and visual explanations in real-time. Through its intuitive phone app interface, users can effortlessly interact with Google Gemini, seeking clarification on landmarks, artworks, and cultural phenomena simply by asking or sending a photo for analysis.

Seamless Integration for Enhanced Travel Experiences

By seamlessly integrating Pokémon Go and Google Gemini into the travel experience, travelers gain access to a 24/7 professional guide that operates at their own pace. Whether exploring bustling city streets or tranquil landscapes, these digital companions offer unparalleled convenience, flexibility, and depth of knowledge, enriching every moment of the journey.

In the subsequent sections, I'll illustrate how this innovative system enhances the travel experience, providing practical examples and insights into its functionality and effectiveness.?

During travel, the traditional audio guide devices and human tour guides can be replaced or augmented by Pokémon Go and Google Gemini.

Pokémon Go Helps Travelers Explore the Physical World

In the realm of augmented reality gaming, Pokémon Go has transcended its status as a mere pastime to become a powerful tool for exploration. Central to its appeal are PokéStops and Wayspots, which serve as gateways to real-world points of interest, enticing travelers to embark on a journey of discovery beyond the beaten path.

Unveiling Hidden Gems

Points of interest in Pokémon Go are represented by PokéStops and Wayspots.?

Wayspots: Community-Driven Points of Interest

Wayspots are real-world locations submitted by players within Niantic games such as Pokémon Go and Ingress. These points of interest encompass a diverse range of attractions, including historical landmarks, sculptures, parks, and architectural marvels. The submission and approval process is facilitated through Niantic Wayfarer, a community-driven platform where players review and endorse submissions.

PokéStops: In-Game Landmarks

Derived from approved Wayspots, PokéStops are in-game locations in Pokémon Go that serve as hubs for interaction and exploration. Notably, not all Wayspots transition into PokéStops, with Niantic carefully considering factors such as location density and suitability for gameplay when making these conversions.

Exploring Hoàn Ki?m Lake, Hanoi

An exemplary showcase of Pokémon Go's ability to unearth hidden treasures lies in the vicinity of Hoàn Ki?m Lake, affectionately known as the "Lake of the Returned Sword," situated in Hanoi. While tourists are drawn to the iconic Tháp Rùa (Turtle Tower) at the heart of the lake, the journey to this renowned landmark is punctuated by lesser-known points of interest often overlooked by traditional tour guides.

These hidden gems, represented by PokéStops and Wayspots, offer a glimpse into the rich tapestry of local culture and heritage. Despite their significance, these points of interest may elude the awareness of tour guides and even evade inclusion on conventional mapping platforms like Google Maps. However, through the lens of Pokémon Go, travelers are provided with a curated selection of "near me" points of interest, fostering a deeper connection to their surroundings and enriching their travel experience.

Pokémon Go uses a system called Wayfarer to manage Wayspots and Pokéstop submissions and edits. This system allows players to contribute by nominating new Wayspots and reviewing others’ submissions. The expansive network of PokéStops and Wayspots owes its growth to the active participation of the gaming community. Through the collaborative efforts of players, countless new points of interest have been added to the map, amplifying the potential for exploration and discovery. From 11/2019 to 6/2020, 1.9 million Wayspots were added by the community.?

Pokémon Go serves as a catalyst for exploration, encouraging travelers to venture beyond the familiar and embrace the allure of the unknown. By leveraging the dynamic ecosystem of PokéStops and Wayspots, travelers can uncover hidden gems, forge meaningful connections with local culture, and embark on unforgettable adventures that transcend the confines of traditional tourism. In the next section, we'll delve into how Google Gemini complements this immersive experience by offering invaluable insights into the world around us.

PokéStops and Wayspots are the best way to explore “near me” Points of Interest that often tour guides don’t know about or Google Maps doesn’t show.

Google Gemini Helps Travelers Explain the Physical World

In the pursuit of unraveling the mysteries and intricacies of our surroundings, Google Gemini emerges as an invaluable companion, offering unparalleled insights into the physical world that often elude traditional sources of information.

Unveiling Hidden Histories

The Tale of the Swiss Clock

During my exploration near Hoàn Ki?m Lake, a peculiar sight captured my attention: a Swiss clock nestled inconspicuously amidst the urban landscape. Of course, this was discovered through Pokémon Go, as illustrated by the 3rd picture in the above example. Intrigued by its presence and perplexed by its obscurity, I turned to Google Gemini for illumination.

The story of the swiss clock near Hoàn Ki?m, shown in the above picture, answers exactly my questions:

1. Why is there a Swiss clock but nobody knows about it? Due to lack of information provided to the public, even a professional tour guide or locals might not know about its history. But Google Gemini does!
2. Where is the Swiss clock? I couldn’t find it on Google maps, nor would I notice. Thus there’s discussion about relocating the clock to a more prominent location. But Pokémon Go shows where it is!

The Legend of Hoàn Ki?m Lake

In my quest for knowledge, Google Gemini also shed light on the intriguing origins of Hoàn Ki?m Lake, colloquially known as the "Lake of the Returned Sword." Delving into its rich history and folklore, Gemini painted a vivid portrait of a legendary sword and the mythical turtle that played a pivotal role in Vietnamese folklore.

What sets Google Gemini apart as a travel companion is its ability to provide insights that transcend the limitations of conventional tour guides. With Gemini at my fingertips, I was empowered to delve deeper into the history and culture of my surroundings, unearthing hidden gems and untold stories that enrich my travel experience.

Google Gemini explains the world better than a professional tour guide.

Moreover, Google Gemini's user-friendly interface and intuitive features, such as the text-to-speech function, offer unparalleled convenience for on-the-go exploration. Paired with wireless earbuds, Gemini transforms into a dynamic audio guide, delivering immersive narratives and informative tidbits as I navigate the bustling streets and serene landscapes. Didn’t someone claim that the future of augmented reality is earbuds, not eyeglasses?

Wireless earbuds with the text-to-speech feature of Google Gemini are the best on-the-go travel guide – an amazing use case of Augmented Reality.

In the ever-evolving landscape of travel technology, Google Gemini stands as a beacon of enlightenment, illuminating the world with its boundless knowledge and insightful commentary. From unraveling the mysteries of obscure landmarks to delving into the legends that shape our cultural heritage, Gemini transcends the role of a mere guide, serving as a gateway to a deeper understanding of the world around us. As we continue to embrace the wonders of augmented reality, Gemini emerges as a transformative force, shaping the future of travel exploration one insight at a time.

Gemini’s Image Understanding is a Killer Feature

In the realm of visual comprehension, Google Gemini emerges as a trailblazer, boasting an unparalleled ability to decipher and elucidate the intricacies of the world captured within a single image.

Unveiling Mysteries at Tr?n Qu?c Pagoda

During my visit to Tr?n Qu?c Pagoda, the oldest Buddhist temple in Hanoi, I encountered a scene shrouded in mystery: individuals engaged in a ritualistic procession around a towering tree. Perplexed by the significance of this ritual, I turned to Google Gemini for illumination: Why are these people circling around the tree in this Buddhist temple?

First of all, Gemini successfully recognized the temple to be Tr?n Qu?c Pagoda based on a single photo (left picture above)! Isn’t it amazing? Then it went on to explain the circling. What’s more, even though the texts are partially covered by people in the photo, it still successfully figured it out: "DUONG LICH", "CHíNH? NGHI?P", and "CHíNH".

A Versatile Companion with Limitations

I found that Google Gemini is great at translating and recognizing objects in photos. But sometimes it refuses to recognize or comment about people. I wish it uses the GPS location of uploaded photos to help it understand more. But I understand why Google wouldn’t do so due to privacy protection.?

As Google Gemini continues to evolve, it gradually assumes the mantle of my preferred tool for image-based inquiries, gradually supplanting Google Lens in its role as my default companion for visual exploration.

If you are out for sightseeing, Google Gemini can augment your eyes and brain.

A Window to the World

As we traverse the globe in search of adventure and enlightenment, Google Gemini emerges as a faithful companion, offering a window to the world that transcends language barriers and cultural divides. With Gemini by our side, the journey becomes more than mere sightseeing; it becomes a voyage of discovery, enlightenment, and unparalleled wonder.

In the subsequent sections, I'll delve deeper into the transformative capabilities of Google Gemini, exploring its potential to reshape the way we perceive and interact with the world around us.

An LLM is More Knowledgeable Than Most Humans or Guides

In the pursuit of culinary exploration, the world-famous Vietnamese egg coffee stands as a delightful testament to the rich tapestry of flavors and traditions that adorn our global gastronomic landscape. As I savored the creamy sweetness of this beloved beverage, I found myself immersed in a dialogue with my local guide, eager to unravel the mysteries that enshroud its creation.

Unraveling Culinary Traditions

Guided by my local companion, I ventured into a quaint café to sample the renowned Vietnamese egg coffee, a concoction revered for its smooth texture and rich flavor profile. As I indulged in this decadent treat, my guide regaled me with tales of its origins and preparation techniques, including the intriguing revelation that the egg yolk is cooked through the process of blending.

The blending took a long time and made a lot of noise in the café. I think the barista blended the egg yolk for at least 5 minutes. Then I can’t help but ask: how did people process the egg yolk before a blender was invented? My guide said he never thought of that. The egg coffee was invented before he was born. He had always seen it made with a blender.

To answer the question, one must know at the time when egg coffee was invented: 1) whether the blender was invented; 2) if yes, was it available in Vietnam 3) if no, what else was used. My local guide didn’t connect these dots. But Gemini had a straight answer:

Old fashioned whisking it was!

Delving deeper into the intricacies of egg coffee preparation, Gemini debunked misconceptions surrounding the cooking of egg yolks during blending. Contrary to popular belief, the heat generated by blending is insufficient to fully cook the yolks, offering a more nuanced understanding of this culinary tradition.

I went on and on to find out why egg coffee was not as popular as coffee with milk. Gemini (or any large language models) satisfied my intellectual curiosity. I believe most guides would not have that extensive knowledge or patience with my quirky questions.

LLMs have both the knowledge and patience to provide 360 view of a tourist interest.

In the realm of travel and exploration, Large Language Models like Google Gemini stand as indispensable companions, offering a 360-degree view of tourist interests and enriching the journey with their boundless knowledge and unwavering patience.

Limitations of Pokémon Go and Google Gemini

As with any technology, both Pokémon Go and Google Gemini come with their own set of limitations that may impact their effectiveness in certain scenarios.

Connectivity Constraints

Dependency on Internet Access

A primary limitation of both Pokémon Go and Google Gemini is their reliance on internet connectivity. In areas without internet access, such as remote wilderness or underground locations, these technologies may be rendered ineffective, restricting their utility for travelers seeking exploration off the beaten path.

Indoor Restrictions

Pokémon Go, in particular, is predominantly designed for outdoor exploration and may not function optimally within indoor environments. As a result, travelers seeking guidance or information within museums, galleries, or other indoor attractions may find limited utility in Pokémon Go as a travel companion.

Local LLM Limitations

I still remember the good old days of using the Lonely Planet book. I also downloaded the entire Wikitravel website to my phone to read the html pages for each city. In this sense, the Lonely Planet book or the offline copy of Wikitravel functions as my local LLM.

Lack of World Knowledge

While locally-run LLMs may offer offline functionality, they often lack the expansive world knowledge and internet access that cloud-based LLMs possess. With limited parameters, local LLMs may struggle to provide comprehensive and up-to-date information, particularly in niche or specialized contexts.

Resource Requirements

Running a local LLM on a mobile device requires substantial computational resources, including ample RAM and processing power. This resource-intensive nature may present challenges for travelers with older or less powerful devices, limiting the feasibility of utilizing local LLMs as travel guides.

Niche Object Recognition

Limitations in Artifact Recognition

In environments such as museums, where specific artifacts may defy conventional categorization, Google Gemini may struggle to provide accurate recognition and explanations. In such instances, traditional museum guides may offer superior expertise and insight, leveraging their specialized knowledge to enrich the visitor experience.

Reliance on Human Expertise

Ultimately, while technologies like Pokémon Go and Google Gemini offer unprecedented convenience and accessibility, they may not always suffice in situations requiring nuanced understanding or expertise. In such cases, the human touch provided by knowledgeable guides remains invaluable, bridging the gap between technology and specialized knowledge.

Pokémon Go and Google Gemini are your personalized travel guide 24/7

In the realm of travel companionship, Pokémon Go and Google Gemini stand as revolutionary tools, offering unparalleled accessibility, knowledge, and convenience to travelers around the globe. By harnessing the power of augmented reality and advanced language processing, these technologies redefine the traditional tour guide experience, providing a personalized journey tailored to each traveler's unique interests and preferences.

Overcoming Traditional Limitations

Expanding Knowledge Horizons

One of the most significant drawbacks of traditional tour guides lies in their limited world knowledge. However, with Google Gemini at your fingertips, travelers gain access to a vast repository of information, enriched by real-time updates and insights gleaned from the vast expanse of the internet. Whether seeking historical anecdotes or cultural nuances, Google Gemini serves as an omniscient guide, ready to illuminate the path with its boundless knowledge.

Uninterrupted Availability

Unlike traditional tour guides, whose availability and capacity may be constrained by time and resources, Pokémon Go and Google Gemini offer round-the-clock assistance, ensuring that travelers can access answers and recommendations at any time, without the need to wait or schedule appointments. This seamless accessibility enhances the flexibility and autonomy of the travel experience, empowering travelers to explore at their own pace.

Personalized Experiences

Tailored Recommendations

Pokémon Go and Google Gemini have the potential to deliver highly personalized experiences, curated to align with each traveler's unique interests and preferences. Through sophisticated algorithms and user feedback mechanisms, these technologies can offer targeted recommendations, guiding travelers to hidden gems, local hotspots, and off-the-beaten-path attractions that resonate with their individual tastes.

Enriched Cultural Immersion

By integrating translation, interpretation, and cultural explanation functionalities, Pokémon Go and Google Gemini foster deeper cultural immersion, enabling travelers to engage with their surroundings on a more profound level. Whether deciphering local customs, navigating language barriers, or unraveling historical mysteries, these technologies serve as indispensable companions, enriching the travel experience with meaningful insights and understanding.

Future Possibilities

Evolving Travel Applications

Looking ahead, the future holds limitless possibilities for the integration of LLMs and augmented reality technologies in travel applications. From sightseeing recommendations to real-time translation services, these innovative solutions have the potential to revolutionize the way travelers explore and interact with the world around them. By harnessing the collective power of LLMs and "near me" points of interest, travelers can embark on immersive journeys guided by knowledge, curiosity, and companionship.

Endless Exploration

In the evolving landscape of travel technology, Pokémon Go and Google Gemini pave the way for a future where travelers are never truly alone. With the support of LLMs and the companionship of digital entities, every journey becomes an adventure, every destination a discovery, and every moment an opportunity for exploration and enlightenment.

As we embrace the boundless potential of technology in travel, we embark on a journey of endless exploration, guided by curiosity, fueled by knowledge, and enriched by the transformative power of Pokémon Go and Google Gemini. Let the adventure begin. The travelers won’t be lonely anymore as they are accompanied by LLMs and possibly Pokémon monsters!