What are some innovative ways to incorporate touch and motion controls into a game?

1 Gesture recognition

One of the most obvious ways to use touch and motion controls is to recognize gestures that mimic the actions or interactions that the player wants to perform in the game. For example, in Fruit Ninja, the player slashes the screen with their finger to cut fruits, or in The Legend of Zelda: Skyward Sword, the player swings the Wii Remote to control Link's sword. Gesture recognition can create a sense of realism and responsiveness, as well as a physical challenge and feedback. However, it is important to design gestures that are intuitive, consistent, and comfortable, and to avoid overloading the player with too many or too complex gestures.

2 Haptic feedback

Another way to use touch and motion controls is to provide haptic feedback, or tactile sensations, that enhance the immersion and emotion of the game. For example, in Astro's Playroom, the PlayStation 5's DualSense controller uses adaptive triggers and haptic motors to simulate the resistance and vibration of different actions and surfaces, such as pulling a bowstring or walking on ice. Haptic feedback can create a more realistic and expressive connection between the player and the game world, as well as a sense of presence and agency. However, it is important to balance haptic feedback with other audiovisual cues, and to avoid overwhelming or distracting the player with too much or too loud feedback.

3 Environmental interaction

A third way to use touch and motion controls is to enable environmental interaction, or the manipulation of objects and elements in the game world. For example, in Tearaway, the player can use the PlayStation Vita's touch screen and rear touch pad to poke holes, draw shapes, and create objects in the game's paper-like environment, or in Half-Life: Alyx, the player can use the VR controllers to grab, throw, and manipulate various items and weapons in the game's physics-based environment. Environmental interaction can create a sense of exploration and creativity, as well as a dynamic and emergent gameplay. However, it is important to design environmental interaction that is meaningful, rewarding, and fun, and to avoid frustrating or boring the player with too little or too much interaction.

4 Player expression

A fourth way to use touch and motion controls is to facilitate player expression, or the customization and personalization of the game's characters, items, and settings. For example, in Animal Crossing: New Horizons, the player can use the touch screen or motion controls to design clothes, furniture, and patterns, or in Just Dance, the player can use the motion controls to perform dance moves and record videos. Player expression can create a sense of identity and ownership, as well as a social and emotional engagement. However, it is important to design player expression that is accessible, diverse, and flexible, and to avoid limiting or imposing the player's choices and preferences.

5 Narrative integration

A fifth way to use touch and motion controls is to integrate them into the narrative, or the story and theme of the game. For example, in Heavy Rain, the player can use the touch screen or motion controls to perform actions that reflect the character's emotions and motivations, such as shaking hands, brushing teeth, or shooting a gun, or in Florence, the player can use the touch screen to interact with the character's memories, conversations, and relationships, such as flipping pages, filling blanks, or sliding pieces. Narrative integration can create a sense of immersion and empathy, as well as a moral and emotional impact. However, it is important to design narrative integration that is coherent, relevant, and impactful, and to avoid breaking or contradicting the player's immersion and agency.

6 User testing

A final way to use touch and motion controls is to test them with real users, or the target audience and potential players of the game. User testing can help you evaluate the usability, accessibility, and enjoyability of your touch and motion controls, as well as identify and fix any issues or problems that may arise. User testing can also help you gather feedback, suggestions, and insights from your users, as well as measure their satisfaction and engagement. However, it is important to conduct user testing early and often, and to use appropriate methods, tools, and metrics, and to avoid bias or assumptions about your users' needs and preferences.

7 Here’s what else to consider

This is a space to share examples, stories, or insights that don’t fit into any of the previous sections. What else would you like to add?