How do you sketch user interfaces and interactions for emerging technologies like AR or VR?

1 Scope and context

Before you start sketching, you need to define the scope and context of your AR or VR project. What is the problem you are trying to solve? Who are your users and what are their needs and goals? What are the constraints and opportunities of the technology and the environment? These questions will help you to frame your design challenge and to sketch with a clear purpose and direction.

2 Sketching tools and materials

You don't need any fancy tools or materials to sketch user interfaces and interactions for AR and VR. You can use any paper, pen, pencil, or marker that you are comfortable with. However, you may want to consider some factors that can affect your sketching process and outcome, such as the size, shape, and orientation of the paper, the level of detail and fidelity of the sketches, and the use of colors, symbols, and labels to convey information and meaning.

3 Sketching user interfaces

Sketching user interfaces for AR and VR is similar to sketching for any other medium, but with some differences and challenges. You need to consider the spatial and temporal aspects of the interface, such as how it is positioned, oriented, and scaled in relation to the user and the environment, and how it changes and responds over time. You also need to consider the modalities and affordances of the interface, such as how the user can see, hear, touch, and manipulate it, and what feedback and cues it provides.

4 Sketching user interactions

Sketching user interactions for AR and VR is more complex and dynamic than sketching for other mediums, because you need to capture the user's actions, gestures, and movements, as well as the interface's reactions, transitions, and animations. You can use different techniques and methods to sketch user interactions, such as storyboards, scenarios, flow diagrams, wireframes, and prototypes. You can also use annotations, arrows, and symbols to indicate the direction, sequence, and logic of the interactions.

5 Sketching details and annotations

Sketching details and annotations for AR and VR can help you to refine and communicate your design ideas and decisions, as well as to document and test your assumptions and hypotheses. You can sketch details and annotations for different aspects of your design, such as the layout, structure, and hierarchy of the interface, the style, color, and typography of the elements, the functionality, behavior, and feedback of the interactions, and the user's goals, tasks, and emotions.

6 Sketching tips and best practices

Sketching user interfaces and interactions for AR and VR can be both fun and challenging. To help you sketch better and faster, it is important to sketch often and early. This will help you generate and explore ideas, iterate and improve your design, and get feedback and validation from others. Additionally, sketching with a user-centered mindset can help you empathize with your users, understand their needs and goals, and design for their context and environment. Furthermore, sketching with a collaborative spirit can help you communicate and collaborate with your team, stakeholders, and users, to share your vision and get different perspectives and inputs. Finally, sketching with a playful attitude can help you experiment and innovate, try new things, learn from your mistakes, and enjoy the process.

7 Here’s what else to consider

This is a space to share examples, stories, or insights that don’t fit into any of the previous sections. What else would you like to add?