Interactive Data Visualization: Take Advantage of the 3rd Dimension with VR and AR

I wish to keep this post relatively short. Our use of data in the world is increasing and so is the amount, which calls for new ways to handle it – And I believe manipulable, interactive 3D data visualization, in a 3D environment, is one of the most promising solutions available.

Big Data was one of 2016’s big buzzwords and continues to be so in 2017, as the production and accumulation of data is only accelerating. Not only is the vastness of data increasing, but so is the complexity. A variety of graphs and charts have long been used to ease the load of information and help people identify patterns, while info-graphics have displayed this information in interesting and salient ways to underpin arguments and highlight trends. However, as complexity of data continues increase, I believe the efficiency and power of 2-dimensional data visualization will decrease and the need for solid, interactive multidimensional data visualization in 3D will be called for.

But let us start with the idea of visualization and why it is useful for understanding data.

Basically, numbers are at the core of data, and when we collect data we collect lists of numbers that have the potential of revealing patterns. The problem is that without proper context, numbers are an abstract entity that can be hard for most of us to understand in larger quantities, not least recognize patterns within. This is where visualization enters the picture – It helps us contextualize those numbers, most often in graphs and charts, which leads to easier pattern recognition.

So what are the advantages of taking visualization into a 3D environment and making them interactive?

The way I see it, there are two major advantages with interactive 3D data visualization:

1. Interaction with objects can aid our retention of related knowledge.  
2. It allows for adaptive exploration and pattern recognition of a larger amount of data dimensions.

The Point with Interactivity

My first point would indicate that interaction leads to increased comprehension – And evidence suggests that this is the case. Many will probably be familiar with Dale’s Cone of Learning as seen below. Often you will see this model with percentages attached, however this is a common misconception, as Dale never added these himself, he merely created the model as an illustration of his theory, i.e. the more visual and active the learning the more knowledge we retain.

Research, for instance within cognitive psychology, indicates that Dale’s theory is in part true, and learning through participation and the manipulation of objects manifests itself better in our long-term memory. In short:

Interactivity aids comprehension and we should therefore take advantage of this when working with data.

Make Data Interactive

The second point concerns adaptive exploration – Utilizing space. Making data 3-dimensional is a start, however it is still limited by the monitor that displays it – being inherently flat and 2D. Place your 3D data into virtual reality (VR) and the potential increases. In VR, you will be able to engage with data in new and interesting ways, adapt it by swapping out datasets dynamically, and take full advantage of the third dimension.  

Everyday life is full of distractions and disturbances, and this is not least the case at work. Virtual Reality can supply people with a space dedicated to productive workflow – The entire space is your canvass to customize and manipulate in whichever way you see fit.

By increasing the representations, nodes, and avenues in which to handle your data, you increase your possibilities to analyse it and extract interesting insights: It lets you understand your data better.

Companies around the world have only just begun exploring the huge potential of data visualization in the 3D environment, not least making it interactive, but there is a lot of prospect in this type of development – Not just in VR, but also with augmented reality (or mixed reality). Microsoft’s HoloLens shows great potential for a variety of solutions that integrate 3D graphical holograms with the real world. One example of a solution model is shown in the following video by Citi, where they extend the desktop workspace to increase workflow.

An important thing this video highlights is the use of real-time data visualization. Augmented reality, such as we see it with the HoloLens, can aid daily operations by displaying real-time data about any chosen part of machinery or mechanism that is equipped with a sensor––by adding an overlay of information. Moreover, real-time data will also come to fruition in virtual reality with the creation of digital twins, i.e. digital versions of production facilities that also gather and display all the data in a customized 3D solution.

I suspect specific solutions will depend on the types of data and its complexity: Some data may be best suited for augmented reality workflow, integrating real and virtual elements, while other datasets may hinge on virtual reality to tease out revealing insights.

As way of conclusion let me suggest just a few of the ways in which such interactive data visualization can add value to businesses, based on personal experience in the industry:

• Shorten the decision-making process as consequence of better understanding of data.
• Facilitate meetings with people across the world in a shared virtual space.
• Present your data in Virtual Reality to stakeholders – Let them visualize, interact, and understand the data as efficiently as you.
• Monitor machines, workflows, data, etc., with the aid of Augmented Reality overlay that displays the information offered through e.g. sensors.
• Consequences of large amounts of data may seem abstract and arbitrary – Increase your understanding of the data through powerful context driven 3D visualization, and retain what you learn by interacting with it.

Feel free to comment, and you can also contact me here.

Sources:

Carly Kontra, Daniel J. Lyons, Susan M. Fischer, and Sian L. Beilock. "Physical Experience Enhances Science Learning". Psychological Science. Vol 26, Issue 6, pp. 737 - 749.

Robb Lindgren, Mina Johnson-Glenberg. "Emboldened by Embodiment". Educational Researcher. Vol 42, Issue 8, pp. 445 - 452.