AI, Computer Vision and Machine Learning for Simulation & Learning
Computer Vision, Artificial Intelligence and Machine Learning have made some startling advances. I believe there is a lot of scope for Simulation and Learning content developers to explore how these edge technologies could impact the training and learning landscape of tomorrow.
So here are 3 exciting new edge technologies that show real potential for use in learning technology development:
3. Eye Tracking as a control interface
The promise of eye-tracking, as shown in the video above, in the field of skill-building, is mainly in the building of Situation Awareness skills. One of the key ways that experts (at any task) differ from novices is in their perception of the situation. Studies have shown, that experts perceive situations differently from novices, even when they are given the same information. When designing games for learning, the ability to follow the gaze of the learners, can give instructors a great insight into their level of competence, instinctive response and thought process.
2. Artificial Intelligence that understands Body Language
With devices like Microsoft’s (now discontinued) Kinect or Intel’s RealSense we could already design games that could understand and interpret whole body gestures. This allowed for some very fun and physical game designs that were revolutionary for their time. The technology that is demonstrated in the above video takes this up several notches. Think about virtual environments and objects that could not only respond to fine motor control (like with Google’s project Soli), emotions and body language but also understand them and be altered by them. This would lend a fidelity to simulation-based and virtual learning that is currently not possible without spending millions on specialised hardware.
3. Tracking people in motion
This last technology has been designed for and is being used for controlling autonomous drones. No plans have been announced for its underlying processes to be released for other developments. However, we think that the potential it demonstrates for training and learning is truly extraordinary. Think of augmented reality and mixed reality learning that can take place, while the learner navigates real world environments. There is tremendous potential for using such technologies for training of a wide range of skills in an equally wide range of sectors such as military, construction, civil defence, mining, agriculture and many many more.
What technologies excite you the most? How do you think the above technologies could be used? Leave us your opinions and suggestions in the comments below.
About the Author:
Siddharth is the Creative Director for Playware Studios a Singapore Serious Games Developer. He develops games for Military, Healthcare, Airlines, Corporate and Government training and Mainstream education. He has taught game design in various college programs at NTU, SIM, NUS and IAL in Singapore and is the author and proponent of the Case Method 2.0 GBL pedagogy.
This article was originally published on playwarestudios.com