Using Emotion AI to Assess Cognitive Function

Never underestimate the power of observation, especially when we can utilize and involve computers in observational workflows such as detecting emotional responses to stimuli. Gartner VP Annette Zimmerman predicts that “by 2022, your personal device will know more about your emotional state than your own family”. https://www.gartner.com/smarterwithgartner/emotion-ai-will-personalize-interactions/. We are just beginning to realize the value of emotion detection technology. Our cognitive functions stand to gain from the continued use of sensors and systems designed to detect emotional responses to memories. Such is the Telememory focus.

At Telememory we have been researching methods and procedures to detect implicit bias using computer vision techniques. Implicit bias is one of the most highly sought-after human characteristics to study, analyze and leverage for the purposes of persuasion and predicting outcomes of human behavior. Implicit bias studies are used in assessing jury trial outcomes, lie detection, race and gender attitudes, brand preference, political affiliation, product or service propensity and subjectivity. In fact, Harvard has one of the longest running studies on implicit bias, dubbed Project Implicit (implicit.harvard.edu). Troves of information exist to match characteristics of implicit bias with demographic attributes. Both implicit and explicit biases inform how we respond to stimuli. Bias governs our attitudes, how we associate with things, value systems and emotions. Using computers to detect bias and emotions is an emerging art.    

Memory care is ripe for innovation in how cognitive function is diagnosed, monitored, and treated. Very few non-pharmacological interventions exist to help patients stay connected to their lives, interests, passions, stories and experiences. We invest so much time and money drawing consumers into fictional or idyllic stories, all with the goal of selling them something. Telememory is turning these machinations into something beneficial for our elders. 

We have a lofty mission. To help patients stay connected to their legacies, longer. Our goal is to set a precedent for non-pharmacological interventions treating mood disorder, anxiety and behavior management within the growing Alzheimer’s and dementia population. Foundational to our solution is the ability to sense and measure psycho-physiological responses to stimuli. Some very exciting research has been conducted recently to help understand how the brain (psycho) and body (physio) logic is working while driving a motor vehicle. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6434408/. Using a similar sensor-based approach, we strive to learn as much about a memory care patient when they are presented with deeply familiar and personalized digital experiences. Our goal is to stimulate memory recall, increase attention and overall engagement. Connections to memories and life stories are fundamental to mental health. Connecting to the reactions of those memories is even more precious. We are optimistic that this process will help diagnose, treat and perhaps even slow cognitive decline.