Gaze Entropy: How The Eyes Become A Window Into The Mind

Visual information is transmitted to the brain through two types of light-sensing cells (rods and cones) located across the retina. The fovea, a small central point in the retina, is densely populated by cone cells which enable the perception of fine details. Because of this configuration, our eyes move constantly to shift our gaze and fixate on or align a region of interest to the fovea so we can perceive it in greater detail.

Such shifting of gaze can occur as a result of internal (conscious decision) or external (unconscious reaction to the environment) influence. For instance, if we are walking through a crowded street looking for a friend who told us they were wearing a bright red hat, we move our eyes consciously looking for a red hat. By contrast, if we are walking through a crowded street where everyone is mostly dressed in dark colors and we are not looking for anyone in particular, someone in a bright red jacket appearing from a side street will stand out, thus automatically catching our attention and causing us to look in their direction.

Within the cognitive and behavioral sciences literature, these influences of gaze shift are referred to as top-down and bottom-up inputs. The top-down refers to how our knowledge, experience, and intention influences our action (e.g. movement of our eyes), whereas the bottom-up refers to how the salience or unexpectedness of objects in the environment can capture our attention and influence our action.

Computationally speaking, the way eye movements are generated is not necessarily a dichotomy where it is either our intention or our environment that causes us to shift our gaze (Awh et al., 2012). Instead, the brain is constantly matching sensory information (bottom-up) with existing knowledge and experience (top-down) to make predictions regarding where we should be looking next. A good example of this interaction between knowledge and the visual environment is how novice and experienced drivers differ in the way they scan the traffic scene and mirrors. Experienced drivers know when to look at the mirrors and which hazards to pay attention to, whereas novice drivers tend to look more centrally. In this case, prior knowledge contributes to the generation of efficient sequences of eye movements for the task of driving, whereas the lack of such knowledge means a less efficient series of eye movements.

Because the predictive process in gaze control involves a wide range of networks in the brain that are responsible for attention, perception and motor control, examining the complexity in eye movement patterns can provide insight into the mental state of an individual. One method of examining eye movement complexity is gaze entropy which provides a quantitative estimation of where we look (SGE: stationary gaze entropy) and the pattern with which our eyes move between different regions of what we are looking at (GTE: gaze transition entropy).

Gaze transition entropy, in particular, indicates how much top-down input (our knowledge and understanding) is contributing towards the control of our eye movements. As a result, if mental state is affected by intoxication, anxiety, stress, fatigue, or illness, the pattern of eye movements (i.e. GTE) and where we look (i.e. stationary gaze entropy) become noticeably altered. In our review of these methods, we propose that insufficient contribution of top-down input to gaze control would result in lower GTE, whereas too much of it may cause interference and increase GTE beyond the optimal range for a given task and visual environment (Shiferaw et al., 2019).

Accurate and efficient scanning of our surrounding through eye movements is critical as it guides our action in everyday tasks such as driving and other specialized operational settings. Given this importance of eye movements, such objective measures of gaze complexity make it possible to assess the efficiency of our visual scanning behavior in applied settings (Di Stasi et al., 2016; Diaz-Piedra et al., 2019; Shiferaw et al., 2018).

With the rapid advancement of eye-tracking technologies, these measures will make it possible to monitor the internal cognitive state of individuals in operational settings and detect impairment to prevent performance degradation. Real-time detection of cognitive impairment through gaze analysis has broad applications from human-computer interaction to the development of non-invasive diagnostic tools for neurological conditions that can be implemented in naturalistic settings (Shaikh and Zee, 2017).

These findings are described in the article entitled A review of gaze entropy as a measure of visual scanning efficiency, recently published in the journal Neuroscience & Biobehavioral Reviews.

References:

  1. Awh, E., Belopolsky, A. V, Theeuwes, J., 2012. Top-down versus bottom-up attentional control : a failed theoretical dichotomy. Trends Cogn. Sci. 16, 437–443. https://linkinghub.elsevier.com/retrieve/pii/S1364661312001489
  2. Di Stasi, L.L., Diaz-Piedra, C., Rieiro, H., Sánchez Carrión, J.M., Martin Berrido, M., Olivares, G., Catena, A., Martin Berrido, M., Sánchez Carrión, J.M., Olivares, G., Rieiro, H., Diaz-Piedra, C., Di Stasi, L.L., 2016. Gaze entropy reflects surgical task load. Surg. Endosc. 30, 5034–5043. https://link.springer.com/article/10.1007%2Fs00464-016-4851-8
  3. Diaz-Piedra, C., Rieiro, H., Cherino, A., Fuentes, L.J., Catena, A., Di Stasi, L.L., 2019. The effects of flight complexity on gaze entropy: An experimental study with fighter pilots. Appl. Ergon. 77, 92–99. https://linkinghub.elsevier.com/retrieve/pii/S0003687019300274
  4. Shaikh, A.G., Zee, D.S., 2017. Eye Movement Research in the Twenty-First Century—a Window to the Brain, Mind, and More. The Cerebellum. https://link.springer.com/article/10.1007%2Fs12311-017-0910-5
  5. Shiferaw, B., Downey, L., Crewther, D., 2019. A review of gaze entropy as a measure of visual scanning efficiency. Neurosci. Biobehav. Rev. 96, 353–366. https://linkinghub.elsevier.com/retrieve/pii/S0149763418303075
  6. Shiferaw, B.A., Downey, L.A., Westlake, J., Stevens, B., Rajaratnam, S.M.W., Berlowitz, D.J., Swann, P., Howard, M.E., 2018. Stationary gaze entropy predicts lane departure events in sleep-deprived drivers. Sci. Rep. in press. https://www.nature.com/articles/s41598-018-20588-7?error=cookies_not_supported&code=0ce782bd-b0a1-494d-bdc2-1752237a67d9

About The Author

Brook Shiferaw

Brook Shiferaw is a research scientist at the Swinburne University of Technology, Centre for Human Psychopharmacology.

David Crewther

David Crewther started his career as a theoretical physicist, completing his Ph.D. at CalTech under Nobel prize-winner Murray Gell-Mann. His interest in neurophysiology started there under the influence of Prof Jack Pettigrew. David's academic career has been diverse, successively at the National Vision Research Institute in Melbourne, the School of Optometry at the University of NSW in Sydney, the School of Psychological Science at La Trobe University in Melbourne and thence to the Brain Sciences Institute and Swinburne in 2000. His academic interests include the neuroscience of normal and abnormal visual development, psychophysics of visual attention, non-linear electrophysiology and functional neuroimaging of cognitive function, as well as neural mechanisms of refractive control. His studies have implications particularly for development in children: dyslexia, amblyopia, autism, myopia, and ADHD, as well as an understanding of conscious awareness and mind/brain relations. David has published widely with over 170 publications in peer-reviewed scientific journals, mainly in the area of vision, visual development, myopia, single-cell electrophysiology, evoked potential research, dyslexia, amblyopia, learning disability, and more than 300 refereed conference abstracts. He has an extended record of funding from both the ARC and NHMRC over nearly 30 years as well as other miscellaneous funding. He has recently held ARC DPs (through Swinburne) into the physiological mechanisms of refractive control and into the basic cortical mechanisms of form, colour and motion processing, a NHMRC project grant (through Swinburne) in the cognitive neuroscience of autistic tendency and an ARC DP (through La Trobe U) into cortical mechanisms of reaching and grasping in time. David was responsible for the "CogNOSS" plan leading to the acquisition of MEG and MRI technologies at Swinburne. David currently holds an Adjunct Professorship in Psychological Science at La Trobe University, and an Adjunct Professorship at the Zhejiang Institute for Integrative Neuroscience and Technology, Zhejian University, Hangzhou, China. He has also been a Visiting Research Professor at the 3rd Military Medical University of Chongqing, China. He served as President of the Australasian Cognitive Neuroscience Society in 2015 and is currently National Co-Chair of the Asia Pacific Conference on Vision.

Luke Downey

Associate Professor Luke Downey is an NHMRC R.D. Wright Biomedical Career Development Fellow. He leads the Drugs and Driving Research Unit at Swinburne, managing a team of research assistants, Ph.D. students, and postdoctoral fellows.

Alongside his research in human psychopharmacology, Dr. Downey also examines how individual differences in emotional intelligence contribute to human behavior. This program of research initially focused on developing reliable and valid measures to assess emotional intelligence in adults and adolescents. These measures can now be used to examine the role of emotional intelligence in predicting outcomes such as scholastic achievement, bullying, stress coping strategies, and recruitment consultant revenue.

In 2015, Dr. Downey held a visiting scholar position at Harvard Medical School. He has also completed two years of postdoctoral work at Swansea University with Professor Andy Parrott.

Speak Your Mind!

READ THIS NEXT

Soil Heterotrophic Respiration And The Earth System Model

The scientific community relies on the projections of Earth system models (ESMs) to evaluate the response of the earth to climate change, including a positive feedback loop between soil carbon (C) and climate, where accelerated decomposition of soil organic matter (SOM) under warming further exacerbate climate change. However, soil heterotrophic respiration, Rh (or, microbial processing […]

Towing Icebergs To Provide Drinking Water To Regions Suffering From Drought

Some of the largest cities in the world are struggling with drought and a shortage of potable water. For instance, Cape Town South Africa has been facing an ongoing water crisis as a result of a years-long drought that threatened to push the city towards a “Day Zero” where the city would be forced to […]

Altered Stress Sensitivity In Individuals With Borderline Personality Disorder

You know how it feels when you’re stressed, right? And you can certainly imagine that stress is not just a subjective experience but also depends heavily on bodily processes and hormones. However, it’s quite important to mention that stress affects individuals differently – and some people presumably more than others. Accordingly, research suggested that individuals […]

The Impact Of Insulin Resistance On The Course Of Bipolar Disorder

Type 2 diabetes is two to three times more prevalent among people with bipolar disorder than among the general population, with over half of all people with bipolar disorder having either insulin resistance (also known as “pre-diabetes”) or type 2 diabetes. The development of type 2 diabetes typically follows a progression from normal glucose metabolism […]

Not All Watersheds Are Created Equal: Natural Boundaries Also Predict Patterns Of Inequality

Patterns of inequality in exposure to environmental pollutants exist around the world today, even right here in our backyards. Such patterns of injustice, observed over the past few decades, are often researched and discussed in the body of scholarship known as Environmental Justice. Researchers who work in this field typically study patterns of exposure by […]

Minima Of Radiated Acoustic Power Are Different From Structural Vibration

Structural vibration mechanism and control have been studied deeply over the last several decades. As the dynamic characteristics usually can be expressed in the form of natural frequencies (poles), antiresonances (zeros) or minimum response frequencies, it is an effective way to change the peaks and valleys of vibrating response by assigning desirable poles to avoid […]

Can Tardigrades Theoretically Survive On Exoplanets?

Tardigrades are water microbes (or water bears) that can survive in extreme conditions and can withstand very high energy cosmic radiations when exposed to a vacuum in space. The major motivation for studying tardigrades on exoplanets is that tardigrade proteins could provide human DNA with protection from harmful cosmic radiation, which will be helpful in […]