You really don’t recognise him? The eye-tracker as a forensic tool for concealed knowledge detection

• Authors: Weronika Celniak , Dominika Słapczyńska , Gowthami Krishnan , Piotr Augustyniak

Abstracts

EN

The Concealed Information Test (CIT), a well-established tool in forensic investigations, has thus far been utilised to measure autonomic nervous system (ANS) changes associated with concealed information. While previous studies have explored the integration of eye-tracking technology in face recognition, the specific application of CIT within a mock crime scenario remains relatively uncharted territory. In this study, we aim to broaden the scope of eye-tracking applications using a mock crime scenario, as well as a machine learning classification method to detect hidden crime-related information. Of the four faces displayed as stimuli, the ‘guilty’ group volunteers in the test were able to recognise one as they had previously seen it in the context of the mock crime, whereas the ‘innocent’ group volunteers were all unfamiliar with all four faces. We chose heatmaps depicting the fixation count and fixation durations as the input data for classification. The results obtained with features extracted using ResNet50 and the Support Vector Machine algorithm yielded promising outcomes, achieving an accuracy level of 84.62% for heat maps created using fixation count. These findings suggest the potential development of an innovative tool capable of objectively determining whether an examined person recognises individuals presented in photos, even when denying familiarity with those individuals. The integration of eye-tracking technology and machine learning holds promise for enhancing the accuracy and efficacy of concealed information detection in forensic contexts.

Keywords

EN

Concealed Information Test; eye-tracker

• Publisher: Uniwersytet Andrzeja Frycza Modrzewskiego w Krakowie
• Journal: European Polygraph
• Year: 2025
• Volume: 19
• Issue: 1 (61)
• Pages: 59-73

Dates

published

2025

Contributors

author

Weronika Celniak

• AGH University of Kraków

• https://orcid.org/0000000217147776

author

Dominika Słapczyńska

• Polish Forensic Sciences Association

• https://orcid.org/0000000161975029

author

Gowthami Krishnan

• AGH University of Kraków

• https://orcid.org/0000000254440875

author

Piotr Augustyniak

• AGH University of Kraków

• https://orcid.org/0000000159863247

References

• Brockmole J.R. & Irwin D.E. (2005), Eye movements and the integration of visual memory and visual perceprion, Preception&psychophysics
• Delmas H., Ciocan C., Novopashyna M. & Paeye C. (2023), Resistance of a short-term memory concealed information test with famous faces to countermeasures, Memory & Cognition, Springer Science and Business Media LLC.
• Guo K., Mahmoodi S., Robertson R.G. & Young M. P. (2005), Longer fixation duration while viewing face images. Experimental Brain Research, 171(1).
• He K., Zhang X., Ren S. & Sun J. (2016), Deep Residual Learning for Image Recognition. 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).
• Honts C.R., Devitt M.K., Winbush M. & Kircher J.C. (1996), Mental and physical countermeasures reduce the accuracy of the concealed knowledge test.
• Iskra A. & Tomc H.G. (2016), Eye-tracking analysis of face observing and face recognition. Journal of Graphic Engineering and Design, 7(1).
• Kircher J.C. & Raskin D.C. (2016), Laboratory and Field Research on the Ocular-motor Deception Test. European Polygraph, 4(38)
• Klein Selle N. & Ben‐Shakhar G. (2022), A new theoretical perspective on concealed information detection. Psychophysiology, 60(3).
• Klein Selle N., Verschuere B., Ben-Shakhar G. (2018). Concealed Information Test, Detecting Concealed Information and Deception. Elsevier.
• Lancry-Dayan O.C., Nahari T., Ben-Shakhar G. & Pertzov Y. (2018), Do you know him? Gaze dynamics toward familiar faces on a Concealed Information Test. Journal of Applied Research in Memory and Cognition, 7(2).
• Ma D.S., Correll J. & Wittenbrink B. (2015), The Chicago face database: A free stimulus set of faces and norming data, Behavior Research Methods, 47.
• Millen, A.E. & Hancock, P.J. (2019), Eye see through you! Eye tracking unmasks concealed face recognition despite countermeasures. Cognitive Research: Principles and Implications, 4.
• Nahari T., Lancry-Dayan O., Ben-Shakhar G. & Pertzov Y. (2019), Detecting concealed familiarity using eye movements: the role of task demands, Cognitive Research: Principles and Implications, 4(1).
• Otsuka T., Mizutani M. & Yamada F. (2019), Selective attention, not cognitive load, elicited fewer eyeblinks in a concealed information test, Biological Psychology, 142.
• Partala, T., & Surakka, V. (2003), Pupil size variation as an indication of affective processing. International Journal of Human-Computer Studies, 59(1–2), 185–198.
• Ryan J.D., Hannula D.E. & Cohen N.J. (2007), The obligatory effects of memory on eye movements. Memory, 15(5).
• Schwedes C. & Wentura D. (2011), The revealing glance: Eye gaze behavior to concealed information, Memory & Cognition, 40(4).
• Speth J., Vance N., Czajka A., Bowyer, K.W., Wright D. & Flynn P. (2021), Deception Detection and Remote Physiological Monitoring: A Dataset and Baseline Experimental Results, 2021 IEEE International Joint Conference on Biometrics (IJCB).
• Welchman A.E. & Harris J.M. (2003), Task demands and binocular eye movements, Journal of Vision.
• Yarbus A.L. (1967), Eye Movements During Perception of Complex Objects. Eye Movements and Vision, Springer.

Identifiers

DOI

10.2478/ep-2025-0003

Biblioteka Nauki

62644789