PL EN


Preferencje help
Widoczny [Schowaj] Abstrakt
Liczba wyników
Tytuł artykułu

Modeling the 2D space of emotions based on the poincare plot of heart rate variability signal

Identyfikatory
Warianty tytułu
Języki publikacji
EN
Abstrakty
EN
Emotions mean accepting, understanding, and recognizing something with one's senses. The physiological signals generated from the internal organs of the body can objectively and realistically reflect changes in real-time human emotions and monitor the state of the body. In this study, the two-dimensional space-based emotion model was introduced on the basis of Poincare's two-dimensional plot of the signal of heart rate variability. Four main colors of psychology, blue, red, green, and yellow were used as a stimulant of emotion, and the ECG signals from 70 female students were recorded. Using extracted features of Poincare plot and heart rate asymmetry, two tree based models estimated the levels of arousal and valence with 0.05 mean square errors, determined an appropriate estimation of these two parameters of emotion. In the next stage of the study, four different emotions mean pleasure, anger, joy, and sadness, were classified using IF-THEN rules with the accuracy of 95.71%. The results show the color red is associated with more excitement and anger, while green has small anxiety. So, this system provides a measure for numerical comparison of mental states and makes it possible to model emotions for interacting with the computer and control mental states independently of the pharmaceutical methods.
Twórcy
autor
  • Department of Biomedical Engineering, Science and Research Branch, Islamic Azad University, Tehran, Iran
  • Department of Biomedical Engineering, Science and Research Branch, Islamic Azad University, Tehran, Iran
autor
  • Department of Biomedical Engineering, Science and Research Branch, Islamic Azad University, Tehran, Iran
Bibliografia
  • [1] Bernardi L, et al. Effects of controlled breathing, mental activity and mental stress with or without verbalization on heart rate variability. J Am Coll Cardiol 2000;35(6):1462–9. Elsevier Science Inc.
  • [2] Ekman P, Levenson R, Friesen W. Autonomic nervous system activity distinguishes among emotions. Science 1983;221:1208–10.
  • [3] Ue H, Masuda I, Yoshitake Y, Inazumi Y, Moritani T. Assessment of cardiac autonomic nervous activities by means of ECG RR interval power spectral analysis and cardiac depolarization-repolarization process. Ann Nininvasive Electrocardiol 2000;5(4):336–45.
  • [4] Moharreri S, Jafarnia Dabanloo N, Parvaneh S, Nasrabadi AM. How to Interpret Psychology from Heart Rate Variability? Middle East Conference on Biomedical Engineering (MECBME) vol 1 2011.
  • [5] Stemmler G, Aue T, Wacker J. Anger and fear: separable effects of emotion and motivational direction on somatovisceral responses. Int J Psychophysiol 2007;66:141–53.
  • [6] Etzel JA, Johnson EL, Dickerson J, Tranel D, Adolphs R. Cardiovascular and respiratory responses during musical mood induction. Int J Psychophysiol 2006;61:57–69.
  • [7] Suk H-J, Irtel H. Emotional response to color across media. Color Res Appl 2008;35:64–77.
  • [8] Haag A, Goronzy S, Schaich P, Williams J. Emotion recognition using bio-sensors: first steps towards an automatic system. Affect Dial Syst 2004;36–48.
  • [9] Mandryk RL, Inkpen KM, Calvert TW. Using psychophysiological techniques to measure user experience with entertainment technologies. Behav Inf Technol 2006;25(2):141–58.
  • [10] Agrafioti F, Hatzinakos D, Anderson AK. ECG pattern analysis for emotion detection. IEEE Trans Affect Comput 2012;3(1):102–15.
  • [11] Suja S, Tripathi S. Real-time emotion recognition from facial images using raspberry Pi II. 3rd International Conference on Signal Processing and Integrated Networks (SPIN), vol. 3. 2016;666–70.
  • [12] Chanthaphan N, Uchimura K, Satonaka T, Makioka T. Facial emotion recognition based on facial motion stream generated by kinect. 11th International Conference on Signal-Image Technology Internet-Based Systems (SITIS) 2015;11:117–24.
  • [13] Koolagudi SG, Rao KS. Emotion recognition from speech: a review. Int J Speech Technol 2012;15(2):99–117.
  • [14] Chenchah F, Lachiri Z. Acoustic emotion recognition using linear and nonlinear cepstral coefficients. Int J Adv Comput Sci Appl 2015;6(11).
  • [15] Karg M, Samadani AA, Gorbet R, Kuhnlenz K, Hoey J, Kulic D. Body movements for affective expression: a survey of automatic recognition and generation. IEEE Trans Affect Comput 2013;4:341–59.
  • [16] Kleinsmith A, Bianchi Berthouze N. Affective body expression perception and recognition: a survey. IEEE Trans Affect Comput 2013;4:15–33.
  • [17] Picard R, Vyzas E, Healey J. Toward machine emotional intelligence: analysis of affective physiological state. IEEE Trans Pattern Anal Mach Intell 2001;23(10):1175–91.
  • [18] Naji M, Firoozabadi M, Azadfallah P. Classification of musicinduced emotions based on information fusion of forehead biosignals and electrocardiogram. Cogn Comput 2014;6:241–52.
  • [19] Zheng WL, Santana R, Lu BL. Comparison of classification methods for eeg-based emotion recognition. World Congress on Medical Physics and Biomedical Engineering 2015;1184–7.
  • [20] Jenke R, Peer A, Buss M. Feature extraction and selection for emotion recognition from EEG. IEEE Trans Affect Comput 2014;5:327–39.
  • [21] Soleymani M, Asghari-Esfeden S, Fu Y, Pantic M. Analysis of EEG signals and facial expressions for continuous emotion detection. IEEE Trans Affect Comput 2016;7:17–28.
  • [22] Wilson GM, Sasse MA. Do users always know what's good for them? Utilizing physiological responses to assess media quality. The Proceedings of HCI 2000: People and Computers XIV—Usability or Else! (HCI 2000); 2000;327–39.
  • [23] Ward RD, Marsden PH. Physiological responses to different web page designs. Int J Hum Comput Stud 2003;59:199–212.
  • [24] Kim J, Andre E. Emotion recognition based on physiological changes in music listening. IEEE Trans Pattern Anal Mach Intell 2008;30(12):2067–83.
  • [25] Kim KH, Bang SW, Kim SR. Emotion recognition system using short-term monitoring of physiological signals. Med Biol Eng Comput 2004;42:419–27.
  • [26] Chen D, Vertegaal R. Using mental load for managing interruptions in physiologically attentive user interfaces. Conference on Human Factors in Computing Systems (CHI 2004). 2004;1513–6.
  • [27] Mandryk RL, Atkins M. A fuzzy physiological approach for continuously modeling emotion during interaction with play technologies. Int J Hum Comput Stud 2007;65(4):329–47.
  • [28] Nasoz F, Alvarez K, Lisetti C, Finkelstein N. Emotion recognition from physiological signals using wireless sensors for presence technologies. Int J Cogn Technol Work 2004;6(1):4–14.
  • [29] Moharreri S, Rezaei S, Jafarnia Dabanloo N, Parvaneh S. Study of induced emotion by color stimuli: power spectrum analysis of heart rate variability. Comput Cardiol (CinC 2014) 2014;41:977–80.
  • [30] Nasoz F, Lisetti C. MAUI avatars: mirroring the user's sensed emotions via expressive multi-ethnic facial avatars. J Vis Lang Comput 2006;17:430–44.
  • [31] Goshvarpour A, Abbasi A, Goshvarpour A. Indices from lagged poincare plots of heart rate variability: an efficient nonlinear tool for emotion discrimination. Aust Phys Sci Eng Med 2017;40(2):277–87.
  • [32] Rezaei S, Moharreri S, Ghiasi S, Parvaneh S. Emotion recognition using parabolic phase space mapping for heart rate variability analysis. Presented at the Computing in Cardiology (CinC); 2017.
  • [33] Scheirer J, Fernandez R, Klein J, Picard R. Frustrating the user on purpose: a step toward building an affective computer. Interact Comput 2002;14(2):93–118.
  • [34] Jones C, Troen T. Biometric valence and arousal recognition. Comput–Hum Interact 2007.
  • [35] Partala T, Surakka V. The effects of affective interventions in human–computer interaction. Interact Comput 2004;16:295–309.
  • [36] Wiem MBH, Lachiri Z. Emotion classification in arousal valence model using MAHNOB-HCI database. Int J Adv Comput Sci Appl 2017;8(3):318–23.
  • [37] Hwang B, Ryu JW, Park C, Zhang BT. A novel method to monitor human stress states using ultra-short-term ECG spectral feature. 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) Seogwipo vol 39 2017;2381–4.
  • [38] Choi K-H, Kim J, Kwon Os, Kim MJ, Ryu YH, Park J-E. Is heart rate variability (HRV) an adequate tool for evaluating human emotions? – A focus on the use of the international affective picture system (IAPS) Psychiatry Res 2017;251:192–6.
  • [39] Lane RD, Mcrae K, Reiman EM, Chen KW, Ahern GL, Thayer JF. Neural correlates of heart rate variability during emotion. Neuroimage 2009;44(1):213–22.
  • [40] Valenza G, Lanata A, Scilingo EP. The role of nonlinear dynamics in affective valence and arousal recognition. IEEE Trans Affect Comput 2012;3(2):237–49.
  • [41] Elliot AJ, Maier MA. Color and psychological functioning. Curr Direct Psychol Sci 2007;16(5):250–4.
  • [42] Hoss R. The significance of color in dreams. Dream Time 1999;16(4):10–6.
  • [43] Goldstein K. Some experimental observations on the influence of color on the function of the organism. Occup Ther Rehabil 1942.
  • [44] Jacobs KW, Hustmyer FE. Effects of four primary colors on GSR, heart rate and respiration rate. Percept Motor Skills 1974;38:763–6.
  • [45] Jacobs KW, James F. Effects of four psychological primary colors on anxiety state. Percept Motor Skills 1975;41:207–10.
  • [46] Moharreri S, Jafarnia Dabanloo N, Parvaneh S, Nasrabadi AM. The relation between colors, emotions and heart response using triangle phase space mapping (TPSM). Presented at the Computing in Cardiology (CinC2011); 2011.
  • [47] Moharreri S, Jafarnia Dabanloo N, Parvaneh S, Nasrabadi AM, Attarodi G. Personality psychology using heart responses to color stimulus. Presented at the Computing in Cardiology (CinC2011); 2011.
  • [48] Nardelli M, Valenza G, Greco A, Lanata A, Pasquale Scilingo E. Recognizing emotions induced by affective sounds through heart rate variability. IEEE Trans Affect Comput 2015;6(4):385–94.
  • [49] Soleymani M, Koelstra S, Patras I, Pun T. Continuous emotion detection in response to music videos. Presented at the IEEE International Conference of Automatic Face Gesture Recognition (FG); 2011.
  • [50] Soleymani M, Asghari-Esfeden S, Pantic M, Fu Y. Continuous emotion detection using EEG signals and facial expressions. Presented at the IEEE International Conference on Multimedia and Expo (ICME) 2014.
  • [51] Nicolaou M, Gunes H, Pantic M. Continuous prediction of spontaneous affect from multiple cues and modalities in valence-arousal space. IEEE Trans Affect Comput 2011;2 (2):92–105.
  • [52] Wagner J, Kim J, Andre E. From physiological signals to emotions: implementing and comparing selected methods for feature extraction and classification. IEEE International Conference on Multimedia and Expo 2005;940–3.
  • [53] Wollmer M, Schuller B, Eyban F, Rigoll G. Combining long short-term memory and dynamic Bayesian networks for incremental emotion-sensitive artificial listening. IEEE J Select Top Signal Process 2010;4(5):867–81.
  • [54] Caridakis G, Karpouzis K, Kollias S. User and context adaptive neural networks for emotion recognition. Neurocomputing 2008;71(13–15):2553–62.
  • [55] Kanluan I, Grimm M, Kroschel K. Audio-visual emotion recognition using an emotion recognition space concept. The 16th European Signal Processing Conference. 2008;16.
  • [56] Forbes-Riley K, Litman D. Predicting emotion in spoken dialogue from multiple knowledge sources. Human Language Technology Conference of North of America. 2004;201–8.
  • [57] Karpouzis K, et al. Modeling naturalistic affective states via facial, vocal and bodily expressions recognition. Lect Notes Artif Intell 2007;4451:92–116.
  • [58] Brennan M, Palaniswami M, Kamen P. Do existing measures of poincare plot geometry reflect nonlinear features of heart rate variability? IEEE Trans Biomed Eng 2001;48 (11):1342–7.
  • [59] Karmakar CK, Khandoker AH, Gubbi J, Palaniswami M. Complex correlation measure: a novel descriptor for poincare plot. Biomed Eng OnLine 2009;8:1–12.
  • [60] Moharreri S, Parvaneh S, Jafarnia Dabanloo N, Nasrabadi AM. Utilizing occurrence sequence of heart rate's phase space points in order to discriminate heart arrhythmia. 17th Iranian Conference of Biomedical Engineering (ICBME2010) Isfahan Iran vol 17 2010.
  • [61] Rukavina S, Gruss S, Hoffmann H, Tan J-W, Walter S, Traue HC. Affective computing and the impact of gender and age. PloS One 2016;11(3).
  • [62] Sakaki M, Mather M. How reward and emotional stimuli induce different reactions across the menstrual cycle. Soc Personal Psychol Comp 2012;6(1):1–17.
  • [63] Burriss L, Powell DA, White J. Psychophysiological and subjective indices of emotion as a function of age and gender. Cogn Emot 2007;21(1):182–210.
  • [64] Porta A, et al. Temporal asymmetries of short-term heart period variability are linked to autonomic regulation. Am J Physiol Regul Integr Comp Physiol 2008;295(2):R550–7.
  • [65] Piskorski J, Guzik P. Geometry of the Poincaré plot of RR intervals and its asymmetry in healthy adults. Physiol Meas 2007;28(3):287.
  • [66] Karmakar CK, Khandoker A, Palaniswami M. Analysis of slope based heart rate asymmetry using Poincare plots. Presented at the Computing in Cardiology (CinC); 2012.
  • [67] Piskorski J, Guzik P. Compensatory properties of heart rate asymmetry. J Electrocardiol 2012;45:220–4.
  • [68] Turan C, Lam KM, He X. Facial expression recognition with emotion-based feature fusion. Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA). 2015;1–6.
  • [69] Backs RW, da Silva SP, Han K. A comparison of younger and older adults' self-assessment manikin ratings of affective pictures. Exp Aging Res 2005;31:421–40.
  • [70] Bradley M, Lang P. Measuring emotion: the self-assessment manikin and the semantic differential. J Behav Therapy Exp Psychiatry 1994;25(1):49–59.
  • [71] Pan J, Tompkins WJ. A real-time QRS detection algorithm. IEEE Trans Biomed Eng 1985;3:230–6.
  • [72] Tulppo MP, Makikallio TH, Takala TES, Seppanen T, Huikuri HV. Quantitative beat-to-beat analysis of heart rate dynamics during exercise. Am J Physiol 1996;71:244–52.
  • [73] Parvaneh S, Toosizadeh N, Moharreri S. Impact of mental stress on heart rate asymmetry. Presented at the Computing in Cardiology (CinC); 2015.
  • [74] Kim J. Robust speech recognition and understanding. ITech Education and Publishing; 2007. p. 265–80.
  • [75] Nicolaou M, Gunes H, Pantic M. Audio-visual classification and fusion of spontaneous affective data in likelihood space. IEEE International Conference on Pattern Recognition 2010;3695–9.
  • [76] Huang Q, Yuan C, Hanmin S. An investigation on the physiological and psychological effects of infrasound on persons. J Low Freq Noise Vib Active Control 2004;23 (1):71–6.
  • [77] Anttonen J, Surakka V. Emotions and heart rate while sitting on a chair. Presented at the SIGCHI Conference of Human Factors in Computing Systems 2005.
  • [78] Jafarnia Dabanloo N, Attarodi G, Moharreri S, Parvaneh S, Nasrabadi AM. Emotion recognition based on utilizing occurrence sequence of heart rate's phase space points. The IASTED International Conference of Biomedical Engineering (BioMed2012) 2012;52–5.
Typ dokumentu
Bibliografia
Identyfikator YADDA
bwmeta1.element.baztech-c5fce8be-78d5-4d61-8b88-6e89c051a49b
JavaScript jest wyłączony w Twojej przeglądarce internetowej. Włącz go, a następnie odśwież stronę, aby móc w pełni z niej korzystać.