Emotions detection scheme using facial skin temperature and heart rate variability

Graduate School of Engineering and Science, Shibaura Institute of Technology, Tokyo, Japan

^* Corresponding author: mg17004@shibaura-it.ac.jp

Abstract

Technology nowadays is aiming to provide a better life quality for people, schools and universities are working for the convenient of the students as well as ensuring a high quality of education is attained. Emotions detections system can be a solution for better education results and may also be used as a part of human-computer interaction applications such as robotics, games, and intelligent tutoring system, This study shows potentials method of detecting emotions using mobile computing to recognize and identify emotions (Relax, Fear, Sadness, and Joy) based on facial skin temperature, more specifically 5 spots on the face, Nose, Glabellar line (between the eyes and eyebrows) right\lift cheeks and the chin, in addition to the Heart Rate Variability (HRV). An experiment was conducted with 20 healthy subjects (10 females and 10 males, 20 to 31 years old), Both visual and auditory media were used to induce these emotions in the experiment. By the end of this paper, the output data will be anglicized by an Artificial neural network (ANN) The Multilayer Perceptron (MLP) was selected as a classifier with a result of 88.75 % accuracy. This mechanism proves that human`s emotions can easily identify without physical interaction with the subject and with high reliability with only 0.11 misprediction rate