By typing text, we give out our emotions 23.10.2014

Our emotions are most easily identified by facial expressions and voice. However, there are as many faces and voices in the world as there are people, and how can we be sure that some kind of emotional grimace in different people expresses the same thing - for example, fear, or joy, or sadness?

In fact, there is no problem for you and me here, our psyche easily copes with the variety of features of someone else's appearance and easily singles out common emotional components in facial expressions. The same thing happens with the voice. However, if we set out to teach a robot to recognize emotions, then we will need clear criteria by which the machine could distinguish fear from joy, and joy from sadness in any of their intensity, with any shades and on any faces.

Researchers from the Islamic University of Technology in Bangladesh chose an original way to solve this problem: they focused not on facial expressions, but on the fingers. The emotion recognition program had to focus on how a person types on the keyboard. In the first part of the experiment, 25 volunteers aged 15 to 40 retyped a piece of text from Lewis Carroll's Alice in Wonderland, while noting their emotional state: joy, fear, anger, sadness, shame, etc. If certain emotions are not it was, you could choose fatigue or neutral emotions. (It is clear that emotions could be in no way connected with the text, a person could be typing, being influenced by some of his thoughts and feelings.)

In the second part of the experiment, volunteers were already typing something of their own, but every half hour they were reminded of a certain emotion: sadness, shame, fear, joy, and further down the list - they had to enter this emotional state and stay in it while typing. At the same time, a special program collected information about how users click on the keyboard buttons.

In an article in Behavior & Information Technology, the authors of the work write that they managed to identify 19 key parameters that could be used to judge the emotional state of the typist. Among them were, for example, typing speed in an interval of five seconds, and the time during which the key remained pressed. Parameter values ​​measured on free text were compared with standard values ​​for specific emotions and words, which were obtained using Carroll's text. In this way, as the researchers will assure, it is possible to determine seven different emotions with great certainty. Most likely, they succeeded with joy (the correct answer was in 87% of cases) and with anger (the correct answer was in 81% of cases).

Compared to emotion detectors that work with facial expressions and voice intonations, the "printed" method has one noticeable disadvantage: if the emotion on the face and in the voice is manifested directly, then the person must do something - type text. If he does not print, then emotions cannot be determined. So, obviously, this method should work in conjunction with mimic and voice detectors. However, it can also be useful on its own: imagine, for example, an online psychological consultation - in such a situation, a psychologist could obtain information about the patient’s emotional state only by his typing style, and at the same time compare how much a person’s emotions correspond to the content of the messages he typed.