Scientists develop tech that can recognise human emotion real time

by IANS |



Seoul, Feb 23 (IANS) South Korean scientists have developed a groundbreaking technology that can recognise human emotions in real time, an advance poised to revolutionise various industries, including next-generation wearable systems.


The multi-modal human emotion recognition system, developed by a team from the Ulsan National Institute of Science and Technology (UNIST), combines verbal and non-verbal expression data to efficiently utilise comprehensive emotional information.


At the core of this system is the personalised skin-integrated facial interface (PSiFI) system, which is self-powered, facile, stretchable, and transparent.


It features a first-of-its-kind bidirectional triboelectric strain and vibration sensor that enables the simultaneous sensing and integration of verbal and non-verbal expression data.


The system is fully integrated with a data processing circuit for wireless data transfer, enabling real-time emotion recognition.


Utilising machine learning algorithms, the developed technology demonstrates accurate and real-time human emotion recognition tasks, even when individuals are wearing masks.


The system has also been successfully applied in a digital concierge application within a virtual reality (VR) environment, including smart homes, private movie theatres, and smart offices. This enables the provision of personalised recommendations for music, movies, and books.


The technology is based on the phenomenon of “friction charging,” where objects separate into positive and negative charges upon friction. Notably, the system is self-generating, requiring no external power source or complex measuring devices for data recognition.


“Based on these technologies, we have developed a skin-integrated face interface (PSiFI) system that can be customised for individuals,” said Prof. Jiyun Kim, from the Department of Material Science and Engineering at UNIST.


In the study, published online in the journal Nature Communications, the team successfully integrated the detection of facial muscle deformation and vocal cord vibrations, enabling real-time emotion recognition.


The system’s capabilities were demonstrated in a virtual reality “digital concierge” application, where customised services based on users’ emotions were provided.


“With this developed system, it is possible to implement real-time emotion recognition with just a few learning steps and without complex measurement equipment. This opens up possibilities for portable emotion recognition devices and next-generation emotion-based digital platform services in the future,” Jin Pyo Lee, the first author, from the varsity.


The research team conducted real-time emotion recognition experiments, collecting multimodal data such as facial muscle deformation and voice.


The system exhibited high emotional recognition accuracy with minimal training. Its wireless and customisable nature ensures wearability and convenience.



Latest News
Karnataka sex videos case: SIT helpline gets calls from 30 victims of Prajwal Revanna Fri, May 24, 2024, 12:39 PM
X platform now has 600 million monthly active users: Musk Fri, May 24, 2024, 12:38 PM
Rampant Belgium beat India 1-4 in FIH Hockey Pro League 2023/24 Fri, May 24, 2024, 12:36 PM
SC's no interim directions to ECI on voter turnout after each phase of LS poll Fri, May 24, 2024, 12:33 PM
Assam swelters as temperature soars 6 degrees above normal Fri, May 24, 2024, 12:32 PM
People under 40 account for 20pc cancer cases in India: Study Fri, May 24, 2024, 12:30 PM
India women's team falters 0-2 against Belgium in FIH Hockey Pro League Fri, May 24, 2024, 12:17 PM
Covid jab technology-based bird flu vaccine may help curb H5N1 cases Fri, May 24, 2024, 12:10 PM
Sensex flat amid negative global cues Fri, May 24, 2024, 12:00 PM
NP Singh, MD & CEO of Sony Pictures Networks India, moves on Fri, May 24, 2024, 11:51 AM
DD Kisan to launch two AI anchors who can speak 50 languages Fri, May 24, 2024, 11:48 AM
About 100 feared dead during huge landslide in Papua New Guinea Fri, May 24, 2024, 11:46 AM
Taiwan reports 49 Chinese warplanes in airspace amid military drills Fri, May 24, 2024, 11:40 AM
Vietnam: Fire at residential building kills 14 in Hanoi Fri, May 24, 2024, 11:40 AM
Situation in Middle East not about taking sides: German Foreign Minister Fri, May 24, 2024, 11:38 AM