Scientists develop tech that can recognise human emotion real time

by IANS |



Seoul, Feb 23 (IANS) South Korean scientists have developed a groundbreaking technology that can recognise human emotions in real time, an advance poised to revolutionise various industries, including next-generation wearable systems.


The multi-modal human emotion recognition system, developed by a team from the Ulsan National Institute of Science and Technology (UNIST), combines verbal and non-verbal expression data to efficiently utilise comprehensive emotional information.


At the core of this system is the personalised skin-integrated facial interface (PSiFI) system, which is self-powered, facile, stretchable, and transparent.


It features a first-of-its-kind bidirectional triboelectric strain and vibration sensor that enables the simultaneous sensing and integration of verbal and non-verbal expression data.


The system is fully integrated with a data processing circuit for wireless data transfer, enabling real-time emotion recognition.


Utilising machine learning algorithms, the developed technology demonstrates accurate and real-time human emotion recognition tasks, even when individuals are wearing masks.


The system has also been successfully applied in a digital concierge application within a virtual reality (VR) environment, including smart homes, private movie theatres, and smart offices. This enables the provision of personalised recommendations for music, movies, and books.


The technology is based on the phenomenon of “friction charging,” where objects separate into positive and negative charges upon friction. Notably, the system is self-generating, requiring no external power source or complex measuring devices for data recognition.


“Based on these technologies, we have developed a skin-integrated face interface (PSiFI) system that can be customised for individuals,” said Prof. Jiyun Kim, from the Department of Material Science and Engineering at UNIST.


In the study, published online in the journal Nature Communications, the team successfully integrated the detection of facial muscle deformation and vocal cord vibrations, enabling real-time emotion recognition.


The system’s capabilities were demonstrated in a virtual reality “digital concierge” application, where customised services based on users’ emotions were provided.


“With this developed system, it is possible to implement real-time emotion recognition with just a few learning steps and without complex measurement equipment. This opens up possibilities for portable emotion recognition devices and next-generation emotion-based digital platform services in the future,” Jin Pyo Lee, the first author, from the varsity.


The research team conducted real-time emotion recognition experiments, collecting multimodal data such as facial muscle deformation and voice.


The system exhibited high emotional recognition accuracy with minimal training. Its wireless and customisable nature ensures wearability and convenience.



Latest News
After 10-yr stint in BJP, Haryana's Jat leader Birender Singh rejoins Congress Tue, Apr 09, 2024, 02:50 PM
PM Modi to address first public rally for LS polls in MP's Maoist-hit Balaghat Tue, Apr 09, 2024, 12:52 PM
Why India is seeing a rising trend of diseases Tue, Apr 09, 2024, 12:40 PM
IPL 2024: 'Chennai Super Kings should be called Chepauk Super Kings', says Aakash Chopra Tue, Apr 09, 2024, 12:37 PM
Real Madrid request UEFA permission to play Manchester City under a closed roof: Report Tue, Apr 09, 2024, 12:36 PM
IPL 2024: Jonny Bairstow ready to put best foot forward' vs former side SRH Tue, Apr 09, 2024, 12:36 PM
Two killed in road accident in J&K's Udhampur Tue, Apr 09, 2024, 12:33 PM
MVA cracks seat-share formula, Uddhav Thackeray grabs maximum Tue, Apr 09, 2024, 12:31 PM
Toronto, other Canadian cities go dark as millions watch total solar eclipse Tue, Apr 09, 2024, 12:28 PM
MSCI India index rebalancing could see inclusion of 18 stocks with inflow of $2.7 bn Tue, Apr 09, 2024, 12:18 PM
South Korean Prez vows to be among top 3 nations in AI technology Tue, Apr 09, 2024, 12:10 PM
Mobile messenger KakaoTalk's users fall below 45 million for 1st time: Report Tue, Apr 09, 2024, 12:09 PM
X employees facing arrest in Brazil: Elon Musk Tue, Apr 09, 2024, 12:06 PM
Sectors like capital goods, auto lead Sensex to new high Tue, Apr 09, 2024, 12:04 PM
Egypt, Jordan, France urge immediate ceasefire in Gaza Tue, Apr 09, 2024, 12:03 PM