Asian Spectator

Fujitsu Develops AI based Facial Expression Recognition Technology to Accurately Detect Subtle Changes in Expression

  • Written by ACN Newswire - Press Releases

Fujitsu Develops AI based Facial Expression Recognition Technology to Accurately Detect Subtle Changes in Expression

TOKYO, Oct 15, 2019 - (JCN Newswire) - Fujitsu Laboratories, Ltd. and Fujitsu Laboratories of America, Inc. today announced the development of an AI facial expression recognition technology that detects subtle changes in facial expression with a high degree of accuracy. The new technology was developed in collaboration with Carnegie Mellon University School of Computer Science.

Fujitsu Develops AI based Facial Expression Recognition Technology to Accurately Detect Subtle Changes in Expression

Figure 1: Shows the relationship between AU and facial expression.

Fujitsu Develops AI based Facial Expression Recognition Technology to Accurately Detect Subtle Changes in Expression

Figure 2: Developed Technology

One of the obstacles for facial expression recognition technology is the difficulty in providing large amounts of data required to train detection models for each facial pose, because faces are usually captured with a wide variety of poses in real-world applications. To address the problem, Fujitsu has developed a technology to adapt different normalization process for each facial image. For example, when the angle of the subject's face is oblique, the technology can adjust the image to more closely resemble the frontal image of the face, allowing the detection model to be trained with a relatively small amount of data. The technology can accurately detect subtle emotional changes, including uncomfortable or nervous laughter, confusion, etc.-even when the subject's face is moving in a real-world context.

Fujitsu anticipates that the new technology will find use in a variety of real-world applications, including communication facilitation for employee engagement and to improve workplace safety for drivers and factory workers.

Background

In recent years, technologies that detect changes in facial expression from images and read human emotions have been increasingly attracting interest. Existing technologies have mainly been developed for detecting clear changes in facial expression (e.g. the corners of the mouth and the corners of the eyes moving widely). These technologies have been used in some practical applications, including automatic extraction of highlight scenes in videos and enhancing robots' reactions. In the future, facial expression recognition technologies will be more widely utilized in a variety of situations, including patient monitoring in healthcare and analysis of customers' responses to products in marketing campaigns.

Issues

In order to "read" human emotions more effectively, it's critical to capture the subtle facial changes associated with emotions like understanding, bewilderment, and stress. To accomplish this, developers have increasingly relied on Action Units (AUs), which express the "units" of movement corresponding to each muscle of the face based on an anatomically based classification system. For example, AUs have been used by professionals in fields as varied as psychological research and animation. AUs are classified into approximately 30 types based on the movements of each facial muscle, including for eyebrow and cheek movements. By integrating these AUs into its technology, Fujitsu has pioneered a new approach to detect even subtle changes in facial expression. To detect AUs with greater accuracy, large amounts of data are required by the underlying deep learning techniques. However, in real-world situations, cameras usually capture faces at various angles, sizes, and positions, making it difficult to prepare large-scale learning data corresponding to each visual/spatial state. Therefore, the camera-captured images adversely impact detection accuracy.

Developed Technologies

In collaboration with the Carnegie Mellon University School of Computer Science, Fujitsu Laboratories, Ltd. and Fujitsu Laboratories of America Inc. have developed an AI facial expression recognition technology that can detect AUs with high accuracy even with limited training data.

1. Normalization process to adjust the face for better resemblance of the frontal image

With this technology, images of the face taken at various angles, sizes, and positions are rotated, enlarged or reduced, and otherwise adjusted so that the image more closely resembles the frontal image of the face. This makes it possible to detect AUs with a small amount of training data based on the frontal view of the subject's face.

2. Analyzing significant regions that affect AU detection for each AU

In the normalization process, multiple feature points of the face in the image are converted so that they approach the positions of the feature points in the frontal image. However, the amount of rotation, enlargement/reduction, and adjustment changes depending on where the feature points are selected in the face. For example, if the feature points are selected to be around the eyes and perform the rotation process, the area around the eyes will be close to the reference image, but parts such as the mouth will be out of alignment. To tackle this issue, the areas that have a significant influence on AU detection from the captured face image are analyzed, and the degree of rotation, enlargement, and reduction get adjusted accordingly. By using different normalization process for each individual AU, the developed technology can detect AUs with greater accuracy.

Outcome

This technology has achieved a high detection accuracy rate of 81% even with limited training data. This technology is also more accurate than other existing technologies according to certain facial expression recognition technology benchmarks (Facial Expression Recognition and Analysis Challenge 2017).

Future Plans

Fujitsu aims to introduce the technology to practical applications for various use cases, including teleconferencing support, employee engagement measurement, and driver monitoring.

About Fujitsu Laboratories

Founded in 1968 as a wholly owned subsidiary of Fujitsu Limited, Fujitsu Laboratories Ltd. is one of the premier research centers in the world. With a global network of laboratories in Japan, China, the United States and Europe, the organization conducts a wide range of basic and applied research in the areas of Next-generation Services, Computer Servers, Networks, Electronic Devices and Advanced Materials. For more information, please see: http://www.fujitsu.com/jp/group/labs/en/.

About Fujitsu Laboratories of America

Fujitsu Laboratories of America, Inc. is a wholly owned subsidiary of Fujitsu Laboratories Ltd. (Japan), focusing on research on novel computing, networking technologies, software development and solutions for several industry verticals. Conducting research in an open environment, it contributes to the global research community and the IT industry. It is headquartered in Sunnyvale, CA. For more information, please see: www.fla.fujitsu.com.

About Fujitsu Ltd

Fujitsu is the leading Japanese information and communication technology (ICT) company, offering a full range of technology products, solutions, and services. Approximately 132,000 Fujitsu people support customers in more than 100 countries. We use our experience and the power of ICT to shape the future of society with our customers. For more information, please see www.fujitsu.com.

This release can be found at https://www.fujitsu.com/global/about/resources/news/press-releases/2019/.

Contact:Fujitsu Laboratories Ltd.
Artificial Intelligence Laboratory
E-mail: query-ferecog@ml.labs.fujitsu.com

Fujitsu Laboratories of America, Inc.
Sensibility Science Project
E-mail: fla_pr@us.fujitsu.com

Fujitsu Limited
Public and Investor Relations
Tel: +81-3-3215-5259
URL: www.fujitsu.com/global/news/contacts/

Copyright 2019 JCN Newswire. All rights reserved. www.jcnnewswire.com

Authors: ACN Newswire - Press Releases

Read more //?#

BENTELER Gets Exhaust Systems Ready for the EU-7 Standard

MUNICH, SALZBURG, Austria and PADERBORN, Germany, July 7, 2020 /PRNewswire-AsiaNet/ -- - Almost 100% pollutant removal during cold starts thanks to an electrically heated catalytic converter...

Nippon Paint Reveals the Winners of the Asia Young Designer Awards 2019/20

Functional and sustainable winning entries of the year celebrated virtually with Nippon Paint SINGAPORE - Media OutReach - 11 July 2020- Following the 13th instalment of the A...

World's First FDA IDE Coronary Patient Treated With a DEB

NYON, Switzerland, July 11, 2020 /PRNewswire-AsiaNet/ -- MedAlliance has announced enrollment of the first patient in its study of SELUTION SLR(TM) 014 DEB (http://medalliance.com/product/ )...

AMN Passes Milestone of 1 Billion Phone Calls Per Year

LONDON, July 10, 2020 /PRNewswire-AsiaNet/ -- Africa Mobile Networks (AMN) is pleased to announce that it now processes more than 1 billion phone calls annually for subscribers in previously...

The World's First CIIE-themed Airplane Launched by CEA Flew to...

SHANGHAI, July 10, 2020 /Xinhua-AsiaNet/-- At 5:36 on July 4, local time, the world's first CIIE-themed airplane flew from Shanghai to Paris Charles de Gaulle International Airport, performi...

Nexteer Recognized by General Motors as a 2019 Supplier of the...

AUBURN HILLS, Mich., July 10, 2020/PRNewswire-AsiaNet/-- Nexteer Automotive, a leader in intuitive motion control, was named a GM Supplier of the Year by General Motors during a virtual cere...

12th Venture Week for International Elites in Suzhou and 1st S...

NANJING, China, July 10, 2020 /Xinhua-AsiaNet/-- Two representatives of scientists were rewarded Suzhou Scientist Medal.On July 10, 2020 Venture Week for International Elites and 1st Scienti...

Komnas HAM Papua Reveals Case of Victim MB’s Death in Asiki

JAKARTA, Indonesia, July 10,2020/Antara-AsiaNet/-- The Papuan Representative Office of the National Commission on Human Rights of the Republic of Indonesia (Komnas HAM) revealed the case of ...

Washington Companies Refuses Safety Recommendations

LAS VEGAS, NV, Jul 10, 2020 - (ACN Newswire) - Through the discovery process in an ongoing federal lawsuit emails were provided of a safety meeting held at the Washington Companies Modern M...

Huion Unveils Its Latest Kamvas 22 Kamvas 22 Plus to Empower...

SHENZHEN, China, July 10, 2020 /PRNewswire-AsiaNet/ -- Huion, one of the leading manufacturers of graphic input devices, launched two 21.5-inch pen displays today, namely Kamvas 22 and its h...

Lifequest World (LQWC) subsidiary Biopipe Global enters US Market with Shipment of its Revolutionary Sludge-Free Biological Wastewater Treatment Plant to California

Ridgefield Park, NJ, Jul 10, 2020 - (ACN Newswire) - Lifequest World (LQWC) subsidiary Biopipe, the world's first biological and only scalable sludge and chemical free wastewater treatment ...

Up to JPY3 Mil. Available for "Take on Challenges Beyond Commo...

TOKYO, July 10, 2020 /Kyodo JBN-AsiaNet/-- - Supported by Japanese Ministry of Internal Affairs and Communications -- Subsidy for Extraordinarily Ambitious Ideas; No Restrictions on Age, Nat...

Merck Opens its Largest M Lab(TM) Collaboration Center in Shan...

DARMSTADT, Germany, July 10, 2020 /PRNewswire-AsiaNet/ -- -- Focus on improving and optimizing drug discovery, development and manufacturing-- Integrated lab with customizable solutions, val...

TOYOTA GAZOO Racing WRC Challenge Program

Toyota City, Japan, Jul 10, 2020 - (JCN Newswire) - The TOYOTA GAZOO Racing WRC Challenge Program will resume when the 2020 FIA World Rally Championship season restarts at Rally Estonia on ...

Komnas HAM Papua presents the case of victim MB's civilian death in Asiki

Jayapura, Papua, Indonesia, Jul 10, 2020 - (ACN Newswire) - The Papuan Representative Office of the National Commission on Human Rights of the Republic of Indonesia (Komnas HAM) revealed th...

Vestas is joined by world-class expert and industry leader Dr ...

MELBOURNE, Australia, July 10, 2020 /PRNewswire-AsiaNet/ -- Grid connection of wind power in rapidly evolving grids will play an increasingly vital role in the global energy transition. As a...

2020 WAIC Summit Online Opens in Shanghai

SHANGHAI, July 10, 2020 /Xinhua-AsiaNet/-- 2020 World Artificial Intelligence Conference (WAIC) Summit Online opened at Golden Hall of Shanghai Expo Center on July 9, according to World Arti...

The Mark Hotel Ranked "#1 City Hotel in the US" and "#1 Hotel ...

NEW YORK, July 10, 2020 /PRNewswire-AsiaNet/ -- The iconic Mark Hotel, which reopened its doors on June 15th and is located in one of Manhattan's most elegant and discreet neighborhoods in t...

SKF Launched Smart Supplier 4.0 Gen 2: Rethinking machine main...

KUALA LUMPUR, Malaysia and SYDNEY, July 9, 2020 /PRNewswire-AsiaNet/ -- Digitalising preventive maintenance for light industries in Southeast Asia and Australia are now more achievable than ...



News Company Media Core

Content & Technology Connecting Global Audiences

More Information - Less Opinion