Fujitsu develops hands-free speech translation device

Fujitsu announced the development of the world's first wearable, hands-free speech translation device, suitable for tasks in which the users' hands are often occupied, such as in diagnosis or treatment in healthcare.

In recent years, with an increase in the number of visitors to Japan, more and more non-Japanese patients are going to hospitals, creating issues in supporting communication in multiple languages.

In 2016, Fujitsu Laboratories developed hands-free technology that recognizes people's voices and the locations of speakers, and that automatically changes to the appropriate language without physical manipulation of the device.

That same year, it also worked with the University of Tokyo Hospital and the National Institute of Information and Communications Technology (NICT) to conduct a field trial of multilingual speech translation in the medical field using stationary-type tablets.

Based on the results, Fujitsu Laboratories learned that, as there are many situations in which healthcare providers have their hands full, such as when providing care in a hospital ward, there was a great need for a wearable speech translation device that could be used without being physically touched.

In order to expand the usability of multilingual speech translation, Fujitsu Laboratories has developed the world's first compact, wearable, hands-free speech translation device by developing technology to differentiate speakers using small omnidirectional microphones.

This is possible through an ingenious modification of the shape of the sound channel, and by improving the accuracy of speech detection technology that is highly resistant to background noise.

Use of this device is expected to reduce the burden on healthcare providers whose hands are often constrained by other tasks.

Fujitsu Laboratories will evaluate the effectiveness of these newly developed translation devices in healthcare situations as part of a multilingual speech translation clinical trial being carried out jointly with Fujitsu Limited, the University of Tokyo Hospital, and NICT, with the new devices being deployed in November 2017.

Fujitsu Laboratories will be carrying out clinical trials in healthcare institutions across Japan, including the University of Tokyo Hospital, beginning in November 2017, using both this newly developed wearable, hands-free speech translation device and a speech translation system that supports accurate translations between Japanese and English or Chinese in healthcare situations, developed by NICT.

In addition, based on the results of these clinical trials, the number of supported languages and the scope of usage will be expanded.

Going forward, Fujitsu Laboratories aims to expand speech translation systems using this technology to a variety of fields, such as in assisting guests in tourism and in public services from local governments, with the goal of commercialization in fiscal 2018.

Fujitsu is a leading Japanese information and communication technology company, offering a range of technology products, solutions, and services.