New technology conveys the direction of sounds through hearing aids

A new signal processing model enables both accurate spatial sound reproduction and sound adjustment for people with hearing loss
Muovinen tutkimuksessa käytetty pää, johon on kiinnitetty mikrofoni.
The researchers tested the model in the laboratory. Photo: Ville Pulkki's resarch group

A hearing aid should answer two questions: what and where?

Now, a team of researchers at Aalto University has developed a technology to accurately provide the missing directional information. Their work was published in the prestigious Journal of American Society of Acoustics (JASA).

‘Improving the spatial quality of sound is about improving the quality of life,’ says lead author doctoral student Janani Fernandez, who has also worked with cochlear implants. Special expertise in signal processing was brought to the work by another doctoral student, Leo McCormack.

The outer parts of our ears play an important role in determining where a sound is coming from. But with hearing aids, sounds sources seem to fill the head, which is distracting and tiring, especially in crowded situations. This is because the sound captured by the microphone is amplified and then passed through a thin tube directly into the ear canal, losing directional information. Not knowing where sounds come from also makes it more difficult to distinguish between different speakers.

In the JASA paper, the researchers present a signal processing model that analyses data from multiple microphones collecting sound from different directions to capture spatial information. ‘Only then is it passed on, for example to a compressor in a hearing aid, which amplifies the signal to suit the listener’s needs. The sound is then played back to the listener using the analysed spatial information, creating a natural spatial impression,’ says Ville Pulkki, Professor of Acoustics.

Akustiikan tutkimuksessa käytettäviä korvan malleja
The auditory system answers two questions: what and where? Picture of KEMAR model ears used in acoustics research. Photo by Sara Urbanski / Aalto University

According to Pulkki, the method is not yet suitable for most hearing aids because it needs a lot of computing power and energy. The hearing aids in the left and right ear also need to communicate with each other. This can be difficult to achieve with small hearing aids, especially since the battery should last a long time for comfort.

Larger devices can more easily house enough computing power and a large enough power supply. This could include headsets used by professionals wearing helmets that impair hearing, such as rescue personnel, police officers and soldiers.

‘When a rescuer goes into a smoke-filled building with poor visibility, it’s important not only to hear the cries for help but also to know where they are coming from or which side a colleague is on,’ says Pulkki.

Determining the direction of sounds is also a safety issue for the hearing impaired, Fernandez stresses. ‘For example, it’s important to distinguish which direction a car is coming from when crossing a road.’

Authentic surround sound would also make augmented reality (AR) experiences more realistic and enjoyable. For example, if a symphony orchestra concert were recorded with enough microphones placed in different parts of the concert hall, the new model could reproduce it so accurately that music fans wouldn’t have to travel to Berlin, London or Chicago to hear top orchestras.  ‘A VR concert would offer the same experience as a concert hall,’ says Fernandez.

The study also involved the University of Tampere.

Link to the paper (

Aalto Acoustics Lab

The Aalto Acoustics Lab is a multidisciplinary research center focusing on audio processing and spatial sound technologies. The laboratory gathers professors and research teams from three different units: Department of Information and Communications Engineering, Department of Computer Science, and Department of Art and Media.

Lue lisää
Aalto University Acoustic Lab

Anyone can get super-hearing

New audio technique can track bats in flight and help localise sources of ultrasonic sound.

Lue lisää
Superkuulon toteuttava laite. Pallon pinnalla on kuusi ultraäänille herkkää mikrofonia. Ultraäänet toistetaan kuulokkeisiin niin, että kuulija havaitsee äänilähteen suunnan oikein. Kuva: Ville Pulkki / Aalto-yliopisto
  • Published:
  • Updated:
URL copied!

Read more news

Image and photo by Aalto University, Giulnara Launonen. MMD logo by Aalto University, Mithila Mohan
Research & Art Published:

Multifunctional Materials Design: Highlights of 2022

Our group's milestones of the previous year
Nainen rannalla tuulisella säällä hymyilee, taustalla meri kuohuaa
Appointments, Research & Art Published:

Professor Ranja Hautamäki: ‘Diverse urban nature is key to increasing well-being and carbon sinks’

Professor of Landscape Architecture is tackling the issues of climate change mitigation and urban carbon sinks.
NASAn Curiosity-mönkijä kuvaama pölypyörre Marsin Gale-kraatterissa. Kuvankäsittely: Henrik Kahanpää. Alkuperäinen kuva: NASA / JPL-Caltech
Research & Art, Studies Published:

On Mars the weather varies dramatically, however the planet’s climate is not changing

The doctoral dissertation of Henrik Kahanpää also questions a prevailing perception related to dust devils on Mars. As a researcher, he hopes that humans would never go to Mars.
A portrait of Laureen Mahler.
Research & Art Published:

Laureen Mahler uses origami folding to create bio-based packaging that is also pleasant to look at

Many products of the packaging industry are made of plastic and other fossil-based materials. The Aalto University Bioinnovation Center is developing ecological packaging solutions based on origami folding which also have value as beautiful objects.