News

Brain scans shine light on how we solve clues

Partnered with machine learning, brain scans reveal how people understand objects in our world
Merkitys / Safa Hovinen
Image Credit Merkitys/Safa Hovinen

What’s an s-shaped animal with scales and no legs?  What has big ears, a trunk and tusks? What goes ‘woof’ and chases cats? The brain’s ability to reconstruct facts – ‘a snake’, ‘an elephant’ and ‘a dog’ – from clues has been observed using brain scanning by researchers at Aalto university. Their study was published today in Nature Communications.

In the research, test subjects were given three clues to help them guess what familiar objects the clues described. In addition to well-known animals, the clues depicted vegetables, fruits, tools and vehicles. The familiar objects and concepts described in the clues were never presented directly to the test subjects.

The researchers at Aalto University demonstrated that brain activation patterns contained more information about the features of the concept than had been presented as clues. The researchers concluded that the brain uses environmental clues in an agile way to activate a whole range of the target concept’s properties that have been learned during life.

‘This is a very important skill in nature because it enables a quick response based on small amount of information. For example, we automatically avoid a wiggly thing on a rocky shore because we know that a snake may be poisonous,’ says Sasa Kivisaari, Postdoctoral Researcher at the Aalto University.

The study used a huge amount of internet-based material to map the meaningful features associated with different concepts. Machine learning was used to create a model that describes the relationship between these features and brain activation patterns. Based on the model, brain activation patterns could be used to accurately deduce which concept the test subject was thinking of. For example, the activation patterns could be used to infer whether the clues led the subject to think of an elephant or a dog.

4 Brains thinking about moose
Scans of the brains of four different people, all thinking about clues for moose. (Sasa L. Kivisaari)

Understanding our differences to detect memory disorders

The method can be used to address the question why people understand or perceive the same concept differently.

‘The organization of meanings in the brain differs from person to person and can also affect how easy or hard it is for them to understand each other,’ says Professor Riitta Salmelin.

The research may also play a role in detecting memory disorders.

‘Combining and understanding meaningful information seems to involve the same brain areas that are damaged in early Alzheimer's disease. Therefore, the method we use may also be applied to the early detection of memory disorders,’ says Kivisaari.

Professor Riitta Salmelin's research team studies the neural basis of processing of language and meaningful information at the Department of Neuroscience and Biomedical Engineering at Aalto University. The research has been supported by the Academy of Finland, the Aalto Brain Centre and the Sigrid Jusélius Foundation.

Further information:

Visualisation of the model used in the study: https://aaltoimaginglanguage.github.io/guess/

Sasa Kivisaari

Postdoctoral Researcher, Academy of Finland
Aalto University
sasa.kivisaari@aalto.fi
Tel: +358 50 432 2828

Riitta Salmelin
Professor
Aalto University
riitta.salmelin@aalto.fi
Tel: +358 50 344 2745

  • Updated:
  • Published:
Share
URL copied!

Read more news

Black and white double exposure of a bearded man in a suit and tie, looking serious at the camera
Aalto Magazine, Research & Art Published:

Everyday choices: Ghassem Gozaliasl, how do galaxy groups reflect the need for human connection?

An astrophysicist with the Aalto High-Performance Computing Lab (HPCLab), Gozaliasl uses the James Webb Telescope to study how galaxies have formed over the last 12 billion years.
Four people talk at a tech event, two by a laptop, colourful UN goal posters glowing in the background
Awards and Recognition, Cooperation Published:

Unite! helps startups expand across Europe

Unite! soft-landing services support startups in expanding into new European markets by offering direct access to local innovation ecosystems, tailored matchmaking with industry and research partners, and hands-on support at Unite! universities across Europe.
Campus park with green and orange autumn trees before a brick building under a blue sky with clouds
Awards and Recognition, University Published:

Which team deserves the Aalto Pioneering Excellence Award? Submit your nomination by 16 October

The award may be given to a team that does pioneering work to advance education, research or artistic activity, or to enable the international success of the Aalto University community
Three men in smart casual clothes pose separately against different indoor backdrops
Press releases, Research & Art Published:

Three rising Aalto University researchers secure highly sought-after EU funding

In their research projects, Dominik Baumann, Tero Mäkinen and Owies Wani develop the training of reinforcement learning agents, a better understanding of the physics of material damage and electrolyte structures for energy storage.