Designing AI that understands humans’ goals better

To make a better smart assistant, we need an AI that understands its user and does not constantly need detailed instructions

Suomessa kehitettiin tekoäly, joka ymmärtää paremmin ihmisen tavoitteita

When researchers design machine learning systems, their goal is typically to automate certain functions. Instead of being fully autonomous, however, most of these systems work together with humans. In order to be truly helpful, they need to understand what goals people have.

Researchers at the Finnish Center for Artificial Intelligence (FCAI) have now taken important steps towards designing AI that understands people.

At first, the researchers taught the AI to build a model of its user - human or machine. Then, they taught it to adapt this model by following the user’s actions. In practice, the researchers developed machine learning methods which combine statistics with computation, and then tested the methods in practice and in simulations. They tested the algorithms in simple situations in order to make sure they understand what exactly happens in those situations and report about the events accurately.

In the first experiment, they designed an AI teacher for the learning AI.

‘This was difficult especially because the learning AI could decide what it wanted to learn,’ explains Samuel Kaski, the director of FCAI and professor at Aalto University. The researchers noticed that the AI learner achieved better learning results when the teacher understood what information the learner had already learned and adapted its teaching material to suit this  particular learner.

In the second experiment, human users were asked to find a particular target word by using an AI-based word-search engine. The engine presents the user one word at a time, and the user then  tells it whether the presented word is useful in finding the target word. If the user is looking for the word ‘football,’ for instance, they are likely to say that the first presented sport-related word is useful, if all the previous words have been related to food.

The results of this experiment showed that the AI could help the users in finding the target words faster if it understood that, by responding to the presented words in a certain way, the user wants to direct the AI towards the right words. In other words, the AI took into account the fact that the user is trying to teach it.

According to Professor Kaski, this topic is important, as the interaction between user and AI becomes much easier when the AI understands its user’s goals. ‘Then the human user does not need to explain in detail anymore what they expect from the AI helper.’

One of the main goals of FCAI is to develop AI that understands humans and is understandable. ‘So far, we can build AI systems that understand the users’ goals only in very simple situations, which means that designing truly helpful AI assistants calls for a lot of additional work,’ Kaski says.

The research article will be published at NeurIPS, the world’s largest and most prestigious machine learning conference that takes place in Vancouver, Canada on December 8 through December 14, 2019.

Link to the research article

Further information

Samuel Kaski
Professor, Aalto University
Director, FCAI
Phone +358 50 3058 694
[email protected]

Tomi Peltola
Postdoctoral Researcher, Aalto University, FCAI
Research Scientist, Curious AI
[email protected]

Finnish Center for Artificial Intelligence (FCAI) is a nationwide competence center for Artificial Intelligence in Finland, initiated by Aalto University, University of Helsinki, and VTT Technical Research Center of Finland. FCAI’s mission is to create a new type of AI that can operate with humans in the complex world and renew the Finnish industry. FCAI is one of the research flagships of the Academy of Finland.

  • Published:
  • Updated:

Read more news

Dr. Swarnalok De and logos of the Finnish Cultural Foundation, Aalto University and MMD group
Research & Art Published:

Dr. Swarnalok De receives a one-year grant from the Finnish Cultural Foundation

Awarded for research on the development of wearable healthcare sensors for autonomous health monitoring of the aging population
Unite! White paper - a new university open science and innovation governance model and policy for a sustainable world
Cooperation, University Published:

Unite!’s pathway for the management of open science and innovation in the European Universities Alliances

Unite! presents a new university open science and innovation governance model and five policy recommendations.
The magnetic properties of a material can affect how it interacts with light.
Press releases, Research & Art Published:

A new optical metamaterial makes true one-way glass possible

Researchers have discovered how to make a new optical metamaterial that would underpin a variety of new technologies.
Mikko Alava ja kolme muuta tutkimusryhmän jäsentä kuvattuna teknisen laitteen äärellä.
Research & Art Published:

Significant grants for science from the Finnish Cultural Foundation

A total of thirty individuals and research groups from Aalto University received grants from the Finnish Cultural Foundation for science and art. Professors Harri Lipsanen and Zhipei Sun and their team, were awarded a large grant to develop electronic components mimicking the structure and function of the human brain. Among the grantees is also Professor Mikko Alava, whose team is developing water-resistant foams as substitutes for plastic using AI-based methods.