News

Oh, a new object! I wonder how it works? A robot can learn by experimentation

Aalto University is involved in a research project which aims to make robots try out new things and thus learn how to use them without precise pre-programming.
Aalto University / A robot / photo: Linda Koskinen

A robotic hand with three fingers grips a ball point pen and lifts it up in the air, feeling its weight and movement.  

‘Testing objects is a bit like playing’, Professor Ville Kyrki says. ‘While the robot handles new objects, it learns about them.’

When people are entrusted to cook in an unfamiliar kitchen, they do not necessarily know how to use the equipment and devices. An unfamiliar kettle or microwave oven may work slightly differently from the corresponding device at home. However, most of us have a general understanding of the operational logic behind some of the most common kitchen equipment and devices, and we learn how to use foreign objects very quickly through experimentation.

In order for robots to become part of everyday life, they also have to be able to handle items that they are not pre-programmed to use. The objective of Interactive Perception-Action-Learning for Modelling Objects (IPALM) research project is to find out how robots could learn to use new things with the help of a general model. Kyrki's research team is responsible for developing objects’ manipulation skills, such as gripping.

‘Robots are already pretty good at moving around and transporting goods. However, they do not quite know how to deal with the uncertainty related with the manipulation or processing of objects. For example, a T-shirt and a pillow change their shape when you lift them or poke them with your finger’, Kyrki explains.

Robots do not quite know how to deal with the uncertainty related with the manipulation or processing of objects.

Ville Kyrki

Observation through direct contact enables the development of more precise models which the robot can use when planning the implementation of the tasks assigned to it. Currently, learning through the manipulation of objects is one of the capabilities robots still need before they can be used in households.

‘This three-year project carries out basic research that aims to develop robots’ ability to learn about objects and their properties. It is one of the missing skills that a robot needs before it can function in an environment that it is not encrypted for, but it is by no means the only one. Robots do not have common sense, and therefore they are incapable of responding to unexpected situations. In other words, there is still a long way to go before robots can provide general domestic help’, says Kyrki.

 

Participants in the Interactive Perception-Action-Learning for Modelling Objects (IPALM) include:  Imperial College London (coordinator), Aalto University, University of Bordeaux, Polytechnic University of Catalonia and Czech Technical University.

  • Published:
  • Updated:
Share
URL copied!

Read more news

Image and photo by Aalto University, Giulnara Launonen. MMD logo by Aalto University, Mithila Mohan
Research & Art Published:

Multifunctional Materials Design: Highlights of 2022

Our group's milestones of the previous year
Utuinen ihmishahmo näyttää kävelevän pois päin, varjo heijastuu vaalealle pinnalle
Research & Art, Studies, University Published:

Master's students' exhibition at the Finnish Museum of Photography

The MoA in Photography 23 exhibition by the Master's students of the Department of Photography is on display until 12 March.
Nainen rannalla tuulisella säällä hymyilee, taustalla meri kuohuaa
Appointments, Research & Art Published:

Professor Ranja Hautamäki: ‘Diverse urban nature is key to increasing well-being and carbon sinks’

Professor of Landscape Architecture is tackling the issues of climate change mitigation and urban carbon sinks.
NASAn Curiosity-mönkijä kuvaama pölypyörre Marsin Gale-kraatterissa. Kuvankäsittely: Henrik Kahanpää. Alkuperäinen kuva: NASA / JPL-Caltech
Research & Art, Studies Published:

On Mars the weather varies dramatically, however the planet’s climate is not changing

The doctoral dissertation of Henrik Kahanpää also questions a prevailing perception related to dust devils on Mars. As a researcher, he hopes that humans would never go to Mars.