Artificial intelligence brings efficiency to processing pictures and sound

Deep neural networks enable the opening of image layers and distinguishing between audio signals.
The robot can open image layers.

Researchers into artificial intelligence have found a new way of approaching a visual reasoning principle called perceptual grouping. A robot learned to group its observations meaningfully unsupervised so that it had not been taught grouping criteria separately.

“When a robot sees pictures, it learns not only to distinguish between the independent parts of the picture, but also to combine the parts that belonged together into wholes and, if necessary, to fill in the missing parts of the picture. For example, a household robot learned to navigate around furniture and other obstacles and to distinguish which objects were situated behind others. The task set for the household robot could be to take hold of a mat whose edges were visible from under the edges of a sofa. To carry out the task, the robot has to learn that the two pieces of mat are part of a complete mat and that it is enough if it takes hold of the mat from one side of the sofa”, explains Antti Rasmus who is carrying out the research for his doctoral dissertation.

Unsupervised grouping of observations has not yet really been researched, but it could be utilised for example in image processing in opening different image layers and in selecting layers to form the final image. This property for example makes it easy to remove disturbing elements from an image.

“The property can be utilised in noisy situations too when there is a need to concentrate on only one sound. In this case the robot makes it possible to separate one audio signal from another”, observes Rasmus.

Deep neural networks, which previously required a lot of data, learn more efficiently when using new visual reasoning. Every image brings more information for the robot’s learning task and so the efficiency of an individual image improves and fewer images are needed than previously.                                                                                                                            

“Movement is also a strong clue to the robot about things that belong together because parts that are linked to one another always move in the same direction. For example, the robot finds it easier to spot a dog behind a fence when the dog starts to move”, he adds.

The research is being carried out by Antti Rasmus, Mathias Berglund and Tele Hotloo Hao from the Department of Computer Science and The Curious AI Company, Klaus Greff and Jürgen Schmidhuber from  IDSIA, the Swiss research laboratory that specialises in artificial intelligence, and The Curious AI Company’s CEO Harri Valpola. The research is part of Mr Rasmus’ and Mr Berglund’s doctoral research.

More information:

Antti Rasmus
Doctoral student
Aalto University, Department of Computer Science
[email protected]

Article Tagger: Deep Unsupervised Perceptual Grouping



  • Published:
  • Updated:
URL copied!

Read more news

Three decaying linden trees as campus outdoor art placed next to light rail tracks in front of the Undergraduate Centre.
Campus, University Published:

New decaying wood artwork on the Otaniemi campus

The piece enhances, among other things, the versatility of campus nature
The ultrasonic needle, which is a regular medical needle with a metal attachement connected to a large box on the side of the syringe
Studies Published:

Ultrasound provides medical needles new functions - can be used to deliver genes

The technology of medical needles has not changed dramatically in 150 years. In his doctoral research, Emanuele Perra explored if nonlinear ultrasound can be used to overcome the limitations of currently used medical needles, such as the pain experienced by patients, inaccuracy and variable quality of needle samples.
Picture of the annual party
Cooperation Published:

The Association of Process Engineering Students, Prosessiteekkarit ry, invited Dean Kristiina Kruus to become an honorary member

The Association of Process Engineering Students (Prosessiteekkarit ry, PT) of the School of Chemical Engineering is celebrating its 10th anniversary this year and to mark the occasion it has invited Kristiina Kruus, Dean of the School, to become its first honorary member.
Juha Jouhki
Cooperation Published:

Juha Jouhki, Aalto University alumni and experienced investor: “Studying is a process, not a project”

Juha Jouhki's family business supports Aalto because top-level research is key to Finnish companies’ worldwide prestige.