News

AI technique captures complexity of human faces to help create realistic photo edits

The ability to distil images to their most essential components and anticipate new scenes is what could drive computer vision and robotics forward

Half a century ago, we expected the future to hold sophisticated computers and robot helpers to slash the time we spend on work and household chores.

Yet, while we now have nearly unlimited knowledge at our fingertips, the level of automation that some predicted still hasn’t come to be. What happened?

It turns out that things are a little more complicated than we expected.

‘It’s taken us a surprisingly long time to come to terms with how complex the world is,’ says Jaakko Lehtinen, an associate professor of computer science at Aalto University and distinguished research scientist at computer graphics firm NVIDIA.

Unsupervised learning

Lehtinen’s work focuses on Artificial Intelligence techniques that create new, realistic images, simply by looking at examples. The method has not just helped speed up tasks, which in the past could take a skilled professional days or weeks, to a matter of seconds but eliminated the need for human eyes all together.

‘Doing this without human supervision is a building block of intelligence,’ Lehtinen explains. ‘Looking at a large collection of images, the algorithm distils the essence of what it sees into a recipe, which it uses to create new images that show the same, hard-to-pinpoint laws and rules.’

With colleagues at NVIDIA, the techniques have, for example, created pictures of non-existent faces that look so eerily real, you could swear they were in the last movie you saw. Most recently, they have made their way into New Portrait tool in Adobe Photoshop, which users around the world can use to easily change the gaze, smile or even age of real faces.

Toimittaja Katrina Jurvan hymyilevät kasvot on käsitelty kuvaan nykyistä vanhemmiksi. Hän on pukeutunut valkoiseen paitaan, kuvan tausta on musta.
Lehtinen and colleagues’ work has helped power Adobe Photoshop’s new Smart Portrait Tool. Thanks to close collaboration with Adobe, the technique moved from academic publication to the hands of users in just a couple years. Photo: Mikko Raskinen

Smarts for the real world

These are impressive achievements, but it’s easy to overlook the potential of this technology if we concentrate on image creation or manipulation. Lehtinen says that methods that learn to imagine what’s out there will be crucial to computer vision and robotics going forward.

‘To deal with a completely new environment, like your home or office, and all of the real-world scenarios that may occur there, a robot needs a really robust idea of what all kinds of different homes and offices look like. These techniques could finally help them deal with all that complexity.’

Watch our Way Out There episode to learn more!

This article will be published in the Aalto University Magazine issue 28 coming out in May.

  • Published:
  • Updated:

Read more news

Professor Riikka Puurunen, Professor Patrick Rinke and IT Application Owner Lara Ejtehadian holding sunflowers and diplomas
Awards and Recognition, Campus, Research & Art Published:

Aalto Open Science Award ceremony brought together Aaltonians to discuss open science

Last week we gathered at A Grid to celebrate the awardees of the Aalto Open Science Award 2023 and discuss open science matters with the Aalto community.
Three female students studying
Research & Art Published:

Seed funding available to boost collaboration between Aalto, KU Leuven and University of Helsinki

Aalto University, KU Leuven and the University of Helsinki launch the 2nd exploratory seed funding call to explore research collaboration possibilities. The funding call is open until 10 September 2024.
Taija Votkin showing 360 camera use and Tomi Kauppinen and Jutta Tavaila recording a podcast episode
Cooperation, University Published:

Workshop day for teachers: 360° environments and podcasts

On Tuesday 4.6. a workshop day consisting of 360° environment creation and podcast production provides a way to get to know these media in practice. Feel free to join both workshops or one of them according to your time and interest.
Woman reading using tablet
Studies Published:

Aalto EE Introduces Alex: A New Learning Experience Platform to Transform Lifewide Learning and Tackle Upskilling Challenges

Aalto University Executive Education (Aalto EE) is launching the first version of Alex in June, a learning platform designed to enhance continuous professional development. Alex offers personalized learning journeys, micro-credentials, and professional development programs, aligning current skills with industry needs. This platform, which continuously evolves with new features like mobile access and AI integration, sets a new standard for professional development in Finland.