News

AI technique captures complexity of human faces to help create realistic photo edits

The ability to distil images to their most essential components and anticipate new scenes is what could drive computer vision and robotics forward

Half a century ago, we expected the future to hold sophisticated computers and robot helpers to slash the time we spend on work and household chores.

Yet, while we now have nearly unlimited knowledge at our fingertips, the level of automation that some predicted still hasn’t come to be. What happened?

It turns out that things are a little more complicated than we expected.

‘It’s taken us a surprisingly long time to come to terms with how complex the world is,’ says Jaakko Lehtinen, an associate professor of computer science at Aalto University and distinguished research scientist at computer graphics firm NVIDIA.

Unsupervised learning

Lehtinen’s work focuses on Artificial Intelligence techniques that create new, realistic images, simply by looking at examples. The method has not just helped speed up tasks, which in the past could take a skilled professional days or weeks, to a matter of seconds but eliminated the need for human eyes all together.

‘Doing this without human supervision is a building block of intelligence,’ Lehtinen explains. ‘Looking at a large collection of images, the algorithm distils the essence of what it sees into a recipe, which it uses to create new images that show the same, hard-to-pinpoint laws and rules.’

With colleagues at NVIDIA, the techniques have, for example, created pictures of non-existent faces that look so eerily real, you could swear they were in the last movie you saw. Most recently, they have made their way into New Portrait tool in Adobe Photoshop, which users around the world can use to easily change the gaze, smile or even age of real faces.

Toimittaja Katrina Jurvan hymyilevät kasvot on käsitelty kuvaan nykyistä vanhemmiksi. Hän on pukeutunut valkoiseen paitaan, kuvan tausta on musta.
Lehtinen and colleagues’ work has helped power Adobe Photoshop’s new Smart Portrait Tool. Thanks to close collaboration with Adobe, the technique moved from academic publication to the hands of users in just a couple years. Photo: Mikko Raskinen

Smarts for the real world

These are impressive achievements, but it’s easy to overlook the potential of this technology if we concentrate on image creation or manipulation. Lehtinen says that methods that learn to imagine what’s out there will be crucial to computer vision and robotics going forward.

‘To deal with a completely new environment, like your home or office, and all of the real-world scenarios that may occur there, a robot needs a really robust idea of what all kinds of different homes and offices look like. These techniques could finally help them deal with all that complexity.’

Watch our Way Out There episode to learn more!

This article will be published in the Aalto University Magazine issue 28 coming out in May.

  • Published:
  • Updated:
Share
URL copied!

Read more news

InteraktiiQuantum Garden on interaktiivinen elektroninen valotaideteos, jota koskettamalla teoksen värit muuttuvat. Tummasävyisessä kuvassa kaksi kättä kurkottaa eriväristen valoantureiden päälle.
Aalto Magazine, Research & Art Published:

Quantum literacy for all

What do computers, cell phones and GPS navigation have in common? And what about digital cameras, solar panels and fibre optics? The answer is that the functioning of these devices is based on quantum phenomena.
Uusi potilaiden etävalvontalaite kiinnitetään hihnalla ranteeseen kuten rannekello
Aalto Magazine Published:

A remote device helps medical staff in the fight against time

How can we improve the monitoring of patient vital signs when hospitals are full of Covid-19 patients? An international group of students, whose award-winning innovation led to establishing a company, has the solution.
Filosofi Esa Saarinen, kuva: Mikko Raskinen
Aalto Magazine Published:

What trust gives us

Philosopher Esa Saarinen says Finland is a society based on trust
Tohtorikoulutettavat Noora Yau ja Konrad Klockars seisovat vierekkäin valkoista taustaa vasten. Heidän välissään on pystysuora puinen levy, joka on pohjaväriltään musta, mutta pinnassa on kirkkaita sinisiä ja keltaisia kuvioita. Kuva: Jaakko Kahilaniemi.
Aalto Magazine, Research & Art Published:

Parallel paths: Designer and materials scientist conjure up glimmering colours out of wood

Designer Noora Yau and materials scientist Konrad Klockars have used wood to conjure up a colour, which is transparent yet glows like a copepod in shallow water. The pair’s good chemistry and open attitude towards asking silly questions is a great help in their work.