News

Where art meets math

Antti Oulasvirta’s work at Aalto University combines art, design, psychology and artificial intelligence—for entirely new ways of studying human-machine interaction.
Smart Art - Where art meets math
Photo: Aleksi Poutanen/Aalto University

‘Computers are capable of generating billions of pieces of art on their own, but it's humans who decide which ones stand out,’ says Antti Oulasvirta. ‘Without the social and cultural context to understand the semantics behind the art, the computer cannot decide which pixel or sound combinations are most relevant or interesting.’ 

‘But an essential aspect of art is the creative exploration of space and of possibilities,’ he continues. ‘And this is an area where AI can indeed help designers, because AI can propose ideas for us without overriding our thinking and our styles.’  
 
Oulasvirta is referring to a research project where his team looked at how machine-learning methods can support computer-aided creative design. The team developed a method for computers to learn an individual designer's preferences, and then make suggestions through an interactive gallery concept. ‘When you're doing any creative activity, you have this issue of near and far ideation. Sometimes you want to drill deep, and sometimes you want to take a step back,’ he says. ‘So we've developed a machine learning algorithm—incidentally called a bandit system—that first recognizes your style as a designer, and then tries to detect if you're exploring or drilling in.’

Antti Oulasvirta
Photo: Jussi Särkilahti

Oulasvirta's team tested the concept on 16 professional designers who were all given the task of creating a realistic mood board. After completing the task, 14 of the 16 said they would choose to implement the software in their everyday work. 

‘One of the great features of the system is that it explains to the designer why it made a certain suggestion. You can ask the AI why it chose a specific colour, for instance, and it will explain its rationale,’ he says. ‘The system never overrides the designer though—it just makes suggestions to guide and steer in a way that makes the task easier."

Oulasvirta also works on keyboard design, and is currently finalising a project commissioned by the government of France to create a new standard for the French keyboard layout. With six types of quotation marks and approximately 190 special characters to consider, Oulasvirta approached the task as an optimization problem.

‘There were basically four things to consider: performance (the speed it takes to reach a specific character), ergonomics (how natural and easy it is for the hand), learnability (which means grouping characters that belong together), and familiarity (how similar it should be to the old keyboard),’ he says. 

His work covers behavioural analytics too, analysing browsing and clickstream data so that companies can optimize the web experience for their customers.

‘Here we use models that come from psychology and human-computer interaction, and use machine learning methods to fit them to data in the best possible way,’ he says. ‘We can use models of perception instead of an eye tracker to predict where eyes move on a site, and we can define places where visitors get lost without needing to ask them.’

More from this series

Smart Art - Machine learning imperfections in materials
Research & Art Published:

Making computer-generated images look just right

Machine learning imperfections in materials
Smart Art - Finland's Art and Craft School Robotti
Research & Art Published:

Rewiring art education

Käsityökoulu Robotti is an extra-curricular school for kids that is as much about having fun bending circuits as about learning by breaking boundaries.
Smart Art - Quantum Garden
Research & Art Published:

Quantum Garden uses sculpture to get the public to train AI

The sculpture gathers data sequences to help solve a quantum computing problem.
Smart Art - AI needs art
Research & Art Published:

AI’s story won’t be complete without art

Aalto’s Kasperi Mäki-Reinikka wants art and technology to collide and make something new
  • Published:
  • Updated:
Share
URL copied!

Related news

ARTS open science roadshow, pic of the session
Research & Art Published:

European Open Science Cloud (EOSC) Finnish Forum webinar on 25th January

One of the speakers is Karel Luyben, the first president of the EOSC Association and a member of board at Aalto University.
Installation Talk 2020, Jarkko Niiranen
Research & Art Published:

Professor Jarkko Niiranen on the computational mechanics of microarchitectural solids and structures

'When developing models, we spend a lot of time on mathematical physics, numerical mathematics and computer programming, but the fundamental concepts of mechanics remain the same' says Niiranen in his installation talk.
A photo showing Dr. Dorothea Golze
Research & Art Published:

Computational physicist Dorothea Golze receives prestigious Emmy Noether Award

Dorothea Golze received funding from the German Research Foundation within the Emmy Noether Programme to establish her own junior research group at the Technical University of Dresden.
Dronen ottama kuva Otakaari 1:sestä, kuva: Mikko Raskinen
Research & Art Published:

How do you know where a drone is flying without a GPS signal?

In Jouko Kinnari's doctoral dissertation, the location of a drone can be determined using map data and sensors.