News

Collaborative AI provides inspiration for designers

A new AI approach helps design practitioners to explore visual ideas

Researchers at Aalto university have developed a machine learning algorithm that collaborates with designers to create visual collages, called mood boards. The AI is integrated in a design tool, and makes recommendations, explains its choices, and adapts to the designer’s problem-solving process over time.

Inspiration can be hard to support using a computer. Creative processes evolve quickly and are exploratory in nature, so computers can struggle to keep up. An AI algorithm that gives suggestions that are weird and random is not useful and likely to be ignored by the designer, and an AI that is too conservative and only returns suggestions that match what has already been used is also not creatively useful. However by using a novel machine learning technique called a Cooperative Contextual Bandit (CCB) method, engineers and designers have developed an AI that strikes this creative balance.

Janin Koch, the researcher behind the work, says, "The advantages of the CCB method is that it is able decide whether to follow the current visual idea, or to explore new ideas depending on the current mood board. The ability of the new AI to work alongside designers encourages a form of human-computer collaboration in the design process."

Mood boards with and without AI
Mood boards created with AI (top) and without the AI (bottom)

The AI also learns from the current designer’s selection behaviour, and uses this behaviour to refine its suggestions. As part of their study the researchers asked a group of 16 designers to create mood boards with, and without the AI helping them. All designers use mood boards as inspiration tools in their work, from design fields including architecture, fashion, and graphic design. In the example on the right, the designer used the AI in the top image while working on a brief for a Health Store, while in the second worked without the AI on a banking firm's youth program. 

The key finding was that the adaptability of the AI allowed it to help designers both when they were “on a roll” and when they were “stuck”. The AI can decide when to offer more explorative suggestions, and when to stick more closely to what’s already chosen. The designers therefore perceived the suggestions as novel without being too eccentric or useless. Even if the AI surprised the designer with unusual suggestions, as these were not completely outlandish, they were more inclined to find them original and useful. The majority of the designers therefore used the AI’s suggestions in their mood boards, and the AI-suggested images made up over a quarter of their final boards.

Further details about the study are available on the research group's website. The details of this successful trial are being presented at the CHI 2019 conference in Glasgow, and the team are now looking to apply the collaborative AI systems in professional context. “The next stage of our study will involve getting the AI out into the working practice, like being used in design agencies over the summer so we can see how it works over time,” Janin says.

 

Contact details

Name: Janin Koch
Languages:
German, English
Email: [email protected]

Name Professor Antti Oulasvirta
Languages:
Finnish, English
Email: [email protected]

Name Professor Andrés Lucero
Languages:
Spanish, English, French
Email: [email protected]

  • Published:
  • Updated:
Share
URL copied!

Read more news

Utuinen ihmishahmo näyttää kävelevän pois päin, varjo heijastuu vaalealle pinnalle
Research & Art, Studies, University Published:

Master's students' exhibition at the Finnish Museum of Photography

The MoA in Photography 23 exhibition by the Master's students of the Department of Photography is on display until 12 March.
Nainen rannalla tuulisella säällä hymyilee, taustalla meri kuohuaa
Appointments, Research & Art Published:

Professor Ranja Hautamäki: ‘Diverse urban nature is key to increasing well-being and carbon sinks’

Professor of Landscape Architecture is tackling the issues of climate change mitigation and urban carbon sinks.
NASAn Curiosity-mönkijä kuvaama pölypyörre Marsin Gale-kraatterissa. Kuvankäsittely: Henrik Kahanpää. Alkuperäinen kuva: NASA / JPL-Caltech
Research & Art, Studies Published:

On Mars the weather varies dramatically, however the planet’s climate is not changing

The doctoral dissertation of Henrik Kahanpää also questions a prevailing perception related to dust devils on Mars. As a researcher, he hopes that humans would never go to Mars.
A portrait of Laureen Mahler.
Research & Art Published:

Laureen Mahler uses origami folding to create bio-based packaging that is also pleasant to look at

Many products of the packaging industry are made of plastic and other fossil-based materials. The Aalto University Bioinnovation Center is developing ecological packaging solutions based on origami folding which also have value as beautiful objects.