News

The research puzzle of when humans and AI don’t see eye to eye

Francesco Croce will be working on robustness in multi-modal foundation models at ELLIS Institute Finland and Aalto University.

A sticker on a traffic sign can cause a self-driving car to crash. A few pixels of noise can make a neural network decide that an image of a dog actually shows a bird. These are just some examples of how AI systems can behave unreliably, displaying an inconsistency that is a bit hard for people to understand. “Why this happens is a mystery,” says Francesco Croce. “Features that are very important for humans are not important for models and vice versa, and why models solve tasks in odd ways is also a safety and a legal concern.”

A person wearing a light grey hoodie stands indoors with a brick wall and green plants in the background.
Francesco Croce. Photo by Matti Ahlgren/Aalto University

Croce has just joined ELLIS Institute Finland and Aalto University to work on these problems of adversarial robustness: making machine learning outcomes stable in the face of strange inputs or even malicious attacks. He is also interested in how AI systems do or don’t align with human perception, for example, do they caption or classify images correctly. Croce was previously a postdoctoral fellow at the Swiss Federal Institute of Technology Lausanne (EPFL) and he is now a PS Fellow and assistant professor at Aalto.

Croce’s career so far has taken him from his native Italy, where he studied mathematics, to Germany for a PhD in machine learning and to London for an internship with Google DeepMind. “It’s lucky that I've been to several places where there were great researchers,” he says. Though ending up in Finland was a bit random, Croce admits, the establishment of the ELLIS Institute was a motivator to apply. “There’s a solid plan for working with AI research in Europe, the computing power of course, and they are building something that will hopefully last long and have an impact.”

At the ELLIS Institute, Croce is now set to recruit PhD students and postdocs who are interested in applying adversarial robustness to multi-modal models. He previously developed a benchmark for testing and tracking the progress of robustness, and is now keen to extend the work to other domains like generative AI.

Students should actually enjoy the research process, says Croce—“not just writing papers and getting lines on your CV”. Creativity is also an important trait for researchers: “To imagine something that doesn’t exist yet and find the good questions, to understand what’s currently missing and what’s relevant to push things forward.”

Contact:

Read more:

Logo of ELLIS Institute Finland with a striped map of Europe above and multicoloured letters 'ellis'.

ELLIS Institute Finland welcomes 9 new professors as principal investigators and PS Fellows

Institute's first recruitment brings nine leading researchers to Finland

News
Group of people standing in a room holding a ribbon, with presentation screen and institute banner in the background.

New Fundamentals: ELLIS Institute Finland launches with bold scientific ambitions

AI and ML for transforming R&D, enhancing human-AI teamwork, and creating exciting new science

News
Logo of ELLIS Institute Finland with a striped map of Europe above and multicoloured letters 'ellis'.

ELLIS Institute Finland (external link)

ELLIS Institute Finland is a world-class research hub in AI and machine learning and part of the European Laboratory for Learning and Intelligent Systems (ELLIS).

  • Updated:
  • Published:
Share
URL copied!

Read more news

A large, historic building with a pink facade and grey roof in a square with people walking and cycling.
Appointments, Cooperation Published:

Aalto academics begin Unite! visiting professorships at TU Darmstadt

As part of the Unite! Visiting Professorship Programme, TU Darmstadt welcomed six visiting professors from Aalto University for the winter semester 2025/2026.
A blue screen with a window titled 'IT Services' showing 'Issue fixed' and a smaller window with a smiling face.
University Published:

Fixed: Disturbances in AV systems in the premises of Maarintie 8

AV systems in rooms TU4, TU5, TU6 and TU7 working normally
A person wearing a black shirt stands outside near a tree.
Appointments Published:

Miklu Silvanto, who has worked with the world's most well-known brands, how do you nurture creativity?

Oura’s Chief Design Officer and Professor of Practice at Aalto University's Department of Design Miklu Silvanto talks about creativity.
A cyclist rides past the Finnish Parliament House in Helsinki during autumn. The building is bathed in golden sunlight.
Press releases, Research & Art Published:

Elites wield huge influence over deepening polarisation –– now we can tell exactly how much

Researchers used network theory to develop a method for measuring the impact of individuals on societal division.