News

Say it again, kid! – A game makes learning to pronounce foreign languages easy and fun

With the help of a game, immigrants and children can practice the basics of a language and pronunciation, getting immediate feedback without a personal teacher.
board_en_en.jpg

Aalto University and the University of Helsinki are involved in a project, which has produced a learning game that can be played on your own smartphone or tablet computer anywhere and as many times as you want. Thanks to the voice-user interface, the game is suited as a learning environment also for children unable to read as well as illiterate adults, who represent seven per cent of the refugees arrived to Finland.

‘It is expensive to organise teaching, so we need technological solutions to support learning that are suited for different age groups and take also users unable to read into account. The learning game can also be used in schools, where it is difficult and expensive to organise practice in active speaking and immediate personal feedback due to large group size,’ says Professor Mikko Kurimo from Aalto University.

New games using speech recognition

The project offers companies a way of applying open source tools developed by researchers to their own projects. Gaming world companies in particular can add speech recognition technology to their games and thus open doors for totally new kind of games and other applications where speaking is the most efficient way of communicating with mobile devices.

‘Computer-assisted language learning and different learning games are already quite popular, but most of them teach mainly writing skills. Since no sufficiently advanced speech recognition technology has been available, giving feedback on oral communication has been very limited and implemented on a few languages only. The speech recognition technology being developed in this project may generate new innovations in such field as game industry or education,’ Mikko Kurimo points out.

Points for correct pronunciation

The idea of the game is to explore various game boards and to turn cards which can teach words in the target language. When you click the card, you see a picture and a voice says the word first in your native language and then in the target language. The players repeat the word in the target language, after which they can evaluate their own performance by listening to their own pronunciation and then to the model pronunciation. As feedback for pronunciation, the game's speech recognition system gives 1 to 5 stars, and collecting them takes you forward in the game. The game has 27 levels.

The Technology-Enhanced Language Learning with mobile devices (TELLme) project won funding in Tekes' Challenge Finland competition. The project involves a team headed by Mikko Kurimo at Aalto University and a team headed by Sari Ylinen at the University of Helsinki from the Cognitive Brain Research Unit, which is one of the world's leading units in brain research and application of its results in the study of learning. The Aalto University research group, on the other hand, is one of the global leaders in the field of automatic speech recognition and its challenging real-world applications.

Watch the video to see how the game is played:

  • Published:
  • Updated:
Share
URL copied!

Read more news

Research group members at Karjaa medieval church in May 2020. Photo: Panu Savolainen
Research & Art Published:

Kone Foundation provides major funding for research into Finland's medieval wooden building heritage

Assistant Professor Panu Savolainen's research group receives 347 000 euros in funding.
Photo: Mika Huisman
Research & Art Published:

New Media Master's Thesis presentations / Mon 13.12.2021

Welcome to follow New Media Master’s Thesis presentations!
ConnectToBrain research. Photo: Mikko Raskinen
Cooperation, Research & Art Published:

Over €2 million awarded to the University of Helsinki and Aalto University for research identifying mechanisms of depression

A new collaborative project in neuroscience, which is being carried out by the University of Helsinki and Aalto University and which originates in the Multi-Channel Psych programme of the Wellcome Leap organisation, has received a grant of over €2 million for a period of three years.
Dominic Stead, Tenured Professors' Installation Talks
Research & Art Published:

Dominic Stead: Cities that need less transport

Organizing our cities differently can help us to reduce the need for transport and encourage more walking and cycling. This can help to reduce many of the negative environmental and social impacts of transport, says Professor Stead in his installation lecture.