Department of Signal Processing and Acoustics

Speech recognition

Our goal is to generally improve the speech recognition methodology with the help of the new algorithms developed in Aalto University. Speech recognition offers challenging benchmarking tasks for efficient algorithms that can process and learn to represent large quantities of data. In addition to improving the acoustic models of phonemes we aim at developing new learning statistical language models for difficult large vocabulary continuous speech recognition tasks.
srdemo_small.jpg

Research Overview

We currently specialize in the following research areas in speech recognition:

  • Sub-word units and deep learning in language modeling
  • Speaker adaptation and pronunciation rating in acoustic modeling
  • Unlimited vocabulary continuous speech recognition
  • Speech recognition and language modeling methods for under-resourced languages
  • Methods for describing and translating audiovisual
  • Speaker and language recognition and diarization

We are part of Finnish Center of Artificial Intelligence (FCAI, https://fcai.fi/).

Group members

Mikko Kurimo

Professori (Associate professor)
[email protected]
+358503476221

Katri Leino

Tohtorikoulutettava
[email protected]

Aku Rouhe

Doctoral candidate
[email protected]

Anja Virkkunen

Tohtorikoulutettava
[email protected]

Juho Leinonen

Tohtorikoulutettava
[email protected]

Mittul Singh

Tutkijatohtori
[email protected]
+358505147551

Hemant Kathania

Postdoctoral researcher
[email protected]
+358503420092

Tamás Grósz

Postdoctoral researcher
[email protected]
+358417044324

Software & Demonstrations

Software produced as part of our research is available on our GitHub

Demonstration videos of our research work can be watched on our YouTube Channel

Latest publications

Applying dnn adaptation to reduce the session dependency of ultrasound tongue imaging-based silent speech interfaces

Gábor Gosztolya, Tamás Grósz, László Tóth, Alexandra Markó, Tamás Gábor Csapó 2020 ACTA POLYTECHNICA HUNGARICA

Visual Interpretation of DNN-based Acoustic Models using Deep Autoencoders

Tamás Grósz, Mikko Kurimo 2020 Machine Learning Methods in Visualisation for Big Data

Data augmentation using prosody and false starts to recognize non-native children's speech

Hemant Kathania, Mittul Singh, Tamás Grósz, Mikko Kurimo 2020 Proceedings of Interspeech

Study of Formant Modification for Children ASR

Hemant Kathania, Sudarsana Kadiri, Paavo Alku, Mikko Kurimo 2020 Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing

Brain activity reflects the predictability of word sequences in listened continuous speech

Miika Koskinen, Mikko Kurimo, Joachim Gross, Aapo Hyvärinen, Riitta Hari 2020 NeuroImage

FinChat: Corpus and evaluation setup for Finnish chat conversations on everyday topics

Katri Leino, Juho Leinonen, Mittul Singh, Sami Virpioja, Mikko Kurimo 2020 Proceedings of Interspeech

Speaker-Aware Training of Attention-Based End-to-End Speech Recognition Using Neural Speaker Embeddings

Aku Rouhe, Tuomas Kaseva, Mikko Kurimo 2020 2020 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2020 - Proceedings

Creating speaker independent ASR system through prosody modification based data augmentation

S. Shahnawazuddin, Nagaraj Adiga, Hemant Kumar Kathania, B. Tarun Sai 2020 Pattern Recognition Letters

Effects of Language Relatedness for Cross-lingual Transfer Learning in Character-Based Language Models

Mittul Singh, Peter Smit, Sami Virpioja, Mikko Kurimo 2020 Proceedings of the 1st Joint Workshop on Spoken Language Technologies for Under-resourced languages (SLTU) and Collaboration and Computing for Under-Resourced Languages (CCURL)

Multimodal machine translation through visuals and speech

Umut Sulubacak, Ozan Caglayan, Stig Arne Grönroos, Aku Rouhe, Desmond Elliott, Lucia Specia, Jörg Tiedemann 2020 MACHINE TRANSLATION
More information on our research in the Research database.
Research database
  • Published:
  • Updated:
Share
URL copied!