Department of Electrical Engineering and Automation

Cyber-physical Systems

Cyber-physical systems tightly integrate physical processes with computing and communication. This tight integration enables emerging applications, e.g., coordinating autonomous vehicles or fleets of drones or controlling factory automation machinery over large networks. However, realizing such applications requires developing novel machine learning and control methods. Major challenges stem from (i) the adoption of wireless technology, (ii) the computational limits of embedded devices, and (iii) the unpredictability of the real world.
Cyber-physical Systems
Cyber-physical systems tightly integrate physical processes with computing and communication.

While wireless communication offers unprecedented flexibility in sharing data between systems, which increases collective information and allows collaborative action, it is, in comparison to wired communication, less reliable, and its bandwidth is limited. For example, if all autonomous vehicles in a big city use the same wireless network and communicate simultaneously, the whole network may break down, impeding communication.

Further, for many application examples of cyber-physical systems, such as drones, we need to do computations on lightweight devices, which limits their computational power. This is particularly challenging for machine learning algorithms, which are often demanding in terms of computations. Still, machine learning algorithms are an essential asset of cyber-physical systems. They are essential, especially because cyber-physical systems are supposed to act autonomously in the real world, and not all situations they may encounter can be anticipated at design time. Machine learning methods can bring the required flexibility and adaptability for systems to work safely in unseen situations.

The cyber-physical systems group addresses these challenges by co-designing control, machine learning, and communication, both through theoretical advances and practical experiments.

The cyber-physical systems group is led by assistant professor Dominik Baumann.

Latest publications

Ergodicity in reinforcement learning

Dominik Baumann, Erfaun Noorani, Arsenii Mustafin, Xinyi Sheng, Bert Verbruggen, Arne Vanhoyweghen, Vincent Ginis, Thomas B. Schön 2026 Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences

Integrating Lagrangian Neural Networks into the Dyna Framework for Reinforcement Learning

Shreya Das, Kundan Kumar, Muhammad Iqbal, Outi Savolainen, Dominik Baumann, Laura Ruotsalainen, Simo Särkkä 2026 Proceedings of the European Signal Processing Conference

Priority-Driven Control and Communication in Decentralized Multi-Agent Systems via Reinforcement Learning

Qingyun Guo, Junyi Shi, Tomasz Kucner, Dominik Baumann 2026 IFAC Proceedings Volumes

Computationally lightweight classifiers with frequentist bounds on predictions

Shreeram Murali, Cristian R. Rojas, Dominik Baumann 2026 Proceedings of Machine Learning Research

Revisiting Value Iteration: Unified Analysis of Discounted and Average-Reward Cases

Arsenii Mustafin, Xinyi Sheng, Dominik Baumann 2026 Proceedings of the Advances in Neural Information Processing Systems

Nested smoothing algorithms for inference and tracking of heterogeneous multi-scale state-space systems

Sara Pérez-Vieites, Harold Molina-Bulla, Joaquín Míguez 2026 Foundations of Data Science

Online Bayesian Experimental Design for Partially Observed Dynamical Systems

Sara Pérez-Vieites, Sahel Iqbal, Simo Särkkä, Dominik Baumann 2026 Proceedings of Machine Learning

Beyond expected value: geometric mean optimization for long-term policy performance in reinforcement learning

Xinyi Sheng, Dominik Baumann 2026 2025 IEEE 64th Conference on Decision and Control, CDC 2025

Safe Bayesian optimization across noise models via scenario programming

Abdullah Tokmak, Thomas B. Schon, Dominik Baumann 2026 2026 American Control Conference, ACC 2026

Towards safe control parameter tuning in distributed multi-agent systems

Abdullah Tokmak, Thomas B. Schön, Dominik Baumann 2026 2025 IEEE 64th Conference on Decision and Control, CDC 2025
More information on our research in the Aalto research portal.
Research portal
  • Updated:
  • Published:
Share
URL copied!