Public defence in Interactive Systems, M.Sc. Yue Jiang

The title of the thesis: Computational Representations for Graphical User Interfaces

Thesis defender: Yue Jiang
Opponent: Prof. Brian A. Smith, Columbia University, US
Custos: Prof. Antti Oulasvirta, Aalto University School of Electrical Engineering

Traditional graphical user interfaces (GUIs) often follow a ''one-size-fits-all'' design, failing to accommodate the diverse needs and contexts of all their users. What if interfaces could instead dynamically understand and adapt to individual users, enhancing their capabilities across a wide range of tasks and contexts? As the diversity of user needs expands, the challenge of designing GUIs that accommodate varying contexts becomes increasingly complex. Data-driven AI methods may offer a way to design GUIs that align with users’ goals. Current AI methods, however, often fall short of capturing the full complexity of human needs, particularly when considering domain-specific knowledge and user-specific requirements. 

This dissertation contributes to the development of human-centered neural representations for interactions that combine domain knowledge and data-driven learning for GUIs. This dissertation centers on the development of intelligent GUIs in two primary areas. First, we focus on creating computational representations that capture the essential properties of UI design. Specifically, these representations integrate domain-specific knowledge into AI models, allowing for design expert guidance while ensuring that users retain control over their interactions. Moreover, we develop AI models that simulate and predict human behaviors to facilitate automatic personalized adaptation. These models encompass various human behaviors, including eye movements and user interactions. Simulating these behaviors enables personalized optimization and enhances the AI to adaptively respond to user needs.

Key words: computational representation, user interface, eye tracking

Thesis available for public display 7 days prior to the defence at Aaltodoc. 

Contact: yuenj.jiang@gmail.com