I Don’t Always Do What I Am Told

The Case for Task Incongruence-Aware Systems for Technology-Supported Reflection on Social Interactions

Conference Paper (2026)
Author(s)

Chenxu Hao (TU Delft - Electrical Engineering, Mathematics and Computer Science)

Tiffany Matej Hrkalovic (TU Delft - Electrical Engineering, Mathematics and Computer Science)

Bernd Dudzik (TU Delft - Electrical Engineering, Mathematics and Computer Science)

Hayley Hung (TU Delft - Electrical Engineering, Mathematics and Computer Science)

Research Group
Pattern Recognition and Bioinformatics
DOI related publication
https://doi.org/10.1145/3776574.3831154 Final published version
More Info
expand_more
Publication Year
2026
Language
English
Research Group
Pattern Recognition and Bioinformatics
Pages (from-to)
428-436
Publisher
ACM
ISBN (electronic)
9798400723186
Event
28th International Conference on Multimodal Interaction, ICMI 2026 (2026-10-05 - 2026-10-09), Napoli, Italy
Page Views
17
Reuse Rights

Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.

Abstract

Technology-supported Self-Reflection (TSR) systems aim to facilitate learning through self-reflection. In the social domain, these systems often nudge individuals to perform better towards a certain outcome in a targeted task. Typically, this idea of support assumes that users pursue specific goals, which system creators anticipate will govern users’ behavior in targeted tasks. However, how goals shape behaviors in social interactions is complex: individuals’ goals can be highly idiosyncratic and multifaceted, sometimes contradictory to their best interest, and they are often not explicitly formulated in advance. We believe that viewing this complex landscape through the lens of a simple task formulation imposes limitations on the type of support these systems can provide. In this paper, we take a first step towards investigating the incongruence between assumed task goals and observed users’ behaviors and decisions in a partner selection setting, where participants need to select a partner for a cooperation task, and the apparent task goal can co-exist with other personal or relationship-oriented goals. First, we identify task-incongruent decisions, showing that even in a highly structured and incentivized setting, some choices deviate from the assumed task goal. Second, using a Large Language Model (LLM) to analyze conversational behavior, we explore topic-based and interactional indicators of task incongruence. Although the behavioral evidence is mixed, these findings still illustrate that what appears to be a reasonably assumed goal by the system may not be what users end up pursuing. In designing TSR systems, we believe that it is crucial to have capabilities for Task-Incongruence Awareness (TIA), enabling meaningful reflections on how users’ consciously or unconsciously self-ascribed goals are aligned with their behaviors and decisions.