Safe and socially acceptable interactions with human-driven vehicles are a major challenge in automated driving. A good understanding of the underlying principles of such traffic interactions could help address this challenge. Particularly, accurate driver models could be used to inform automated vehicles in interactions. These interactions entail complex dynamic joint behaviors composed of individual driver contributions in terms of high-level decisions, safety margins, and low-level control inputs. Existing driver models typically focus on one of these aspects, limiting our understanding of the underlying principles of traffic interactions. Here, we present a Communication-Enabled Interaction model based on risk perception, that does not assume humans are rational and explicitly accounts for communication between drivers. Our model can explain and reproduce observed human interactions in a simplified merging scenario on all three levels. Thereby improving our understanding of the underlying mechanisms of human traffic interactions and posing a step towards interaction-aware automated driving.

@en

In Industry 5.0, cognitive robots and workers will engage in evolving and reciprocal relations, which we call worker-robot relationships (WRRs). To enable evidence-based work futures with workers, we must co-develop WRRs and understand their impact on work, workers, management, and society. To this end, we posit that the HRI field should work beyond disciplines and include value-driven and plural perspectives through transdisciplinary research done with and for workers. However, WRRs and transdisciplinarity pose unique technical, design, and methodological challenges yet to be explored. We propose a workshop to engage the HRI community working on Industry 5.0, aiming at 1) taking stock of current WRR-related challenges in relevant disciplines, 2) collectively kick-off the exploration of a joint research agenda, 3) preliminary examining if and how transdisciplinarity could help the HRI community, and 4) start discussing how to deal with such complex knowledge integration in practice.

@en

This handbook presents the concept of ‘meaningful human control’ (MHC) over AI systems from the perspectives of (i) philosophy and ethics, (ii) law and governance, and (iii) design and engineering. The introductory chapter addresses the motivations and recent developments in MHC, introducing each perspective and related chapters. These three disciplinary perspectives scrutinize how MHC intertwines with philosophical debates on moral responsibility, societal concerns regarding control over technological advancements in legal frameworks, and the engineering complexities of designing and developing AI systems while ensuring human control and responsibility. Additionally, cross-cutting aspects on MHC over AI systems are also introduced and discussed through (iv) interdisciplinary and systemic perspectives. By offering a contextualized introduction to the perspectives considered in this handbook, this chapter aims to present the handbook’s various approaches and points of interest for a diverse audience, highlighting potential entry points into this multidisciplinary volume.

@en

Understanding behavior of human drivers in interactions with automated vehicles (AV) can aid the development of future AVs. Existing investigations of such behavior have predominantly focused on situations in which an AV a priori needs to take action because the human has the right of way. However, future AVs might need to proactively manage interactions even if they have the right of way over humans, e.g., a human driver taking a left turn in front of the approaching AV. Yet it remains unclear how AVs could behave in such interactions and how humans would react to them. To address this issue, here we investigated behavior of human drivers (N = 19) when interacting with an oncoming AV during unprotected left turns in a driving simulator experiment. We measured the outcomes (Go or Stay) and timing of participants’ decisions when interacting with an AV which performed subtle longitudinal nudging maneuvers, e.g. briefly decelerating and then accelerating back to its original speed. We found that participants’ behavior was sensitive to deceleration nudges but not acceleration nudges. We compared the obtained data to predictions of several variants of a drift-diffusion model of human decision making. The most parsimonious model that captured the data hypothesized noisy integration of dynamic information on time-to-arrival and distance to a fixed decision boundary, with an initial accumulation bias towards the Go decision. Our model not only accounts for the observed behavior but can also flexibly generate predictions of human responses to arbitrary longitudinal AV maneuvers, and can be used for both informing future studies of human behavior and incorporating insights from such studies into computational frameworks for AV interaction planning.@en

Traffic jams occurring on highways cause increased travel time as well as increased fuel consumption and collisions. So-called phantom traffic jams are traffic jams that do not have a clear cause, such as a merging on-ramp or an accident. Phantom traffic jams make up 50% of all traffic jams and result from instabilities in the traffic flow that are caused by human driving behavior. Automating the longitudinal vehicle motion of only 5% of all cars in the flow can dissipate phantom traffic jams. However, driving automation introduces safety issues when human drivers need to take over the control from the automation. We investigated whether phantom traffic jams can be dissolved using haptic shared control. This keeps humans in the loop and thus bypasses the problem of humans’ limited capacity to take over control, while benefiting from most advantages of automation. In an experiment with 24 participants in a driving simulator, we tested the effect of haptic shared control on the dynamics of traffic flow and compared it with manual control and full automation. We also investigated the effect of two control types on participants’ behavior during simulated silent automation failures. Results show that haptic shared control can help dissipating phantom traffic jams better than fully manual control but worse than full automation. We also found that haptic shared control reduces the occurrence of unsafe situations caused by silent automation failures compared to full automation. Our results suggest that haptic shared control can dissipate phantom traffic jams while preventing safety risks associated with full automation.

@en

While Meaningful Human Control (MHC) is at the very heart of the Edward Elgar research handbook, this specific chapter addresses the questions how MHC is rooted in the history of human artefacts and human-machine systems, how it is related to the term control, ability, responsibility, authority, autonomy and finally accountability. The chapter sketches, step by step, a holistic, cybernetic model of the most important relationships between MHC and its related concepts interconnected over this holistic big picture map. Starting point are existing control systems and their evolution through history, followed by the interrelationship between the small-scale human-machine or human-AI system, and the increasingly bigger system of systems, organizations, societies and our global environment. The goal of this bow-tie shaped system map is to enable a better balance between global and local perspectives, and therefore enable a more efficient and better design, engineering and evaluation of such systems. @en

This study presents a general optimal trajectory planning (GOTP) framework for autonomous vehicles (AVs) that can effectively avoid obstacles and guide AVs to complete driving tasks safely and efficiently. Firstly, we employ the fifth-order Bezier curve to generate and smooth the reference path along the road centerline. Cartesian coordinates are then transformed to achieve the curvature continuity of the generated curve. Considering the road constraints and vehicle dynamics, limited polynomial candidate trajectories are generated and smoothed in a curvilinear coordinate system. Furthermore, in selecting the optimal trajectory, we develop a unified and auto-tune objective function based on the principle of least action by employing AVs to simulate drivers’ behavior and summarizing their manipulation characteristics of “seeking benefits and avoiding losses.” Finally, by integrating the idea of receding-horizon optimization, the proposed framework is achieved by considering dynamic multi-performance objectives and selecting trajectories that satisfy feasibility, optimality, and adaptability. Extensive simulations and experiments are performed, and the results demonstrate the framework's feasibility and effectiveness, which avoids both dynamic and static obstacles and applies to various scenarios with multi-source interactive traffic participants. Moreover, we prove that the proposed method can guarantee real-time planning and safety requirements compared to drivers’ manipulation.

@en

Traffic interactions between merging and highway vehicles are a major topic of research, yielding many empirical studies and models of driver behaviour. Most of these studies on merging use naturalistic data. Although this provides insight into human gap acceptance and traffic flow effects, it obscures the operational inputs of interacting drivers. Besides that, researchers have no control over the vehicle kinematics (i.e., positions and velocities) at the start of the interactions. Therefore the relationship between initial kinematics and the outcome of the interaction is difficult to investigate. To address these gaps, we conducted an experiment in a coupled driving simulator with a simplified, top-down view, merging scenario with two vehicles. We found that kinematics can explain the outcome (i.e., which driver merges first) and the duration of the merging conflict. Furthermore, our results show that drivers use key decision moments combined with constant acceleration inputs (intermittent piecewise-constant control) during merging. This indicates that they do not continuously optimise their expected utility. Therefore, these results advocate the development of interaction models based on intermittent piecewise-constant control. We hope our work can contribute to this development and to the fundamental knowledge of interactive driver behaviour.

@en

Increasing online retail has resulted in increased automation in order picking systems, leading to new challenges and opportunities in task scheduling. The job-shop scheduling problem is an optimization problem essential in such systems, but existing JSP literature often overlooks workplace fatigue, which harms employees’ well-being and costs U.S. employers up to €127 billion annually. In this work, we propose fatigue consideration in the job-shop scheduling problem in a cobotic order picking system to mitigate its negative effects. We present a new bi-objective mixed integer nonlinear programming problem formulation that considers worker fatigue and productivity during schedule optimisation. To put the results of simulated optimisation in perspective, we experimentally validate the fatigue model and scheduling results in a real operation. The mathematical model finds solutions that conventional single-objective optimisation cannot, allowing fractional fatigue distribution improvements more than 4x larger than the decrease in productivity they require in 53% of the considered virtual cases. The experiments show that our predictive fatigue model has an average RMSE of 2.20 kcal/min in estimating energy expenditure rates compared to heart rate measurements. It also shows a low correlation, meaning it is unfit for application. On the other hand, fatigue-conscious schedules show no clear benefit regarding measured and perceived fatigue. However, the scheduling model could also use heart rate measurements that do not show these inaccuracies. Our study highlights the need to further develop and validate the mathematical formulation and fatigue model and extend to other human factors and indirect fatigue effects.@en

Recently, multiple naturalistic traffic datasets of human-driven trajectories have been published (e.g., highD, NGSim, and pNEUMA). These datasets have been used in studies that investigate variability in human driving behavior, for example for scenario-based validation of autonomous vehicle (AV) behavior, modeling driver behavior, or validating driver models. Thus far, these studies focused on the variability on an operational level (e.g., velocity profiles during a lane change), not on a tactical level (i.e., to change lanes or not). Investigating the variability on both levels is necessary to develop driver models and AV s that include multiple tactical behaviors. To expose multi-level variability, the human responses to the same traffic scene could be investigated. However, no method exists to automatically extract similar scenes from datasets. Here, we present a four-step extraction method that uses the Hausdorff distance, a mathematical distance metric for sets. We performed a case study on the highD dataset that showed that the method is practically applicable. The human responses to the selected scenes exposed the variability on both the tactical and operational levels. With this new method, the variability in operational and tactical human behavior can be investigated, without the need for costly and time-consuming driving-simulator experiments.

@en

Robotic assistance for work processes in the hospitality industry is receiving increased attention both in the hospitality industry and in academic research. Unfortunately, academic literature about hospitality robotics is currently disjointed, making it hard for hospitality professionals to decide which processes to target, and which available robotic systems would result in benefits (or limitations) for the organisation, employees or guests. Similarly, it is hard to understand what robotic functionalities need to be developed for particular processes, or what future functionalities to expect from ongoing developments in the robotics field. Researching hospitality robotics requires expertise in both fields. With this chapter, we try to give an insight in the things that should be considered when designing and evaluating the effectiveness of robots in a hospitality work environment. We do this by illustrating how robots can influence many interactions in a work environment and we present a conceptual framework for mapping these different interactions.

@en

Robotic teleoperation is used in various applications, including the nuclear industry, where the experience and intelligence of a human operator are necessary for making complex decisions that are beyond the autonomy of robots. Human-robot interfaces that help strengthen an operators situational awareness without inducing excessive cognitive load are crucial to the success of teleoperation. This paper presents a novel visual interface that allows operators to simultaneously control a 6-DoF camera platform and a robotic manipulator whilst experiencing the remote environment through a virtual reality head-mounted display (HMD). The proposed system, Orbital Head-Mounted Display (OHMD), utilizes head rotation tracking to command camera movement in azimuth and elevation directions around a fixation point located at a robot's end-effector. A human factor study was conducted to compare the interface acceptance, perceived workload, and task performance of OHMD with a conventional interface utilizing multiple fixed cameras (Array) and a standard head-mounted display implementation (HMD). Results show that both the OHMD and HMD interfaces significantly improve task performance, reduce perceived workload and increase interface acceptance compared to the Array interface. Participants reported they preferred OHMD due to the increased assistance and freedom in viewpoint selection. Whilst OHMD excelled in usefulness, the standard HMD interface allowed operators to perform robotic welding tasks significantly faster.@en

A major challenge for autonomous vehicles is handling interactions with human-driven vehicles—for example, in highway merging. A better understanding and computational modelling of human interactive behaviour could help address this challenge. However, existing modelling approaches predominantly neglect communication between drivers and assume that one modelled driver in the interaction responds to the other, but does not actively influence their behaviour. Here, we argue that addressing these two limitations is crucial for the accurate modelling of interactions. We propose a new computational framework addressing these limitations. Similar to game-theoretic approaches, we model a joint interactive system rather than an isolated driver who only responds to their environment. Contrary to game theory, our framework explicitly incorporates communication between two drivers and bounded rationality in each driver’s behaviours. We demonstrate our model’s potential in a simplified merging scenario of two vehicles, illustrating that it generates plausible interactive behaviour (e.g. aggressive and conservative merging). Furthermore, human-like gap-keeping behaviour emerged in a car-following scenario directly from risk perception without the explicit implementation of time or distance gaps in the model’s decision-making. These results suggest that our framework is a promising approach to interaction modelling that can support the development of interaction-aware autonomous vehicles.@en

Overtaking on two-lane roads can lead to increased collision risks due to drivers' errors in evaluating whether or not to accept the gap to the vehicle in the opposite lane. Understanding these gap acceptance decisions can help mitigate the risks associated with overtaking. Previous research on overtaking has focused on the factors influencing gap acceptance decisions. However, the cognitive processes underlying gap acceptance decisions remain poorly understood. Previous studies have shown that response time (i.e. the time it takes the driver to evaluate the gap and make a decision) can provide valuable insights into the cognitive processes during gap acceptance decisions, in particular in pedestrian crossing and left turn decisions. However, the more complex nature of the overtaking maneuver renders it difficult to measure response times in overtaking. As a result, response times in overtaking have not been investigated, thereby limiting our understanding of overtaking behavior. To address this gap, in this paper we propose a method to measure response time in drivers' overtaking decisions and demonstrate this method in a driving simulator experiment (N=25). Specifically, we analyzed the effect of distance to the oncoming vehicle and speed of the ego vehicle on response time in accepted and rejected gaps. We found that response times for rejected gaps were on average longer than for accepted gaps. The response times increased with the distance gap and decreased with the initial velocity of the ego vehicle. We conclude that using the proposed method for measuring response time can give insight in the way drivers make gap acceptance decisions during overtaking. These results provide basis for cognitive process models that can help further understand overtaking decisions.

@en

In this paper, we problematize popular narratives of driving automation. Whether positive or negative, these propagate simplistic assumptions about human abilities and reinforce technocratic approaches to mobility innovation. We build on narrative approaches to participatory research and adversarial design, to explore how design-led confrontation can create opportunities for reflection on implicit assumptions and narratives that stakeholders may refer to when discussing and making decisions about automated driving technologies. Specifically, we discuss the results of four focus groups where we used contestational artifacts to promote critical discussions and confront taken-for-granted beliefs among stakeholders. We reflect on the results to distill methodological insight and design recommendations for conducting adversarial participatory design research as a way towards confronting dominant narratives. Together with the methodological approach, the main contribution of this work, we also provide a set of narrative tensions that can be used to question common beliefs surrounding automated driving futures.

@en

When humans and AI-agents collaborate, they need to continuously learn about each other and the task. We propose a Team Design Pattern that utilizes adaptivity in the behavior of human and agent team partners, causing new Collaboration Patterns to emerge. Human-AI Co-Learning takes place when partners can formalize recognized patterns of collaboration in a commonly shared language, and can communicate with each other about these patterns. For this, we developed an ontology of Collaboration Patterns. An accompanying Graphical User Interface (GUI) enables partners to formalize and refine Collaboration Patterns, which can then be communicated to the partner. The ontology was evaluated empirically with human participants who viewed video recordings of joint human-agent activities. Participants were requested to identify Collaboration Patterns in the footage, and to formalize patterns by using the ontology’s GUI. Results show that the ontology supports humans to recognize and define Collaboration Patterns successfully. To improve the ontology, it is suggested to include pre- and post-conditions of tasks, as well as parallel actions of team members.

@en

Daily household tasks involve manipulation in cluttered and unpredictable environments and service robots require complex skills and adaptability to perform such tasks. To this end, we developed a teleoperated online learning approach with a novel skill refinement method, where the operator can make refinements to the initially trained skill by a haptic device. After a refined trajectory is formed, it is used to update a probabilistic trajectory model conditioned to the environment state. Therefore, the initial model can be adapted when unknown variations occur and the method is able to deal with different object positions and initial robot poses. This enables human operators to remotely correct or teach complex robotic manipulation skills. Such an approach can help to alleviate shortages of caretakers in elderly care and reduce travel time between homes of different elderly to reprogram the service robots whenever they get stuck. We performed a human factors experiment on 18 participants teaching a service robot how to empty a dishwasher, which is a common daily household task performed by caregivers. We compared the developed method against three other methods. The results show that the proposed method performs better in terms of how much time it takes to successfully adapt a model and in terms of the perceived workload.

@en

This paper studies non-physical feedback mechanisms to guide human workers toward ergonomic body postures. Specifically, the focus is to solve the tasks that involve no direct physical interaction between the human and the robotic system, therefore tactile guidance by the robot body is not feasible. We propose a multi-modal ergonomic posture guidance system that comprises visual feedback and speech-based audio feedback. We hypothesise that the proposed multi-modal system leads to better performance compared to uni-modal feedback systems when trying to guide users from one pose to another. To test the hypothesis we conducted an experiment that compared conditions with only audio feedback, only visual feedback and multi-modal feedback. In addition, we examined speech-based audio guidance in joint space and in endpoint space. The results showed that the speech-based feedback in joint space came out as the preferred audio feedback due to its ability to allow users to carry out efficient and coordinated inter-joint movements, especially in cases of high redundancy. Furthermore, the proposed multi-modal feedback system was superior compared to the other feedback modalities both in terms of objective measures and subjective measures.

@en

Modelling causal responsibility in multi-agent spatial interactions is crucial for safety and efficiency of interactions of humans with autonomous agents. However, current formal metrics and models of responsibility either lack grounding in ethical and philosophical concepts of responsibility, or cannot be applied to spatial interactions. In this work we propose a metric of causal responsibility which is tailored to multi-agent spatial interactions, for instance interactions in traffic. In such interactions, a given agent can, by reducing another agent's feasible action space, influence the latter. Therefore, we propose feasible action space reduction (FeAR) as a metric of causal responsibility among agents. Specifically, we look at ex-post causal responsibility for simultaneous actions. We propose the use of Moves de Rigueur (MdR) - a consistent set of prescribed actions for agents - to model the effect of norms on responsibility allocation. We apply the metric in a grid world simulation for spatial interactions and show how the actions, contexts, and norms affect the causal responsibility ascribed to agents. Finally, we demonstrate the application of this metric in complex multi-agent interactions. We argue that the FeAR metric is a step towards an interdisciplinary framework for quantifying responsibility that is needed to ensure safety and meaningful human control in human-AI systems.

@en