Circular Image

D.A. Abbink

info

Please Note

132 records found

Transdisciplinary Thinking around Robotic Work Futures

Robotic technologies are often proposed to relieve dull, dirty, or dangerous work, but may cause work to instead be experienced as boring, or dehumanized. Understanding the impact of robotics on the workfloor is complicated by the entanglement between emerging robotic capabilities, social dynamics, and organizational issues—which we call Worker–Robot Relations. Consequently, the impact of robotics on work is often studied in hindsight. Speculative design methodologies can facilitate alignment of robotic developments with a meaningful future of work, by creating boundary objects for communicating about current and future work practices. Making use of an unfolding artistic collaboration, we propose an experiential approach for speculating about future Worker–Robot Relations. We enabled speculative encounters between participants and robotic creatures that embody seven meta-behaviors. We abstracted these from observed behaviors in a current work context in baggage handling. We present the findings from focus groups responding to these encounters, including implications for HRI and speculative design. ...
Conference paper (2026) - Wilbert Tabone, Benedetta Lusi, Alessandro Ianniello, J. Micah Prendergast, Deborah Forster, Olger Siebinga, Dave Murray-Rust, Marco C. Rozendaal, David Abbink, More Authors
Building on two previous workshops on transdisciplinary practices for shaping worker-robot relations, this half-day workshop introduces participants to worldbuilding, a design-driven technique used to co-create and explore richly detailed futures, as a way to empower workers and scholars in reimagining plausible and preferable future worker-robot relations (WRRs). WRRs describe the interactions, collaborations, and shared practices between workers and robotic systems in organisational contexts. The workshop begins with an introduction to WRRs, and a keynote by a worldbuilding expert that will outline the method and its value for envisioning future WRRs. Groups of workshop participants will then investigate concrete case studies that demonstrate how robotic systems can support workers in their practice, with a focus on enhancing wellbeing. Through interactive activities in this workshop, participants will co-create imagined worlds of work, which will be analyzed systemically across multiple levels of complexity, from the individual worker and their immediate context to broader societal implications. The workshop ultimately aims to build a community committed to shaping sustainable futures of robot-assisted work. ...
Journal article (2026) - A. L. Ratschat, D. A. Abbink, G. M. Ribbers, L. Marchal-Crespo
Arm weight support (AWS) from upper-limb exoskeletons aids training by reducing fatigue and increasing the movement workspace, especially in people with acquired brain injury (ABI). Simultaneously, task-specific training could be enabled via haptic rendering, simulating the interaction forces with tangible virtual objects. However, how AWS affects somatosensory perception, such as the perception of the weight of haptically rendered virtual objects, is unclear. We therefore conducted a psychophysics experiment with 40 participants investigating the effect of partial AWS on virtual object weight perception during dynamic lifting. Participants performed the lifting task under two conditions: with and without AWS, where AWS compensated for 50% of their arm weight. An upperlimb exoskeleton equipped with a haptic hand module provided both AWS and haptic rendering of virtual objects. The virtual objects and a representation of the participant's arm and hand were visualized using immersive virtual reality.Weight perception was assessed using just-noticeable differences (JNDs). To evaluate the experimental setup, participants' estimated elbow torques were analyzed. Additionally, subjective measures of task load, motivation, and user experience with the exoskeleton were collected to explore potential secondary factors influencing weight perception. We found that partial AWS effectively reduced elbow load during dynamic lifting compared to no-AWS. The JND was not significantly different between conditions, suggesting that AWS does not hamper weight discrimination. However, participants with a larger self-reported sense of control over their movement and those who reported that the robot followed their movements more closely were associated with better weight perception. Our findings suggest that including haptic rendering into exoskeletons that provide partial AWS could be a viable solution to provide task-specific training. ...
The aviation sector is currently facing a growing shortage of aircraft maintenance engineers, further complicated by outdated training and assessment regulations focusing on theory and time requirements rather than competencies. In response, the industry is moving towards Competency-Based Training and Assessment, which introduces a significant shift by including transversal competencies that hold strong attitudinal elements requiring assessment through direct observation of performance. This study seeks to identify the critical success factors for training and assessing these transversal competencies within aircraft maintenance vocational education and training, leveraging principles of programmatic assessment.

A five-month action research study was conducted involving 21 students and three instructors, utilizing a previously developed training and assessment programme validated by industry stakeholders. The findings demonstrate that a programmatic assessment approach, integrating peer, self, and instructor assessments within individual assessment portfolios, is perceived as effective to develop and evaluate competence. Students report enhanced reflection, self-awareness, and competency performance. Key factors for success included the adoption of a coaching approach, the use of simulation and role-play, and the implementation of iterative assessments with formative feedback in supportive environments. Additionally, instructors benefited from applying the ORCA (Observe, Record, Classify, Assess) method and undertaking further training in holistic group assessment. ...
Journal article (2026) - Alexandre L. Ratschat, Beatrice Luciani, David A. Abbink, Gerard M. Ribbers, Laura Marchal-Crespo
Advances in haptic technologies enable rich, multi-channel haptic rendering of interactions with virtual objects during virtual reality training. However, it remains an open question whether multi-channel haptic rendering (kinesthetic and tactile) provides superior motor learning and transfer when training dynamic tasks compared to simpler, single-channel sensory information. We investigated how 40 participants learned to invert and balance a virtual pendulum after training under four haptic rendering conditions: congruent kinesthetic and tactile rendering, kinesthetic rendering alone, tactile rendering alone, and no haptic rendering. Kinesthetic information was delivered through a delta robot, and tactile information through a two-dimensional skin-stretch device at the finger pads. Participant performance was measured in catch trials during training, in short- and long-term retention trials, and with a transfer task with a shorter pendulum. Participants from all four training conditions demonstrated the ability to improve and transfer their skills. However, we observed poorer performance during catch trials when training with reduced or absent haptic rendering compared to training with congruent kinesthetic and tactile rendering. The advantage of congruent haptic rendering over conditions lacking kinesthetic rendering was maintained during short-term retention, whereas no significant performance differences were observed between conditions in long-term retention and the transfer task. These results suggest that congruent haptic rendering benefits the task's early learning by supporting the generation of internal models of the task dynamics, with kinesthetic rendering playing a major role. Overall, our findings highlight the potential benefits of multi-channel haptic rendering to accelerate virtual reality training. ...
Force perturbations during gait training can increase movement variability, which may support motor exploration and learning. However, when such perturbations are delivered through a robotic exoskeleton, they can also reduce perceived exoskeleton transparency, potentially hindering user acceptance. We tested whether visualizing continuous upper leg-level perturbations in immersive virtual reality (VR) could preserve their variability-enhancing effect while mitigating the cost to perceived transparency in a pelvis-centered walking task. Thirty healthy adults walked on a treadmill while wearing a robotic exoskeleton and performed a ball-in-cup task, requiring continuous mediolateral control of the pelvis. Participants trained under one of three conditions: Control (no perturbations), Perturbation (continuous noise-like multisine forces applied at the thighs), or Perturbation + Visual (same forces with a real-time, body-referenced force-beam visualization). Step-width variability was evaluated during Training. Task performance, intrinsic motivation, and perceived transparency were assessed across Baseline, Training, Retention, and a faster-speed Transfer test (120% of preferred speed). Both perturbation conditions significantly increased step-width variability during Training relative to Control, with no detectable difference between Perturbation and Perturbation + Visual. Task performance improved from Baseline to Retention and Transfer across all conditions, with no significant differences across conditions. Motivation did not differ between conditions either. Critically, perceived transparency decreased only in the non-visualized Perturbation condition and remained stable in both Control and Perturbation + Visual. Our results show that continuous leg-level perturbations reliably enrich lateral gait variability and that simple visual force cues can prevent a perceived transparency cost without compromising the variability manipulation. Future work should test adaptive dosing, multi-session training, and clinical cohorts with impaired lateral stability. ...
Despite recent advancements in physical humanrobot collaboration, measuring and distinguishing between forces applied by humans and robots remains challenging, limiting our understanding of force dynamics during collaboration. Our proposed solution addresses this gap with a low-cost, lightweight design that integrates directly at the robot endeffector level. The interface employs a three-ring mechanical structure with strategically positioned load cells and a Sarrus mechanism to constrain movement to the z-axis only, enabling tool mounting for real-world collaborative tasks such as blending or sanding operations. Validation experiments demonstrate excellent force decoupling capabilities with minimal crossinterference, achieving Weighted Root Mean Squared Errors of 0.14 N for robot-applied forces and 0.08 N for human-applied forces compared to ground truth measurements in steadystate for loads ranging from 0 N up to 23 N. The Maximum Absolute Error in these experiments is 0.33 N, confirming high measurement accuracy. This affordable and integrated solution lowers the threshold for employing decoupled force sensing in collaborative tasks, making it more accessible for investigating force dynamics and developing adaptive control strategies in both research and practical applications of physical humanrobot collaboration. ...

Potential Fields Using Active Lateral Forces Enhance Touch Interactions

Conference paper (2025) - Zhaochong Cai, David Abbink, Michaël Wiertlewski
Touchscreens and touchpads offer intuitive interfaces but provide limited tactile feedback, usually just mechanical vibrations. These devices lack continuous feedback to guide users’ fingers toward specific directions. Recent innovations in surface haptic devices, however, leverage ultrasonic traveling waves to create active lateral forces on a bare fingertip. This paper investigates the effects and design possibilities of active forces feedback in touch interactions by rendering artificial potential fields on a touchpad. Three user studies revealed that: (1) users perceived attractive and repulsive fields as bumps and holes with similar detection thresholds; (2) step-wise force fields improved targeting by 22.9% compared to friction-only methods; and (3) active force fields effectively communicated directional cues to the users. Several applications were tested, with user feedback favoring this approach for its enhanced tactile experience, added enjoyment, realism, and ease of use. ...
Combining biomechanical modeling with robotic physiotherapy is a promising direction to provide real-time insights during the rehabilitation of patients with musculoskeletal injuries, such as rotator-cuff tears. One aspect is to prevent re-injuries caused by high strain in the injured tissues while allowing patients to perform the required rehabilitation exercises. In this paper, we propose a novel shared control method for robots to limit unsafe patient movements, through physical guidance based on a strain-space representation of the human rotator cuff. The method provides motion corrections through two complementary predictive modules. The first module exerts a lower degree of intervention and is analogous to rumble strips or speed bumps for cars on the road. In this case, an impedance controller induces variable damping to slow down the patient's movement when a danger zone is approached. The second module produces a higher degree of intervention and is analogous to lane-assist in cars. In this case, the robot plans an optimal deflection trajectory and temporarily takes over control of the movement to avoid an unsafe situation. We performed experiments with a healthy participant acting as a patient and evaluated the effect of different human-robot interaction modalities on the resulting human movement in terms of avoidance of high-strain areas of the rotator-cuff tendons and contact forces exchanged. ...
Journal article (2025) - Laurence Willemet, Felix Roël, David Abbink, Ingvars Birznieks, Michaël Wiertlewski
Abstract: A task as simple as holding a cup between your fingers generates complex motor commands to finely regulate the forces applied by muscles. These fine force adjustments ensure the stability and integrity of the object by preventing it from slipping out of grip during manipulation and by reacting to perturbations. To do so, our sensorimotor system constantly monitors tactile and proprioceptive information about the force object exerts on fingertips and the friction of the surfaces to determine the optimal grip force. While the literature describes the transient responses, humans can generate to react to perturbations in load force, it is yet to be determined if humans can also react to abrupt changes in friction while already holding an object. Only recently technology using imperceivable ultrasonic vibrations became available to modulate friction in real time to investigate this question. In this study, we used an object with an integrated friction modulation device suspended in a pulley system controlling the load. With this device, we explored the rapid adaptation of the sensorimotor system to changes in friction alone and in combination with changes in load. When load force and friction changed simultaneously, the grip force response was regulated based on the grip safety requirements. Participants increased their grip force in response to decrease in friction. However, they did not adjust their grip force when the friction increased, which is expected based on our biomechanical model of friction sensing mechanisms. (Figure presented.). Key points: Simple tasks like pouring water into a glass mobilize intricate interactions between fingertip sensory inputs and motor commands to account for the weight change and friction. It has been investigated how humans react to force perturbations when holding an object, but very little is known about how frictional changes are sensed and acted upon while holding an object, for example, due to sweating or condensation. We engineered a unique experimental object that utilizes imperceivable ultrasonic vibrations to change the frictional properties of the surface in a few milliseconds. This apparatus enabled us to study how human subjects react to change of friction when gripping or holding an object. We showed that humans adjust the strength of their grasp when forces in the direction of gravity either increase or decrease; however, frictional change evokes adjustments only when friction decreases. ...
Gait variability, the subtle fluctuations in walking patterns, is crucial for adaptation and motor learning. While existing methods to increase gait variability often rely on force-based perturbations, these can reduce motivation. This study explored if a subtle visual feedback distortion (VFD), applied to a first-person avatar's foot position in an immersive virtual reality environment, could increase gait variability without such a drawback. Twenty healthy adults walked on a treadmill wearing a head-mounted display and motion trackers, performing a stepping task under two conditions: with and without VFD. The VFD introduced a continuously changing, noise-like offset to the displayed foot positions, designed to be minimally noticeable. We quantified gait variability through the standard deviation of step width and step length and collected self-report measures on embodiment, motivation, and simulator sickness. We found that VFD significantly increased step width variability by about 15%, indicating enhanced lateral adaptability. In contrast, step length variability remained unchanged. Participants adjusted their foot placement in the opposite direction of the visual distortion, supporting the idea that proprioceptive recalibration underpinned the observed changes. Notably, this increase in variability occurred without any significant effects on embodiment, motivation, or simulator sickness. These findings suggest that subtle VFD can enhance gait variability - potentially facilitating motor learning and adaptability - while preserving user experience and motivation. Future research should determine whether such VFD-based interventions yield lasting functional improvements and investigate their applicability in rehabilitation contexts, potentially offering a noninvasive, user-friendly approach to promoting healthy gait dynamics. ...
Journal article (2025) - N. Mol, J.M. Prendergast, David Abbink, L. Peternel
In this letter, we investigate whether classical function allocation—the principle of assigning tasks to either a human or a machine—holds for physical Human-Robot Collaboration, which is important for providing insights for Industry 5.0 to guide how to best augment rather than replace workers. This study empirically tests the applicability of Fitts' List within physical Human-Robot Collaboration, by conducting a user study (N=26, within-subject design) to evaluate four distinct allocations of position/force control between human and robot in an abstract blending task. We hypothesize that the function in which humans control the position achieves better performance and receives higher user ratings. When allocating position control to the human and force control to the robot, compared to the opposite case, we observed a significant improvement in preventing overblending. This was also perceived better in terms of physical demand and overall system acceptance, while participants experienced greater autonomy, more engagement and less frustration. An interesting insight was that the supervisory role (when the robot controls both position and force) was rated second best in terms of subjective acceptance. Another surprising insight was that if position control was delegated to the robot, the participants perceived much lower autonomy than when the force control was delegated to the robot. These findings empirically support applying Fitts' principles to static function allocation for physical collaboration, while also revealing important nuanced user experience trade-offs, particularly regarding perceived autonomy when delegating position control. ...
This paper presents a multi-modal dynamic workspace re-indexing method for addressing operator ergonomics and workspace limitations. The proposed method has two interactive modes: pose-to-pose mode, which is active when the operator is within an ergonomic workspace of comfortable arm postures, and ergonomic workspace drift mode, which activates after the operator makes an excursion beyond the boundaries of the ergonomic workspace when trying to reach more distant targets with the remote robot. In the ergonomic workspace drift mode, the operator temporarily stays slightly outside these boundaries, while the offset between the local and remote workspace drifts with a velocity proportional to the excursion distance. This dynamically re-indexes the remote workspace toward the distant target, and the operator can remain in a comfortable posture while the remote robot moves toward the intended target where the task is. To construct the ergonomic workspace, we employed the Rapid Upper Limb Assessment method. To validate the proposed method, we conducted experiments on a teleoperation setup involving a Force Dimension Sigma7 haptic device controlling a Kuka LBR iiwa robotic arm. The results show that the proposed controller successfully addresses workspace limitations by dynamically reindexing the follower's workspace towards target objects, while maintaining good operator ergonomics. ...
Journal article (2024) - Olger Siebinga, Arkady Zgonnikov, David A. Abbink
Traffic interactions between merging and highway vehicles are a major topic of research, yielding many empirical studies and models of driver behaviour. Most of these studies on merging use naturalistic data. Although this provides insight into human gap acceptance and traffic flow effects, it obscures the operational inputs of interacting drivers. Besides that, researchers have no control over the vehicle kinematics (i.e., positions and velocities) at the start of the interactions. Therefore the relationship between initial kinematics and the outcome of the interaction is difficult to investigate. To address these gaps, we conducted an experiment in a coupled driving simulator with a simplified, top-down view, merging scenario with two vehicles. We found that kinematics can explain the outcome (i.e., which driver merges first) and the duration of the merging conflict. Furthermore, our results show that drivers use key decision moments combined with constant acceleration inputs (intermittent piecewise-constant control) during merging. This indicates that they do not continuously optimise their expected utility. Therefore, these results advocate the development of interaction models based on intermittent piecewise-constant control. We hope our work can contribute to this development and to the fundamental knowledge of interactive driver behaviour. ...
Journal article (2024) - A. van den Berg, Jelle Hofland, Cock J.M. Heemskerk, David Abbink, L. Peternel
In recent years, providing additional visual feedback about the interaction forces has been found to offer benefits to haptic-assisted teleoperation. However, there is limited insight into the effects of the design of force feedback-related visual cues and the type of visual display on the performance of teleoperation of robotic arms executing industrial tasks. In this study, we provide new insights into this interaction by extending these findings to the haptic assistance teleoperation of a simulated robotic arm in a virtual environment, in which the haptic assistance is comprised of a set of virtual fixtures. We design a novel method for providing visual cues about the interaction forces to complement the haptic assistance and augment visual feedback in virtual reality with a head-mounted display. We evaluate the visual cues method and head-mounted display method through human factors experiments in a teleoperated dross removal use case. The results show that both methods are beneficial for task performance, each of them having stronger points in different aspects of the operation. The visual cues method was found to significantly improve safety in terms of peak collision force, whereas the head-mounted display additionally improves the performance significantly. Furthermore, positive scores of the subjective analysis indicate an increased user acceptance of both methods. This work provides a new study on the importance of visual feedback related to (interaction) forces and spatial information for haptic assistance and provides two methods to take advantage of its potential benefits in the teleoperation of robotic arms. ...
Journal article (2024) - Olger Siebinga, Arkady Zgonnikov, David A. Abbink
Safe and socially acceptable interactions with human-driven vehicles are a major challenge in automated driving. A good understanding of the underlying principles of such traffic interactions could help address this challenge. Particularly, accurate driver models could be used to inform automated vehicles in interactions. These interactions entail complex dynamic joint behaviors composed of individual driver contributions in terms of high-level decisions, safety margins, and low-level control inputs. Existing driver models typically focus on one of these aspects, limiting our understanding of the underlying principles of traffic interactions. Here, we present a Communication-Enabled Interaction model based on risk perception, that does not assume humans are rational and explicitly accounts for communication between drivers. Our model can explain and reproduce observed human interactions in a simplified merging scenario on all three levels. Thereby improving our understanding of the underlying mechanisms of human traffic interactions and posing a step towards interaction-aware automated driving. ...

Empirical evidence and computational cognitive modeling

Understanding behavior of human drivers in interactions with automated vehicles (AV) can aid the development of future AVs. Existing investigations of such behavior have predominantly focused on situations in which an AV a priori needs to take action because the human has the right of way. However, future AVs might need to proactively manage interactions even if they have the right of way over humans, e.g., a human driver taking a left turn in front of the approaching AV. Yet it remains unclear how AVs could behave in such interactions and how humans would react to them. To address this issue, here we investigated behavior of human drivers (N = 19) when interacting with an oncoming AV during unprotected left turns in a driving simulator experiment. We measured the outcomes (Go or Stay) and timing of participants’ decisions when interacting with an AV which performed subtle longitudinal nudging maneuvers, e.g. briefly decelerating and then accelerating back to its original speed. We found that participants’ behavior was sensitive to deceleration nudges but not acceleration nudges. We compared the obtained data to predictions of several variants of a drift-diffusion model of human decision making. The most parsimonious model that captured the data hypothesized noisy integration of dynamic information on time-to-arrival and distance to a fixed decision boundary, with an initial accumulation bias towards the Go decision. Our model not only accounts for the observed behavior but can also flexibly generate predictions of human responses to arbitrary longitudinal AV maneuvers, and can be used for both informing future studies of human behavior and incorporating insights from such studies into computational frameworks for AV interaction planning. ...
Book chapter (2024) - David Abbink, Daniele Amoroso, L. Cavalcante Siebert, M.J. van den Hoven, Giulio Mecacci, F. Santoni De Sio
This handbook presents the concept of ‘meaningful human control’ (MHC) over AI systems from the perspectives of (i) philosophy and ethics, (ii) law and governance, and (iii) design and engineering. The introductory chapter addresses the motivations and recent developments in MHC, introducing each perspective and related chapters. These three disciplinary perspectives scrutinize how MHC intertwines with philosophical debates on moral responsibility, societal concerns regarding control over technological advancements in legal frameworks, and the engineering complexities of designing and developing AI systems while ensuring human control and responsibility. Additionally, cross-cutting aspects on MHC over AI systems are also introduced and discussed through (iv) interdisciplinary and systemic perspectives. By offering a contextualized introduction to the perspectives considered in this handbook, this chapter aims to present the handbook’s various approaches and points of interest for a diverse audience, highlighting potential entry points into this multidisciplinary volume. ...

Requirements, Method, and Test With Handover Task

Journal article (2024) - Emma M. Van Zoelen, Hugo Veldman-Loopik, Karel van den Bosch, Mark Neerincx, David A. Abbink, Luka Peternel
Despite a large body of research on robot learning, it has not yet been thoroughly studied how collaborating humans and robots learn reciprocally. In such situations, both humans and robots continuously learn about each other and the task through interaction. This letter addresses the research question: "How can human-robot co-learning be facilitated in physically embodied collaborative tasks?". First, we derived five requirements for successful human-robot co-learning from literature: shared goal, synchrony, interdependence, adaptability, and transparency. Based on these requirements, we designed a collaborative human-robot handover task and a robot Q-learning method. In an evaluation with six human participants co-learning was indeed found to emerge in the hand-over task. Particularly, for three of the human-robot dyads, our designed setup proved to facilitate co-learning in a way that met all five requirements. The task and robot learning method presented in this letter demonstrate how human-robot co-learning can be enabled in physically embodied tasks. ...

Enabling Autonomous Vehicles with the Principle of Least Action

Journal article (2024) - Heye Huang, Yicong Liu, Jinxin Liu, Qisong Yang, Jianqiang Wang, David Abbink, Arkady Zgonnikov
This study presents a general optimal trajectory planning (GOTP) framework for autonomous vehicles (AVs) that can effectively avoid obstacles and guide AVs to complete driving tasks safely and efficiently. Firstly, we employ the fifth-order Bezier curve to generate and smooth the reference path along the road centerline. Cartesian coordinates are then transformed to achieve the curvature continuity of the generated curve. Considering the road constraints and vehicle dynamics, limited polynomial candidate trajectories are generated and smoothed in a curvilinear coordinate system. Furthermore, in selecting the optimal trajectory, we develop a unified and auto-tune objective function based on the principle of least action by employing AVs to simulate drivers’ behavior and summarizing their manipulation characteristics of “seeking benefits and avoiding losses.” Finally, by integrating the idea of receding-horizon optimization, the proposed framework is achieved by considering dynamic multi-performance objectives and selecting trajectories that satisfy feasibility, optimality, and adaptability. Extensive simulations and experiments are performed, and the results demonstrate the framework's feasibility and effectiveness, which avoids both dynamic and static obstacles and applies to various scenarios with multi-source interactive traffic participants. Moreover, we prove that the proposed method can guarantee real-time planning and safety requirements compared to drivers’ manipulation. ...