An analysis of the role of different levels of exchange of explicit information in human–robot cooperation

For smooth human–robot cooperation, it is crucial that robots understand social cues from humans and respond accordingly. Contextual information provides the human partner with real-time insights into how the robot interprets social cues and what action decisions it makes as a result. We propose and...

Full description

Saved in:
Bibliographic Details
Main Authors: Ane San Martin, Johan Kildal, Elena Lazkano
Format: Article
Language:English
Published: Frontiers Media S.A. 2025-02-01
Series:Frontiers in Robotics and AI
Subjects:
Online Access:https://www.frontiersin.org/articles/10.3389/frobt.2025.1511619/full
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1823860927190007808
author Ane San Martin
Johan Kildal
Elena Lazkano
author_facet Ane San Martin
Johan Kildal
Elena Lazkano
author_sort Ane San Martin
collection DOAJ
description For smooth human–robot cooperation, it is crucial that robots understand social cues from humans and respond accordingly. Contextual information provides the human partner with real-time insights into how the robot interprets social cues and what action decisions it makes as a result. We propose and implement a novel design for a human–robot cooperation framework that uses augmented reality and user gaze to enable bidirectional communication. Through this framework, the robot can recognize the objects in the scene that the human is looking at and infer the human’s intentions within the context of the cooperative task. We proposed three levels of exchange of explicit information designs, each providing increasingly more information. These designs enable the robot to offer contextual information about what user actions it has identified and how it intends to respond, which is in line with the goal of cooperation. We report a user study (n = 24) in which we analyzed the performance and user experience with the three different levels of exchange of explicit information. Results indicate that users preferred an intermediate level of exchange of information, in which users knew how the robot was interpreting their intentions, but where the robot was autonomous to take unsupervised action in response to gaze input from the user, needing a less informative action from the human’s side.
format Article
id doaj-art-e9e8b8e5741a49bbb4e9f66563939de4
institution Kabale University
issn 2296-9144
language English
publishDate 2025-02-01
publisher Frontiers Media S.A.
record_format Article
series Frontiers in Robotics and AI
spelling doaj-art-e9e8b8e5741a49bbb4e9f66563939de42025-02-10T08:53:50ZengFrontiers Media S.A.Frontiers in Robotics and AI2296-91442025-02-011210.3389/frobt.2025.15116191511619An analysis of the role of different levels of exchange of explicit information in human–robot cooperationAne San Martin0Johan Kildal1Elena Lazkano2Department of Autonomous and Intelligent Systems, Tekniker, Eibar, SpainDepartment of Autonomous and Intelligent Systems, Tekniker, Eibar, SpainFaculty of Informatics, University of the Basque Country (UPV/EHU), Bilbao, SpainFor smooth human–robot cooperation, it is crucial that robots understand social cues from humans and respond accordingly. Contextual information provides the human partner with real-time insights into how the robot interprets social cues and what action decisions it makes as a result. We propose and implement a novel design for a human–robot cooperation framework that uses augmented reality and user gaze to enable bidirectional communication. Through this framework, the robot can recognize the objects in the scene that the human is looking at and infer the human’s intentions within the context of the cooperative task. We proposed three levels of exchange of explicit information designs, each providing increasingly more information. These designs enable the robot to offer contextual information about what user actions it has identified and how it intends to respond, which is in line with the goal of cooperation. We report a user study (n = 24) in which we analyzed the performance and user experience with the three different levels of exchange of explicit information. Results indicate that users preferred an intermediate level of exchange of information, in which users knew how the robot was interpreting their intentions, but where the robot was autonomous to take unsupervised action in response to gaze input from the user, needing a less informative action from the human’s side.https://www.frontiersin.org/articles/10.3389/frobt.2025.1511619/fullhuman–robot collaborationbidirectional communicationsituation awarenesssocial signal processinguser experienceuser study
spellingShingle Ane San Martin
Johan Kildal
Elena Lazkano
An analysis of the role of different levels of exchange of explicit information in human–robot cooperation
Frontiers in Robotics and AI
human–robot collaboration
bidirectional communication
situation awareness
social signal processing
user experience
user study
title An analysis of the role of different levels of exchange of explicit information in human–robot cooperation
title_full An analysis of the role of different levels of exchange of explicit information in human–robot cooperation
title_fullStr An analysis of the role of different levels of exchange of explicit information in human–robot cooperation
title_full_unstemmed An analysis of the role of different levels of exchange of explicit information in human–robot cooperation
title_short An analysis of the role of different levels of exchange of explicit information in human–robot cooperation
title_sort analysis of the role of different levels of exchange of explicit information in human robot cooperation
topic human–robot collaboration
bidirectional communication
situation awareness
social signal processing
user experience
user study
url https://www.frontiersin.org/articles/10.3389/frobt.2025.1511619/full
work_keys_str_mv AT anesanmartin ananalysisoftheroleofdifferentlevelsofexchangeofexplicitinformationinhumanrobotcooperation
AT johankildal ananalysisoftheroleofdifferentlevelsofexchangeofexplicitinformationinhumanrobotcooperation
AT elenalazkano ananalysisoftheroleofdifferentlevelsofexchangeofexplicitinformationinhumanrobotcooperation
AT anesanmartin analysisoftheroleofdifferentlevelsofexchangeofexplicitinformationinhumanrobotcooperation
AT johankildal analysisoftheroleofdifferentlevelsofexchangeofexplicitinformationinhumanrobotcooperation
AT elenalazkano analysisoftheroleofdifferentlevelsofexchangeofexplicitinformationinhumanrobotcooperation