Selected robotics papers from arXiv! 👏👏👏
#Robotics
EMMA: Expanding Mobile Manipulation through Self-Centric Human Data
Date: September 4, 2025
Authors: Lawrence Y. Zhu, Pranav Kuppili, Ryan Punamiya, Patcharapong Aphiwetsa, Dhruv Patel, Simar Kareer, Sehoon Ha, Danfei Xu
Link: http://arxiv.org/abs/2509.04443v1The expansion of imitation learning for mobile robot manipulation is limited by the expensive remote operation of mobile robots. We propose the Self-Centric Mobile Manipulation (EMMA) framework, an end-to-end framework that trains mobile manipulation policies using static robot data, thus avoiding mobile remote operation. To achieve this, we jointly train human full-body motion data with static robot data. In our three practical task experiments, EMMA demonstrates performance comparable to the baseline trained on remotely operated mobile robot data (Mobile ALOHA), achieving higher or equivalent task performance in terms of overall task success. We find that EMMA can generalize to new spatial configurations and scenarios, and as the hours of human data increase, we observe positive performance scaling, opening new avenues for scalable robot learning in real environments. Detailed information about the project can be found at https://ego-moma.github.io/.
DEXOP: A Device for Robotic Execution of Dexterous Hand Manipulations
Date: September 4, 2025
Authors: Hao-Shu Fang, Branden Romero, Yichen Xie, Arthur Hu, Bo-Ruei Huang, Juan Alvarez, Matthew Kim, Gabriel Margolis, Kavya Anbarasu, Masayoshi Tomizuka, Edward Adelson, Pulkit Agrawal
Link: http://arxiv.org/abs/2509.04441v1We introduce perioperation, a paradigm for robotic data collection that maximizes data transferability by sensorizing and recording human operations for real robots. We realize this paradigm through DEXOP, a passive hand exoskeleton designed to maximize the ability of humans to collect rich sensory (visual + haptic) data for various dexterous manipulation tasks in natural environments. DEXOP connects human fingertips to robotic fingertips through mechanical linkage, providing users with direct contact feedback (via proprioception) and mirroring human hand postures onto the passive robotic hand to maximize the transfer of demonstrated skills to the robot. Force feedback and posture mirroring make task demonstrations more natural for humans than teleoperation, thereby improving speed and accuracy. We evaluate DEXOP’s performance across a range of dexterous, contact-rich tasks, demonstrating its capability to collect high-quality demonstration data at scale. Strategies learned from DEXOP data significantly improve task performance per unit time compared to teleoperation, making DEXOP a powerful tool for enhancing robotic dexterity. Our project page is at https://dex-op.github.io.
SAFE–MA–RRT: Multi-Agent Motion Planning with Data-Driven Safety Certificates
Date: September 4, 2025
Authors: Babak Esmaeili, Hamidreza Modares
Link: http://arxiv.org/abs/2509.04413v1This paper presents a fully data-driven motion planning framework for homogeneous linear multi-agent systems operating in shared, obstacle-filled workspaces that do not have access to explicit system models. Each agent independently learns its closed-loop behavior from experimental data by solving convex semidefinite programs to generate local invariant ellipsoids and corresponding state feedback gains. These ellipsoids are centered around grid-based waypoints, ensuring dynamic feasibility for short-range transitions and defining safe regions for operation. A sampling-based planner constructs a waypoint tree such that transitions are only allowed when adjacent ellipsoids overlap, ensuring invariant-to-invariant transitions and continuous safety. All agents simultaneously expand their trees and coordinate through a spatiotemporal reservation table that guarantees safety between agents by preventing simultaneous occupancy and head-on collisions. Each successful edge in the tree is equipped with its own local controller, allowing execution without re-solving optimization problems at runtime. The generated trajectories are not only dynamically feasible but also provably safe concerning environmental constraints and inter-agent collisions. Simulation results demonstrate that the method effectively synthesizes synchronized, safe trajectories for multiple agents under shared dynamics and constraints using only data and convex optimization tools.
Control Barrier Function Synthesis Using Equivariance and Symmetry
Date: September 4, 2025
Authors: Adrian Wiltz, Dimos V. Dimarogonas
Link: http://arxiv.org/abs/2509.04399v1The synthesis of control barrier functions (CBFs) often involves complex computations or meticulous constructions. However, the structural properties of system dynamics and constraints can alleviate these challenges. In this paper, we explore how to leverage the equivariance of dynamics in CBF synthesis, which can be roughly understood as a form of symmetry. Although CBFs themselves typically do not possess inherent symmetry, we show how the equivariance in dynamics and symmetry in constraints can induce symmetry in CBFs through reachability analysis. This insight allows us to infer CBF values over the entire domain from values on subsets, leading to significant computational savings. Interestingly, equivariance can even be utilized in CBF synthesis for asymmetric constraints. Specifically, we demonstrate how to construct CBFs applicable to various new constraints using partially known CBFs in conjunction with equivariance. Throughout the paper, we provide examples illustrating the theoretical findings. Additionally, a numerical study investigates the computational gains of introducing equivariance into CBF synthesis.
The Impact of Infinite Computational Power in OBLOT: Implications for Synchronous Robots on Graphs
Date: September 4, 2025
Authors: Serafino Cicerone, Alessia Di Fonso, Gabriele Di Stefano, Alfredo Navarra
Link: http://arxiv.org/abs/2509.04383v1In theoretical swarm robotics, the OBLOT model has been widely studied. It assumes that the mobile robots involved have weak capabilities, such as being anonymous, disoriented, lacking memory of past events (forgetting), and being silent. Their only (implicit) means of communication is through their positions, i.e., trace information. These limited capabilities make the design of distributed algorithms a challenging task. Over the past two decades, many research papers have addressed the question of what tasks can be accomplished in this model. However, as is often the case in distributed computing, the computational power of robots in OBLOT has been overlooked, as the primary cost metric for designing algorithms is the number of moves or rounds required. In this paper, we prove that infinite computational power (beyond finite time) has significant implications for synchronous robots moving on finite graphs. In fact, by leveraging it, we provide a final solution algorithm applicable to a wide class of problems while guaranteeing minimal moves and rounds.
Privacy Awareness in Robot-Assisted Health Coaching: Examining the Role of Information Transparency, User Control, and Proactivity
Date: September 4, 2025
Authors: Atikkhan Faridkhan Nilgar, Manuel Dietrich, Kristof Van Laerhoven
Link: http://arxiv.org/abs/2509.04358v1Social robots are increasingly recognized as valuable supporters in the field of wellness coaching. They can serve as independent coaches or provide support alongside human coaches and healthcare professionals. In coaching interactions, these robots often handle sensitive information shared by users, making privacy a relevant issue. Nevertheless, little is known about the factors that shape users’ privacy perceptions. This study aims to systematically examine three key factors: (1) the transparency of information use; (2) the specific level of control users have over how the robot uses their information; (3) the robot’s behavioral approach—whether it acts proactively or merely responds to demands. Results from an online study (N = 200) indicate that even when users grant robots overall access to personal data, they still expect to have explicit control over how that information is interpreted and shared during interactions. Experimental conditions that provided such control received significantly higher ratings in perceived privacy appropriateness and trust. Compared to user control, the effects of transparency and proactivity on perceived privacy appropriateness were lower, and we found no significant effects. The results suggest that merely informing users or proactively sharing information is insufficient without accompanying user control. These insights highlight the need for further research into mechanisms that allow users to manage the information processing and sharing of robots, especially as social robots take on more proactive roles in assisting humans.
SRWToolkit: An Open-Source Oz Wizard Toolkit for Creating Social Robot Avatars
Date: September 4, 2025
Authors: Atikkhan Faridkhan Nilgar, Kristof Van Laerhoven, Ayub Kinoti
Link: http://arxiv.org/abs/2509.04356v1We introduce SRWToolkit, an open-source Oz Wizard toolkit designed to simplify the rapid prototyping of social robot avatars driven by local large language models (LLMs). Our web-based toolkit enables multimodal interaction through text input, button-activated speech, and wake word commands. The toolkit provides an intuitive dashboard for real-time configuration of the avatar’s appearance, behavior, language, and voice. Compared to previous work relying on cloud-based LLM services, SRWToolkit emphasizes modularity and ensures functionality on-device through local LLM inference. In our small-scale user study (n=11), participants created interactions with various robot roles (hospital receptionist, math teacher, and driving assistant), demonstrating positive outcomes in usability, trust, and user experience. The toolkit enables the rapid and efficient development of robot roles that meet researchers’ needs, supporting scalable research in human-robot interaction.
OVGrasp: An Open-Vocabulary Grasping Assistance System Based on Multimodal Intent Detection
Date: September 4, 2025
Authors: Chen Hu, Shan Luo, Letizia Gionfrida
Link: http://arxiv.org/abs/2509.04324v1Grasping assistance is crucial for restoring autonomy to individuals with motor impairments, especially in unstructured environments where object categories and user intentions are diverse and unpredictable. We propose OVGrasp, a hierarchical control framework for soft exoskeleton grasping assistance that integrates RGB-D vision, open-vocabulary prompts, and voice commands for robust multimodal interaction. To enhance generalization in open environments, OVGrasp incorporates a vision-language foundation model with an open vocabulary mechanism, allowing zero-shot detection of previously unseen objects without retraining. A multimodal decision-maker further fuses spatial and linguistic cues to infer user intentions, such as inferring grasping or releasing actions in multi-object scenarios. We deployed the complete framework on a custom self-centered perspective wearable exoskeleton and systematically evaluated it on 15 objects across three grasp types. Experimental results from ten participants indicate that OVGrasp achieved an 87.00% grasp ability score (GAS), outperforming state-of-the-art baselines and achieving better kinematic alignment with natural hand movements.
Compatibility of Multiple Control Barrier Functions in Constrained Nonlinear Systems
Date: September 4, 2025
Authors: Max H. Cohen, Eugene Lavretsky, Aaron D. Ames
Link: http://arxiv.org/abs/2509.04220v1Control barrier functions (CBFs) are powerful tools for controlling constrained nonlinear systems; however, most results in the literature focus on systems constrained by a single CBF, making it challenging to synthesize safe controllers that can handle multiple state constraints. This paper presents a framework for constrained control of nonlinear systems subject to box constraints on vector-valued outputs using multiple CBFs. Our results show that when the outputs have vector relative degrees, the CBF constraints encoding these box constraints are compatible, and the optimization-based controller is locally Lipschitz continuous and has a closed-form expression. Additional results are presented to describe the degradation of nominal tracking objectives in the presence of safety constraints. Simulations on planar multirotor vehicles are also demonstrated to validate the effectiveness of the proposed framework.
Real-Time FPGA-Based CNNs for Detection, Classification, and Tracking in Autonomous Systems: Recent Design Optimizations
Date: September 4, 2025
Authors: Safa Mohammed Sali, Mahmoud Meribout, Ashiyana Abdul Majeed
Link: http://arxiv.org/abs/2509.04153v1This paper provides a comprehensive review of recent advancements in deploying convolutional neural networks (CNNs) on field-programmable gate arrays (FPGAs) for object detection, classification, and tracking. With the increasing demand for real-time computer vision applications in areas such as autonomous vehicles, robotics, and surveillance, FPGAs have emerged as a strong alternative to GPUs and ASICs due to their reconfigurability, low power consumption, and deterministic latency. We critically analyze the latest FPGA implementations for CNN-based vision tasks, including algorithmic innovations, hardware acceleration techniques, and integrated optimization strategies such as pruning, quantization, and sparse-aware methods to maximize performance under hardware constraints. The survey also discusses the landscape of modern FPGA platforms, including LUT-DSP-based classical architectures, system-on-chip (SoC) FPGAs, and adaptive compute acceleration platforms (ACAPs), comparing their capabilities for handling deep learning workloads. Additionally, we review available software development tools such as Vitis AI, FINN, and Intel FPGA AI Suite, which greatly simplify the design and deployment of AI models on FPGAs. The paper uniquely discusses hybrid architectures that combine GPUs and FPGAs for collaborative acceleration of AI inference and addresses issues related to energy efficiency and throughput. Furthermore, we emphasize hardware-software co-design practices, dataflow optimization, and pipelining techniques that are crucial for real-time inference on resource-constrained devices. Through this survey, researchers and engineers will gain insights into developing the next generation of energy-efficient and high-performance vision systems optimized for FPGA deployment in edge and embedded applications.