Benchmarking Obstacle-Conditioned Safety in Household Robot Navigation
Abstract
The study introduces a benchmark and metric to evaluate whether robot navigation policies adapt continuous motion to obstacle safety semantics, revealing a gap in translating semantic caution into safe movement.
Safe household navigation requires robots to regulate clearance and speed according to what an obstacle is and how close it is, without unnecessary conservatism. Yet existing evaluations do not test whether semantic safety distinctions are reflected in continuous motion. To that end, we introduce OSMA-Bench, an Obstacle-Conditioned Safe Motion Adaptation Benchmark built on spatially matched scenario sets that differ only in obstacle type. We also propose the Semantic Sensitivity Index (SSI), which measures whether clearance and distance-dependent speed and smoothness follow the caution ordering of obstacles. Evaluating VLM-based and vision-language-action (VLA) policies on the benchmark, we find that neither consistently adapts its motion to obstacle safety, even with explicit safety prompts. Our analysis shows that the policies can correctly distinguish obstacles by safety relevance but fail to reflect this distinction in the motion parameters or actions they produce. For VLM-based policies, which recognize the obstacle and then generate a navigation program, adding an explicit parameter-inference step between these two stages improves adaptation. These findings expose a gap in semantic-to-motion grounding, highlighting the need to translate semantic caution into appropriately safe motion.
Community
Do household robots move more cautiously around riskier obstacles? OSMA-Bench evaluates whether VLM- and VLA-based policies adjust their clearance, speed, and smoothness according to an obstacle’s safety relevance. We find that recognizing risk does not always translate into appropriately cautious motion.
Paper: https://arxiv.org/abs/2610.34674
Code: https://github.com/OSMA-Bench/OSMA-Bench
Project Page: https://osma-bench.github.io/
@article {OSMABench,
title={{Benchmarking Obstacle-Conditioned Safety in Household Robot Navigation}},
author={Hyunwoong Bae and Jisu Han and Jiyeon Choi and Dohoon Kim and Taesup Moon},
year={{2026}},
eprint={{2610.34674}},
url={https://arxiv.org/abs/2610.34674},
}
This is an automated message from the Librarian Bot. I found the following papers similar to this paper.
The following papers were recommended by the Semantic Scholar API
- PASS-VLN: Passability-Aware Local-Command Vision-and-Language Navigation (2026)
- What the Elevation Map Cannot See: Semantic-Aware Locomotion and Execution-Aware Navigation for Humanoid Robot (2026)
- Towards Path-Creative Navigation: Robot Navigation through Embodied Interaction (2026)
- Revealing and Bridging the Physical Executability Gap in Vision-Language Navigation (2026)
- Successful but Unsafe: An Analytical Benchmark for Revealing Collisions in Vision-and-Language Navigation (2026)
- Zero-Shot Reactive Obstacle Avoidance for Generative Robot Policies (2026)
- ExceptionDrive: A Planning-Oriented Counterfactual Corner-Case Benchmark for Autonomous Driving (2026)
Please give a thumbs up to this comment if you found it helpful!
If you want recommendations for any Paper on Hugging Face checkout this Space
You can directly ask Librarian Bot for paper recommendations by tagging it in a comment: @librarian-bot recommend
Get this paper in your agent:
hf papers read 2610.34674 Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash Models citing this paper 0
No model linking this paper
Datasets citing this paper 0
No dataset linking this paper
Spaces citing this paper 0
No Space linking this paper
Collections including this paper 0
No Collection including this paper