Resilience Matters for Embodied Agents System: New Metrics, Systematic Evaluation, and Optimization
Yapeng Liu ⋅ Yuanzhao Zhai ⋅ Xudong Gong ⋅ Feng Dawei ⋅ Bo Ding ⋅ Lin Wang ⋅ Huaimin Wang
Abstract
As Embodied Agents System (EAS) move into physical domains such as autonomous navigation and household assistance, reliable execution becomes critical for physical task completion and collaboration trust. Recent EAS reliability evaluation works typically focus on outcome-centric metrics as success rate or safety-only scores to assess an agent's performance, which collapse diverse execution trajectories into coarse outcomes. Therefore they ignore a critical property of EAS -- which we define as the **Resilience** -- that reflects how EASs recover, stabilize, and extend under perturbations and across iterative updates. The lack of resilience is particularly critical in open-world environments due to continuous unexpected disruptions, thus directly affecting the quality of EAS deployment. To address this problem, we gain insight from the resilience-engineering concepts to EAS groundings and propose a novel resilience evaluation framework that can be flexibly applied to any EAS. Specifically, we define the first comprehensive resilience metrics suite for EASs system that exposes *Rebound*, *Stability*, and *Graceful Extensibility* across embodied tasks execution, providing a practical grounding for EAS resilience analysis. We further implement the resilience evaluation layer that transforms execution evidence into assessments for comparison, diagnosis and optimization. Across 400 household tasks with 10 representative EAS baselines, our evaluation reveals process-level distinction hidden by outcome metrics, including recovery cost differences among successful episodes ($\Delta C_{\mathrm{rec}}=25.2$), increased instability under semantic perturbations, and task-family-specific degradation under stress. Metrics-guided optimizations reduce recovery cost by 42.94%, increase stability by 19.87%, and improve graceful extensibility completion by 10.08%, showing the diagnostic effect of resilience evaluation. Beyond these targeted gains, our results reveal trade-offs among resilience characteristics, suggesting that a resilient EAS construction should be evaluated and configured according to deployment-specific requirements. Our code and data are available at .
Chat is not available.
Successful Page Load