高级检索

基于深度强化学习的机器人巡检覆盖路径规划

Path Planning for Robot Inspection Coverage Based on Deep Reinforcement Learning

  • 摘要: 机器人巡检作为建设工地、铁路沿线和大型设施中重要的监测手段,其部署策略直接影响巡检覆盖效率。针对传统布置方法过度依赖人工经验及启发式算法、在复杂环境下难以实现全局最优的问题,提出一种基于近端策略优化(PPO)算法的移动机器人巡检覆盖策略。通过深度强化学习构建智能体与仿真环境的交互机制,将机器人部署过程建模为马尔可夫决策过程(MDP)。在奖励函数设计中,在覆盖增量、部署成本及碰撞惩罚等常规因子的基础上,引入动态稀缺性增益与覆盖冗余惩罚,通过精细化奖励整形机制实现巡检位姿的优化部署。随后,结合非对称旅行商问题(ATSP)与A*算法,将任务解耦为布局优化与路径规划两个阶段串行推进,生成最优巡检轨迹。实验结果表明,该方法平均覆盖率达到96.47%,较基准算法提升5.56个百分点;平均部署点位数为37.6个,较基准算法缩减了14.6个,在三个随机实验场景中均能稳定生成高效巡检路径。该方法通过深度强化学习与路径规划的深度融合,为复杂几何环境下的移动机器人自主覆盖巡检提供了高效、平滑且具备强泛化能力的决策范式。

     

    Abstract: Robotic inspection serves as a critical monitoring method for construction sites, railway corridors, and large-scale facilities, where deployment strategies directly impact inspection coverage efficiency. To address the limitations of traditional planning methods—which rely heavily on human experience and heuristic algorithms and struggle to achieve global optimality in complex environments—we propose a patrol coverage strategy for mobile robots based on the Policy-Based Proximal Optimization (PPO) algorithm. By utilizing deep reinforcement learning to establish an interaction mechanism between the agent and the simulation environment, the robot deployment process is modeled as a Markov Decision Process (MDP). Regarding the design of the reward function, this paper introduces dynamic scarcity gains and coverage redundancy penalties in addition to conventional factors such as coverage increment, deployment cost, and collision penalties. Through this refined reward mechanism, the optimal deployment of inspection locations is achieved. Subsequently, by combining the Asymmetric Traveling Salesman Problem (ATSP) with the A* algorithm, the task is decoupled into two sequential stages—layout optimization and path planning—to generate optimal inspection trajectories. Experimental results show that the method achieves an average coverage rate of 96.47%, a 5.56% improvement over the baseline algorithm, and an average of 37.6 deployment points, a reduction of 14.6 points compared to the baseline. It successfully generates optimal inspection paths across three random experimental scenarios. Through the deep integration of deep reinforcement learning and path planning, this study provides an efficient, smooth, and highly generalizable decision-making framework for autonomous coverage inspection by mobile robots in complex geometric environments.

     

/

返回文章
返回