引用本文:段 勇,崔宝侠,徐心和.多智能体强化学习及其在足球机器人角色分配中的应用[J].控制理论与应用,2009,26(4):371~376.[点击复制]
DUAN Yong,CUI Bao-xia,XU Xin-he.Multi-agent reinforcement learning and its application to role assignment of robot soccer[J].Control Theory and Technology,2009,26(4):371~376.[点击复制]
多智能体强化学习及其在足球机器人角色分配中的应用
Multi-agent reinforcement learning and its application to role assignment of robot soccer
摘要点击 2697  全文点击 1846  投稿时间:2007-12-09  修订日期:2008-10-31
查看全文  查看/发表评论  下载PDF阅读器
DOI编号  10.7641/j.issn.1000-8152.2009.4.004
  2009,26(4):371-376
中文关键词  多智能体系统  强化学习  朴素贝叶斯分类器  机器人足球  角色分配
英文关键词  multi-agent system  reinforcement learning  naive bayes classifier  robot soccer  role assignment
基金项目  国家自然科学基金资助项目(60475036).
作者单位E-mail
段 勇 沈阳工业大学 信息科学与工程学院, 辽宁 沈阳 110178 duanyong0607@126.com 
崔宝侠 沈阳工业大学 信息科学与工程学院, 辽宁 沈阳 110178 cuibx88@126.com 
徐心和 东北大学 人工智能与机器人研究所, 辽宁 沈阳 110023 xuxh@gmail.com 
中文摘要
      足球机器人系统是一个典型的多智能体系统, 每个机器人球员选择动作不仅与自身的状态有关, 还要受到其他球员的影响, 因此通过强化学习来实现足球机器人决策策略需要采用组合状态和组合动作. 本文研究了基于智能体动作预测的多智能体强化学习算法, 使用朴素贝叶斯分类器来预测其他智能体的动作. 并引入策略共享机制来交换多智能体所学习的策略, 以提高多智能体强化学习的速度. 最后, 研究了所提出的方法在足球机器人动态角色分配中的应用, 实现了多机器人的分工和协作.
英文摘要
      Robot soccer is a typical multi-agent system. The action selected by each robot player not only depends on the current field state, but is also impacted by other players. Hence, the decision-making strategy of robot soccer obtained by reinforcement learning needs the information of the joint-state and the joint-action of multiple agents. A multi-agent reinforcement learning method based on the action prediction of agents is proposed. The Naive Bayes classifier is applied to predict the actions of other agents. Moreover, the sharing-policy mechanism is introduced into multi-agent reinforcement learning system for exchanging the learning policies among agents. It can increase the learning speed effectively. Finally, the proposed approach is applied to learn the role assignment strategy in realizing the cooperation and coordination between robots.