Evolutionary Learning of Goal-Oriented Communication Strategies in Multi-Agent Systems

• Autorzy: Althnian A. , Agah A.

Identyfikatory

DOI

10.14313/JAMRIS_3-2015/24

• Języki publikacji: EN

Abstrakty

EN

Previous studies in multi-agent systems have observed that varying the type of information that agents communicate, such as goals and beliefs, has a significant impact on the performance of the system with respect to different, usually conflicting, performance metrics, such as speed of solution, communication efficiency, and travel distance/cost. Therefore, when designing a communication strategy for a multi-agent system, it is unlikely that one strategy can perform well with respect to all of performance metrics. Yet, it is not clear in advance, which strategy will be the best with respect to each metric. With multi-agent systems being a common paradigm for building distributed systems in different domains, performance goals can vary from one application to the other according to the domain’s specifications and requirements. To address this issue, this work proposes a genetic algorithm-based approach for learning a goal- oriented communication strategy. The approach enables learning an effective communication strategy with respect to flexible, user-defined measurable performance goals. The learned strategy will determine what, when, and to whom information should be communicated during the course of task execution in order to improve the performance of the system with respect to the stated goal. Our preliminary evaluation shows that the proposed approach has promising results and the learned strategies have significant usefulness in improving the performance of the system with respect to the goals.

Słowa kluczowe

EN

multi-agent system; communication strategy; evolutionary communication; genetic algorithms

• Wydawca: Łukasiewicz Industrial Research Institute for Automation and Measurements PIAP
• Czasopismo: Journal of Automation Mobile Robotics and Intelligent Systems
• Rocznik: 2015
• Tom: Vol. 9, No. 3
• Strony: 52--64
• Opis fizyczny: Bibliogr. 22 poz., rys.

Twórcy

autor

Althnian A.

• Department of Electrical Engineering and Computer Science, University of Kansas, Lawrence, Kansas, USA

autor

Agah A.

• Department of Electrical Engineering and Computer Science, University of Kansas, Lawrence, Kansas, USA

Bibliografia

• [1] Balch T., Arkin R. C. “Communication in Reactive Multiagent Robotic Systems”, Autonomous Robots, Volume 1, 1994, 27-52. DOI:10.1007/BF00735341.
• [2] Becker Raphen, et al., “Analyzing myopic approaches for multi-agent communication”, Computational Intelligence, vol. 25, no. 1, 2009, 31-50. DOI: 10.1111/j.1467-8640.2008.01329.x.
• [3] Boutilier C., “Sequential optimality and coordination in multiagent systems ”, IJCAI, vol. 99, 1999.
• [4] Carlin A., Zilberstein S., “Myopic and non-myopic communication under partial observability”, Web Intelligence and Intelligent Agent Technologies, 2009. WI-IAT’09. IEEE/WIC/ACM International Joint Conferences on, vol. 2, IET, 2009. DOI: 10.1109/WI-IAT.2009.174.
• [5] Chakraborty D., Sen S., “Computing effective communication policies in multiagent systems”. In: Proceedings of the 6th international joint conference on Autonomous agents and multiagent systems , 2007,36. DOI:10.1145/1329125.1329168.
• [6] Dutta P. S., Goldman C. V., Jennings N.R. “Communicating effectively in resource-constrained multi-agent systems”. In: IJCAI, 2007, 1269–1274.
• [7] Ghavamzadeh M., Mahadevan S., “Learning to communicate and act using hierarchical reinforcement learning”. In: Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems, vol. 3, 2004, 1114–1121.
• [8] Goldman C. V., Zilberstein S., “Optimizing information exchange in cooperative multi-agent systems”. In: Proceedings of the second international joint conference on Autonomous agents and multiagent systems, 2003,137–144. DOI: 10.1145/860575.860598.
• [9] Iba H., Nozoe T., Ueda, K., “Evolving communicating agents based on genetic programming”. In:IEEE International Conference on Evolutionary Computation, 1997, 297-302. DOI: 10.1109/ICEC.1997.592321.
• [10] Kinney M., Tsatsoulis C., “Learning communication strategies in multiagent systems”, Applied intelligence, vol. 9, no. 1, 1998, 71–91. DOI: 10.1023/A:1008251315338.
• [11] Mazurowski Maciej A., Jacek M. Zurada, “Emergence of communication in multi-agent systems using reinforcement learning”. In:IEEE International Conference on Computational Cybernetics, 2006. DOI: 10.1109/ICCCYB.2006.305696.
• [12] Melo F.S., Spaan M.T., “A POMDP-based Model for Optimizing Communication in Multiagent Systems”. In:Proc. 1st Eur. Workshop on Multiagent Systems, 2011.
• [13] North M.J., T.R. Howe, N.T. Collier, Vos R.J., “The Repast Simphony Runtime System”. In: Proceedings of the Agent 2005 Conference on Generative Social Processes, Models, and Mechanisms, 2005.
• [14] Roth, M., Simmons, R., & Veloso, M. “Reasoning about joint beliefs for execution-time communication decisions”. In Proceedings of the fourth international joint conference on Autonomous agents and multi-agent systems, 2005,pp. 786-793. DOI: 10.1145/1082473.1082593.
• [15] Roth M., Simmons R., Veloso M., “What to communicate? Execution-time decision in multi-agent POMDPs”. In: Distributed Autonomous Robotic Systems 7, 2006, 177–186. DOI: 10.1007/4-431-35881-1_18.
• [16] Russell S., Norvig P., Artificial Intelligence: A modern approach,Prentice-Hall: Egnlewood Cliffs, 1995.
• [17] Thierens D., “Selection schemes, elitist recombination, and selection intensity”. In: Proceedings of the 7th International Conference on Genetic Algorithms, 1997,152–159.
• [18] Tian Le, Jian Luo, Zhili Huang. “Communication based on Interactive Dynamic Influence Diagrams in cooperative multi-agent systems”. In: Computer Science & Education (ICCSE), 2013 8th International Conference on. IEEE, 2013.
• [19] Wei C., Hindricks K., Jonker C. M., “The Role of Communication in Coordination Protocols for Cooperative Robot Teams”. In: International Conference on Agents and Artificial Intelligence,2014. DOI: 10.5220/0004758700280039.
• [20] Williamson S., Gerding E., Jennings N., A principled information valuation for communications during multi-agent coordination, 2008, 137–151.
• [21] Wu A. S., Yu H., Jin S., Lin K. C., Schiavone G., “An incremental genetic algorithm approach to multiprocessor scheduling”, IEEE Transactions on Parallel and Distributed Systems, vol.15, no. 9, 2004, 824-834. DOI: 10.1109/TPDS.2004.38.
• [22] Zhang Y., “Observant and Proactive Communication in Multi-Agent Teamwork”. In: IEEE/WIC/ACM International Conference on Intelligent Agent Technology, 2006, 460-466. DOI:10.1109/IAT.2006.97.