Learning methods in ad-hoc networks: a review

• Autorzy: Kudelski M. , Pacut A.
• Konferencja: Evolutionary Computation and Global Optimization (10; Krajowa Konferencja Algorytmy Ewolucyjne i Optymalizacja Globalna; 11-13.06.2007; Będlewo, Poland)
• Języki publikacji: EN

Abstrakty

EN

The paper presents a comprehensive review of learning methods used to solve various problems in ad-hoc networks. The learning methods are classified according to learning mechanisms and problems solved. Nine representative approaches are discussed in more detail.

Słowa kluczowe

EN

telecommunication network; learning methods; ad hoc networks

• Wydawca: Oficyna Wydawnicza Politechniki Warszawskiej
• Czasopismo: Prace Naukowe Politechniki Warszawskiej. Elektronika
• Rocznik: 2007
• Tom: z. 160
• Strony: 153--163
• Opis fizyczny: Bibliogr. 37 poz.

Twórcy

autor

Kudelski M.

autor

Pacut A.

• Warsaw University of Technology Institute of Control and Computation Engineering

Bibliografia

• [1] I. Akyildiz, W. Su, Y. Sankarasubramaniam, and E. Cayirci. "A survey on sensor networks", IEEE Commun. Mag. 40(8), pp. 102-114, 2002.
• [2] Ian F. Akyildiz, Xudong Wang, Weilin Wang, "Wireless mesh networks: a survey", Computer Networks 47, pp. 445-487, 2005.
• [3] B. Awerbuch, D. Holmer, H. Rubens, "Swarm Intelligence Routing Resilient to Byzantine Adversaries", International Zurich Seminar on Communications, pp. 160-163, 2004.
• [4] J. A. Boyan and M. L. Littman, "Packet Routing in Dynamically Changing Networks: A Reinforcement Learning Approach", Advances in Neural Information Processing Systems, vol. 6, pp. 671-678, Morgan Kaufmann Publishers Inc., 1994.
• [5] J.B.D. Cabrera, C. Gutierrez, R.K. Mehra, "Infrastructures and algorithms for distributed anomaly-based intrusion detection in mobile ad-hoc networks", IEEE MILCOM, vol. 3, pp. 1831-1837, 2005.
• [6] D. Camara, A.A.F. Loureiro, "GPS/Ant-Like Routing in Ad Hoc Networks", Telecommunication Systems 18, pp. 1-3, 85-100, 2001.
• [7] Yu-Han Chang, "Mobilized ad-hoc networks: A reinforcement learning approach", Proceedings of International Conference on Autonomic Computing, pp. 240-247, 2004.
• [8] D. Chetret, C. Tham, L. Wong "Reinforcement Learning and CMAC-based Adaptive Routing for MANETs", IEEE ICON, vol. 2, pp. 540-544, 2004.
• [9] S. Corson and J. Macker, "Mobile Ad hoc Networking (MANET): Routing protocol Performance Issues and Evaluation Considerations", Internet draft from http://www.ietf.org/rfc/rfc2501.txt, 1999.
• [10] G. Di Caro, F. Ducatelle and L. M. Gambardella, "AntHocNet: An Adaptive Nature-Inspired Algorithm for Routing in Mobile Ad Hoc Networks", European Transactions on Telecommunications, vol. 16, pp. 443-455, 2005.
• [11] M. Dorigo, V. Maniezzo, and A. Colorni, "Positive feedback as a search strategy", Politecnico di Milano Technical Report 91016, 1991.
• [12] J. Dowling, E. Curran, R. Cunningham, and V. Cahill, "Using Feedback in Collaborative Reinforcement Learning to Adaptively Optimize MANET Routing", IEEE Transactions On Systems, Man, and Cybernetics, vol. 35, pp. 360-372, 2005.
• [13] A.I. El-Osery, D. Baird, W. Abd-Almageed, "A Learning Automata Based Power Management for Ad-Hoc Networks", IEEE International Conference on Systems, Man and Cybernetics, vol. 4, pp. 3569-3573, 2005.
• [14] P. Fu, J. Li, and D. Zhang, "Heuristic and Distributed QoS Route Discovery for Mobile Ad hoc Networks", IEEE CIT, pp. 512-516, 2005.
• [15] E. Gelenbe, R. Lent, "Power-aware ad hoc cognitive packet networks", Ad Hoc Networks 2, pp. 205-216, 2004.
• [16] E. Gelenbe, Z. Xu and E. Seref, "Cognitive Packet Networks", Proceedings of IEEE Tools with Artificial Intelligence, pp. 47-54, 1999.
• [17] S. Hadjiefthymiades and L. Merakos, "Proxies + Path Prediction: Improving Web Service Provision in Wireless-Mobile Communications", Mobile Networks and Applications 8, pp. 389-399, 2003.
• [18] C. Huang, L. Chen, Y. Lin, Y. Chuang, W. Kuang Lai, S. Hsiao, "A Zone Routing Protocol for Bluetooth MANET with Online Adaptive Zone Radius", IEEE ICICS, pp. 579-583, 2005.
• [19] K. Maneenil, W. Usaha, "Preventing malicious nodes in ad hoc networks using reinforcement learning", 2nd International Symposium on Wireless Communication Systems, pp. 289-292, 2005.
• [20] P. Nicopolitidis, G.I. Papadimitriou, A.S. Pomportsis, "An Adaptive MAC Protocol for Ad-Hoc Wireless LANs", 58th Vehicular Technology Conference, vol. 2, pp. 1383-1386, 2003.
• [21] B.J. Oommen, S. Misra, "A Fault-Tolerant Routing Algorithm for Mobile Ad Hoc Networks Using a Stochastic Learning-Based Weak Estimation Procedure", IEEE WiMob, pp. 31-37, 2006.
• [22] A. Pacut, M. Gadomska, A. Igielski, "Ant-Routing vs. Q-Routing in Telecommunication Networks", Proceedings of the 20-th ECMS Conference, pp. 67-72, 2006.
• [23] C. E. Perkins and P. Bhagwat, "Highly Dynamic Destination-Sequenced Distance-Vector Routing (DSDV) for Mobile Computers", Proceedings of ACM SIGCOMM, pp. 212-225, 1994.
• [24] Sundaram Rajagopalan, Chien-Chung Shen, "ANSI: A swarm intelligence-based unicast routing protocol for hybrid ad hoc networks", Journal of Systems Architecture 52, pp. 485-504, 2006.
• [25] S. Sarafijanovic, J. Boudec, "An Artificial Immune System Approach With Secondary Response for Misbehavior Detection in Mobile ad hoc Networks", IEEE Transactions on Neural Networks, vol. 16, pp. 1076-1087, 2005.
• [26] Y. Shang, M.P.J. Fromherz, Y. Zhang, L.S. Crawford, "Constraint-based Routing for Ad-hoc Networks", IEEE ITRE, pp. 306-310, 2003.
• [27] C. Shen, Z. Huang, C. Jaikaeo, "Ant-Based Distributed Topology Control Algorithm for Mobile Ad hoc Networks", Wireless Networks 11, pp. 299-317, 2005.
• [28] P. Su, M. Gellman, "Using adaptive routing to achieve Quality of Service", Performance Evaluation 57 (Elsevier), pp. 105-119, 2004.
• [29] R. Sun, S. Tatsumi, G. Zhao, "Q_MAP: a novel multicast routing method in wireless ad hoc networks with multiagent reinforcement learning", Proceedings of IEEE TENCON, vol. 1, pp. 667-670, 2002.
• [30] T. Tao, S. Tagashira, S. Fujita, "LQ-Routing Protocol for Mobile Ad-Hoc Networks", IEEE ICIS, pp. 441-446, 2005.
• [31] W. Usaha, J. Barria, "Reinforcement learning ticket-based probing path discovery scheme for MANETs", Ad Hoc Networks 2, pp. 319-334, 2004.
• [32] S. Varadarajan, N. Ramakrishnan, M. Thirunavukkarasu, "Reinforcing reachable routes", Computer Networks 43, pp. 389-416, 2003.
• [33] B. Venkata Ramana, B. S. Manoj, and C. Siva Ram Murthy, "Learning-TCP: A Novel Learning Automata Based Reliable Transport Protocol for Ad hoc Wireless Networks", 2nd International Conference on Broadband Networks, vol. 1, pp. 484-493, 2005.
• [34] Y. Wang, M. Martonosi and Li-Shiuan Peh, "Supervised Learning in Sensor Networks: New Approaches with Routing, Reliability Optimizations", SECON, vol. 1, pp. 256-265, 2006.
• [35] C. J. Watkins, "Learning with delayed rewards", Ph.D. Thesis, Univ. of Cambridge, 1989.
• [36] Daniel Yagan and Chen-Khong Tham, "Adaptive QoS Provisioning in Wireless Ad Hoc Networks: A Semi-MDP Approach", Wireless Communications and Networking Conference, vol 4, pp. 2238-2244, 2005.
• [37] S. Ziane, A. Mellouk, "A Swarm Intelligent Scheme for Routing in Mobile Ad hoc Networks", Proceedings of IEEE ICW, pp. 2-6, 2005.