Energy Efficient Scheduling Methods for Computational Grids and Clouds

• Autorzy: Jakóbik A. , Grzonka D. , Kołodziej J. , Chis A. E. , González-Vélez H.
• Języki publikacji: EN

Abstrakty

EN

This paper presents an overview of techniques developed to improve energy efficiency of grid and cloud computing. Power consumption models and energy usage proles are presented together with energy efficiency measuring methods. Modeling of computing dynamics is discussed from the viewpoint of system identication theory, indicating basic experiment design problems and challenges. Novel approaches to cluster and network-wide energy usage optimization are surveyed, including multi-level power and software control systems, energy-aware task scheduling, resource allocation algorithms and frameworks for backbone networks management. Software-development techniques and tools are also presented as a new promising way to reduce power consumption at the computing node level. Finally, energy-aware control mechanisms are presented. In addition, this paper introduces the example of batch scheduler based on ETC matrix approach.

Słowa kluczowe

EN

batch scheduling; cloud computing; energy efficient; grids; power consumption; resource allocation

• Wydawca: Instytut Łączności - Państwowy Instytut Badawczy
• Czasopismo: Journal of Telecommunications and Information Technology
• Rocznik: 2017
• Tom: nr 1
• Strony: 56--64
• Opis fizyczny: Bibliogr. 35 poz., rys., tab.

Twórcy

autor

Jakóbik A.

• Faculty of Physics, Mathematics and Computer Science Tadeusz Ko±ciuszko Cracow University of Technology Warszawska st 24 31-155 Cracow, Poland

autor

Grzonka D.

• Faculty of Physics, Mathematics and Computer Science Tadeusz Ko±ciuszko Cracow University of Technology Warszawska st 24 31-155 Cracow, Poland

autor

Kołodziej J.

• Faculty of Physics, Mathematics and Computer Science Tadeusz Ko±ciuszko Cracow University of Technology Warszawska st 24 31-155 Cracow, Poland

autor

Chis A. E.

• Cloud Competency Centre National College of Ireland Dublin, Ireland

autor

González-Vélez H.

• Cloud Competency Centre National College of Ireland Dublin, Ireland

Bibliografia

• [1] K. H. Kim, A. Beloglazov, and R. Buyya, “Power-aware provisioning of cloud resources for real-time services”, in Proc. 7th Int. Worksh. on Middleware for Grids, Clouds and e-Science MGC’09, Urbana Champaign, IL, USA, 2009, pp. 1:1–1:6 (doi: 10.1145/1657120.1657121).
• [2] A. Beloglazov and R. Buyya, “Adaptive threshold-based approach for energy-efficient consolidation of virtual machines in cloud data centers”, in Proc. 8th Int. Worksh. on Middleware for Grids, Clouds and e-Science MGC’10, Bangalore, India, 2010, pp. 4:1–4:6 (doi: 10.1145/1890799.189080333).
• [3] X. Fan, W.-D. Weber, and L. A. Barroso, “Power provisioning for a warehouse-sized computer”, in Proc. 34th Ann. Int. Symp. on Comp. Architec. ISCA’07, San Dieco, CA, USA, 2007, pp. 13–23.
• [4] E. Pinheiro, R. Bianchini, E. Carrera, and T. Heath, “Load balancing and unbalancing for power and performancee in cluster-based systems” in Proc. of the Worksh. on Compilers and Operat. Syst. for Low Power COLP’01, Barcelona, Spain, 2001, pp. 182–195.
• [5] A. Beloglazov, J. Abawajy, and R. Buyya, “Energy-aware resource allocation heuristics for efficient management of data centers for cloud computing”, Future Gener. Comput. Syst., vol. 28, no. 5, pp. 755–768, 2012.
• [6] R. Nathuji and K. Schwan, “Virtualpower: Coordinated power management in virtualized enterprise systems”, in Proc. 21st ACM SIGOPS Symposium on Operat. Syst. Principles SOSP’07, Stevenson, WA, USA, 2007, pp. 265–278.
• [7] D. Kusic, J. O. Kephart, J. E. Hanson, N. Kandasamy, and G. Jiang, “Power and performance management of virtualized computing environments via lookahead control”, Cluster Comput., vol. 12, no. 1, pp. 1–15, 2009.
• [8] G. Dhiman, K. Mihic, and T. Rosing, “A system for online power prediction in virtualized environments using Gaussian mixture models”, in Proc. 47th Design Autom. Conf. DAC’10 Anaheim, CA, USA, 2010, pp. 807–812.
• [9] A. Hameed et al., “A survey and taxonomy on energy efficient resource allocation techniques for cloud computing systems”, Computing, vol. 98, no. 7, pp. 751–774, 2016.
• [10] S. Russell and P. Norvig, Artificial Intelligence. A modern approach. Englewood Cliffs: Prentice-Hall, 1995.
• [11] R. Kaur and P. Luthra, “Load balancing in cloud computing”, in Proc. of Int. Conf. on Recent Trends in Inform., Telecom. and Comput. ITC ’12, Bangalore, India, 2012.
• [12] D. Grzonka, J. Kołodziej, J. Tao, and S. U. Khan, “Artificial neural network support to monitoring of the evolutionary driven security aware scheduling in computational distributed environments”, Future Gener. Comput. Syst., vol. 51, no. C, pp. 72–86, 2015.
• [13] P. Fibich, L. Matyska, and H. Rudov´ a, “Model of grid scheduling problem”, in Proc. Worksh. on Explor. Plann. and Schedul. for Web Services, Grid and Autonomic Comput., Pittsburgh, PA, USA, 2005, pp. 17–24.
• [14] D. Klus´ aˇcek and H. Rudov´ a, “Efficient grid scheduling through the incremental schedule-based approach”, Computat. Intell., vol. 27, no. 1, pp. 4–22, 2011.
• [15] J. Kołodziej, S. U. Khan, L. Wang, A. Byrski, N. Min-Allah, and S. A. Madani, “Hierarchical genetic-based grid scheduling with energy optimization”, Cluster Comput., vol. 16, no. 3, pp. 591–609, 2013.
• [16] C. Cai, L. Wang, S. U. Khan, and J. Tao, “Energy-aware high performance computing: A taxonomy study”, in Proc. 2011 IEEE 17th Int. Conf. on Parallel and Distrib. Syst. ICPADS 2011, Tainan, Taiwan, 2011, pp. 953–958.
• [17] J. Kołodziej, Evolutionary Hierarchical Multi-Criteria Metaheuristics for Scheduling in Large-Scale Grid Systems. Studies in Computational Intelligence, vol. 419. Springer, 2012.
• [18] J. R. Anette, W. A. Banu, and Shriram, “A taxonomy and survey of scheduling algorithms in cloud: Based on task dependency”, Int. J. of Comp. Appl., vol. 82, no. 15, pp. 20–26, 2013.
• [19] J. Kołodziej, S. U. Khan, and F. Xhafa, “Genetic algorithms for energy-aware scheduling in computational grids”, in Proc. Int. Conf. on P2P, Parallel, Grid, Cloud and Internet Comput. 3PGCIC 2011, Barcelona, Spain, 2011, pp. 17–24.
• [20] S. Ali, H. J. Siegel, M. Maheswaran, D. Hensgen, and S. Ali, “Task execution time modeling for heterogeneous computing systems”, in Proc. 9th Heterogen. Comput. Worksh. HCW 2000 (Cat. No. PR00556), Cancun, Mexico, 2000, pp. 185–199 (doi: 10.1109/HCW.2000.843743).
• [21] D. Kliazovich, P. Bouvry, and S. U. Khan, “Dens: Data center energy-efficient network-aware scheduling”, in Int. Conf. on Green Comput. & Commun. GreenCom 2010 and IEEE/ACM Int. Conf. on Cyber, Physical & Social Comput. CPSCom 2010), Hangzhou, China, 2010, pp. 69–75 (doi: 10.1109/GreenCom-CPSCom.2010.31).
• [22] Y. Mhedheb, F. Jrad, J. Tao, J. Zhao, J. Kołodziej, and A. Streit, “Load and thermal-aware VM scheduling on the cloud”, in Algorithms and Architectures for Parallel Processing: 13th International Conference, ICA3PP 2013, Vietri sul Mare, Italy, Dec. 18-20, 2013, Proceedings, Part II, R. Aversa, J. Kołodziej, J. Zhang, F. Amato, and F. Giancarlo, Eds. Springer, 2013, pp. 101–114.
• [23] C. Ghribi, M. Hadji, and D. Zeghlache, “Energy efficient VM scheduling for cloud data centers: Exact allocation and migration algorithms”, in Proc. 13th IEEE/ACM Int. Symp. on Cluster, Cloud, and Grid Comput. CCGrid 2013, Delft, The Netherlands, 2013, pp. 671–678.
• [24] C. Ghribi and D. Zeghlache, “Exact and heuristic graph-coloring for energy efficient advance cloud resource reservation”, in Proc. IEEE 7th Int. Conf. on Cloud Comput. CLOUD 2014, Anchorage, AK, USA, 2014, pp. 112–119.
• [25] A. Beloglazov, “Energy-efficient management of virtual machines in data centers for cloud computing”, Ph.D. thesis, The University of Melbourne, 2013 [Online]. Available: http://beloglazov.info/thesis.pdf
• [26] A. Beloglazov and R. Buyya, “OpenStack Neat: A framework for dynamic and energy-efficient consolidation of virtual machines in openstack clouds”, Concurr. Comput.: Pract. Exper., vol. 27, no. 5, pp. 1310–1333, 2015 (doi: 10.1002/CPC.3314).
• [27] A. Iqbal, C. Pattinson, and A. L. Kor, “Managing energy efficiency in the cloud computing environment using SNMPV3: A quantitative analysis of processing and power usage”, in Proc. IEEE 14th Int. Conf. Dependable, Autonom. & Secure Comput., 14th Int. Conf. Pervasive Intell. & Comput., 2nd Int. Conf. Big Data Intell. & Comput., and Cyber Sci. and Technol. Congr. DASC/PiCom/DataCom/ CyberSciTech, Auckland, New Zealand, 2016, pp. 239–244 (doi: 10.1109/DASC-PICom-DataCom-CyberSciTec.2016.60).
• [28] H. Goudarzi, M. Ghasemazar, and M. Pedram, “SLA-based optimization of power and migration cost in cloud computing”, in Proc. 12th IEEE/ACM Int. Symp. on Cluster, Cloud and Grid Comput. CCGrid 2012, Ottawa, Canada, 2012, pp. 172–179.
• [29] A. Beloglazov and R. Buyya, “Optimal online deterministic algorithms and adaptive heuristics for energy and performance efficient dynamic consolidation of virtual machines in cloud data centers”, Concurr. Comput.: Pract. Exper., vol. 24, no. 13, pp. 1397–1420, 2012 (doi: 10.1002/CPC.1867).
• [30] R. N. Calheiros, R. Ranjan, A. Beloglazov, C. A. F. De Rose, and R. Buyya, “CloudSim: A toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms”, Softw. Pract. Exper., vol. 41, no. 1, pp. 23–50, 2011.
• [31] J. Kołodziej, F. Xhafa, L. Barolli, and V. Kolici, “A taxonomy of data scheduling in data grids and data centers: Problems and intelligent resolution techniques”, in Proc. Int. Conf. on Emerging Intell. Data and Web Technol. EiIDWT 2011, Tirana, Albania, 2011, pp. 63–71 (doi: 10.1109/EIDWT.2011.20).
• [32] L. Wang, S. U. Khan, D. Chen, J. Kołodziej, R. Ranjan, C.-Z. Xu, and A. Zomaya, “Energy-aware parallel task scheduling in a cluster”, Future Gener. Comput. Syst., vol. 29, no. 7, pp. 1661–1670, 2013.
• [33] A. Jakóbik, D. Grzonka, and F. Palmieri, “Non-deterministic security driven meta scheduler for distributed cloud organizations”, Simul. Modell. Practice and Theory, Elsevier, Nov. 2016 (doi: 10.1016/j.simpat.2016.10.011).
• [34] A. Jakóbik, D. Grzonka, J. Kołodziej, and H. Gonzalez-Velez, “Towards secure non-deterministic meta-scheduling for clouds”, in Proc. 30th Eur. Conf. on Modell. and Simul. ECMS 2016, Regensburg, Germany, 2016, pp. 596–602 (doi: 10.7148/2016-0596).
• [35] A. Jakóbik, “Big data security”, in Resource Management for Big Data Platforms: Algorithms, Modelling, and High-Performance Computing Techniques, F. Pop, J. Kołodziej, and B. Di Martino, Eds. Springer, 2016, pp. 241–261.

Uwagi

Opracowanie ze środków MNiSW w ramach umowy 812/P-DUN/2016 na działalność upowszechniającą naukę (zadania 2017).