The extension of TORQUE scheduler allowing the use of planning and optimization in grids

• Autorzy: Chlumsky V. , Klusacek D. , Ruda M.
• Języki publikacji: EN

Abstrakty

EN

In this work we present a major extension of the open source TORQUE Resource Manager system. We have replaced a naive scheduler provided in the TORQUE distribution with complex scheduling system that allows to plan job execution ahead and predict the behavior of the system. It is based on the application of job schedule, which represents the jobs’ execution plan. Such a functionality is very useful as the plan can be used by the users to see when and where their jobs will be executed. Moreover, created plans can be easily evaluated in order to identify possible inefficiencies. Then, repair actions can be taken immediately and the inefficiencies can be fixed, producing better schedules with respect to considered criteria.

Słowa kluczowe

EN

grid; scheduling; TORQUE; schedule; planning; predictability; evaluation

• Wydawca: Wydawnictwa AGH
• Czasopismo: Computer Science
• Rocznik: 2012
• Tom: Vol. 13 (2)
• Strony: 5--19
• Opis fizyczny: Bibliogr. 36 poz., rys., wykr.

Twórcy

autor

Chlumsky V.

• CESNET z.s.p.o., Prague, Czech Republic

autor

Klusacek D.

• CESNET z.s.p.o., Prague, Czech Republic

autor

Ruda M.

• CESNET z.s.p.o., Prague, Czech Republic

Bibliografia

• [1] Abraham A., Buyya R., Nath B.: Nature’s heuristics for scheduling jobs on computational Grids. [in:] The 8th IEEE International Conference on Advanced Computing and Communications (ADCOM 2000), pp. 45–52, 2000.
• [2] Abraham A., Liu H., Grosan C., Xhafa F.: Nature inspired meta-heuristics for Grid scheduling: Single and multi-objective optimization approaches. [in:] Metaheuristics for Scheduling in Distributed Computing Environments [34], pp. 247– 272.
• [3] Adaptive Computing Enterprises, Inc. Moab workload manager administrator’s guide, version 6.1.4, February 2012. http://www.adaptivecomputing.com/resources/docs/.
• [4] Adaptive Computing Enterprises, Inc. TORQUE Admininstrator Guide, version 3.0.3, February 2012. http://www.adaptivecomputing.com/resources/docs/.
• [5] Baptiste P., Pape C. L., Nuijten W.: Constraint-based scheduling: Applying constraint programming to scheduling problems. Kluwer, 2001.
• [6] Baruah S., Funk S., Goossens J.: Robustness results concerning EDF scheduling upon uniform multiprocessors. IEEE Transactions on Computers, 52(9):1185–1195, 2003.
• [7] Burke S., Campana S., Peris A. D., Donno F., Lorenzo P. M., Santinelli R., Sciaba A.: gLite 3 user guide. Worldwide LHC Computing Grid, January 2007.
• [8] Feitelson D. G.: Parallel workloads archive (PWA), February 2012. http://www. cs.huji.ac.il/labs/parallel/workload/.
• [9] Feitelson D. G., Rudolph L., Schwiegelshohn U., Sevcik K. C., Wong P.: Theory and practice in parallel job scheduling. [in:] Feitelson D. G., Rudolph L., editors, Job Scheduling Strategies for Parallel Processing, volume 1291 of LNCS, pp. 1–34. Springer Verlag, 1997.
• [10] Feitelson D. G., Weil A. M.: Utilization and predictability in scheduling the IBM SP2 with backfilling. [in:] 12th International Parallel Processing Symposium, pages 542–546. IEEE, 1998.
• [11] Gentzsch W.: Sun Grid Engine: towards creating a compute power Grid. [in:] Proceedings of the First IEEE/ACM International Symposium on Cluster Computing and the Grid, pp. 35–36, 2001.
• [12] Hovestadt M., Kao O., Keller A., Streit A.: Scheduling in HPC resource management systems: Queuing vs. planning. [in:] Job Scheduling Strategies for Parallel Processing, volume 2862 of LNCS, pp. 1–20. Springer, 2003.
• [13] Huedo E., Montero R., Llorente I.: The GridWay framework for adaptive scheduling and execution on Grids. Scalable Computing: Practice and Experience, 6(3):1–8, 2005.
• [14] Jones J. P.: PBS Professional 7, administrator guide. Altair, April 2005.
• [15] Keller A., Reinefeld A.: Anatomy of a resource management system for HPC clusters. Annual Review of Scalable Computing, 3:1–31, 2001. The extension of TORQUE scheduler allowing the use of planning (...) 17
• [16] Kleban S. D., Clearwater S. H.: Fair share on high performance computing systems: What does fair really mean? [in:] Third IEEE International Symposium on Cluster Computing and the Grid (CCGrid’03), pp. 146–153. IEEE Computer Society, 2003.
• [17] Klus´aˇcek D.: Event-based Optimization of Schedules for Grid Jobs. PhD thesis, Masaryk University, 2011.
• [18] Klus´aˇcek D., Rudov´a H.: Alea 2 – job scheduling simulator. [in:] Proceedings of the 3rd International ICST Conference on Simulation Tools and Techniques (SIMUTools 2010). ICST, 2010.
• [19] Klus´aˇcek D., Rudov´a H.: Handling inaccurate runtime estimates by event-based optimization. [in:] Cracow Grid Workshop 2010 Abstracts (CGW’10), Cracow, Poland, 2010.
• [20] Klus´aˇcek D., Rudov´a H.: Efficient data representation of large job schedules. In Mathematical and Engineering Methods in Computer Science (MEMICS 2011) selected papers, volume 7119 of LNCS. Springer, 2011. To appear.
• [21] Klus´aˇcek D., Rudov´a H.: Efficient Grid scheduling through the incremental schedule-based approach. Computational Intelligence: An International Journal, 27(1):4–22, 2011.
• [22] Klus´aˇcek D., Rudov´a H., Baraglia R., Pasquali M., Capannini G.: Comparison of multi-criteria scheduling techniques. [in:] Grid Computing Achievements and Prospects, pp. 173–184. Springer, 2008.
• [23] Kurowski K., Back W., Dubitzky W., Guly´as L., Kampis G., Mamonski M., Szemes G., Swain M.: Complex system simulations with qoscosgrid. [in:] Proceedings of the 9th International Conference on Computational Science: Part I, volume 5544 of LNCS, pp. 387–396. Springer, 2009.
• [24] Kurowski K., Oleksiak A., Piatek W., Weglarz J.: Hierarchical scheduling strategies for parallel tasks and advance reservations in grids. Journal of Scheduling, 11(14):1–20, 2011.
• [25] Mar´ıa M. L´opez E. H., Senar M. A.: Sensitivity analysis of workflow scheduling on Grid systems. Scalable Computing: Practice and Experience, 8(3):301–311, 2007.
• [26] Matyska L., Ruda M., ˇSimon T´oth.: Work towards peer-to-peer scheduling architecture for the czech national grid. [in:] Cracow Grid Workshop (CGW 2010). Cyfronet AGH, 2010.
• [27] MetaCentrum, February 2012. http://www.metacentrum.cz/.
• [28] Mu’alem A. W., Feitelson D. G.: Utilization, predictability, workloads, and user runtime estimates in scheduling the IBM SP2 with backfilling. IEEE Transactions on Parallel and Distributed Systems, 12(6):529–543, 2001.
• [29] Skovira J., Chan W., Zhou H., Lifka D.: The EASY – LoadLeveler API project. [in:] Feitelson D. G., Rudolph L., editors, Job Scheduling Strategies for Parallel Processing, volume 1162 of LNCS, pp. 41–47. Springer, 1996.
• [30] Smith W., Foster I., Taylor V.: Scheduling with advanced reservations. [in:] V´aclav Chlumsk´y, Dalibor Klus´aˇcek, Miroslav Ruda ternational Parallel and Distributed Processing Symposium (IPDPS ’00), pp. 127–132, 2000.
• [31] S¨uß W., Jakob W., Quinte A., Stucky K.-U.: GORBA: A global optimising resource broker embedded in a Grid resource management system. [in:] International Conference on Parallel and Distributed Computing Systems, PDCS 2005, pp. 19–24. IASTED/ACTA Press, 2005.
• [32] Thain D., Tannenbaum T., Livny M.: Condor and the Grid. [in:] Berman F., Fox G., Hey T., editors, Grid Computing: Making the Global Infrastructure a Reality. John Wiley & Sons Inc., 2002.
• [33] Tsafrir D.: Using inaccurate estimates accurately. [in:] Frachtenberg E., Schwiegelshohn U., editors, Job Scheduling Strategies for Parallel Processing, volume 6253 of LNCS, pages 208–221. Springer Verlag, 2010.
• [34] Xhafa F., Abraham A.: Metaheuristics for Scheduling in Distributed Computing Environments, volume 146 of Studies in Computational Intelligence. Springer, 2008.
• [35] Xhafa F., Abraham A.: Computational models and heuristic methods for Grid scheduling problems. Future Generation Computer Systems, 26(4):608–621, 2010.
• [36] Xu M. Q.: Effective metacomputing using LSF multicluster. [in:] CCGRID ’01: Proceedings of the 1st International Symposium on Cluster Computing and the Grid, pp. 100–105. IEEE, 2001.