Practical experiences with Torque meta-scheduling in the Czech National Grid

• Autorzy: Toth S. , Ruda M.
• Języki publikacji: EN

Abstrakty

EN

The Czech National Grid Infrastructure went through a complex transition in the last year. The production environment has been switched from a commercial batch system PBSPro, which was replaced by an open source alternative Torque batch system. This paper concentrates on two aspects of this transition. First, we will present our practical experience with Torque being used as a production ready batch system. Our modified version of Torque, with all the necessary PBSPro exclusive features re-implemented and further extended with new features like cloud-like behaviour, was deployed across the entire production environment, covering the entire Czech Republic for almost a full year. In the second part, we will present our work on meta-scheduling. This involves our work on distributed architecture and cloud-grid convergence. The distributed architecture was designed to overcome the limitations of a central server setup, which was originally used and presented stability and performance issues. While this paper does not discuss the inclusion of cloud interfaces into grids, it does present the dynamic infrastructure, which is a requirement for sharing the grid infrastructure between a batch system and a cloud gateway. We are also inviting everyone to try out our fork of the Torque batch system, which is now publicly available.

Słowa kluczowe

EN

TORQUE; grid scheduling; virtualization; cloud

• Wydawca: Wydawnictwa AGH
• Czasopismo: Computer Science
• Rocznik: 2012
• Tom: Vol. 13 (2)
• Strony: 33--45
• Opis fizyczny: Bibliogr. 13 poz., rys.

Twórcy

autor

Toth S.

• CESNET z.s.p.o., Zikova 4, 160 00 Praha 6, Czech Republic

autor

Ruda M.

• CESNET z.s.p.o., Zikova 4, 160 00 Praha 6, Czech Republic

Bibliografia

• [1] Barham P., Dragovic B., Fraser K., Hand S., Harris T., Ho A., Neugebar R., Pratt I., Warfield A.: Xen and the Art of Virtualization. [in:] ACM Symposium on Operating Systems Principles (SOSP), 2003.
• [2] Chlumsk´y V., Klusacek D., Ruda M.: The Extension of Torque Scheduler Allowing the Use of Planing and Optimization Algorithms in Grids.
• [3] Denemark J., Ruda M.: Magrathea – Scheduling Virtual Grids with Preemption. [in:] Cracow’08 Grid Workshop, 2009.
• [4] et al. D. A.: VirtCloud: Virtualising Network for Grid Environments – First Experiences. [in:] AINA, 2009.
• [5] Foster I.: Globus Toolkit Version 4: Software for Service-Oriented Systems. [in:] IFIP International Conference on Network and Parallel Computing, pp. 2–13, 2006.
• [6] Henderson R., Tweten D.: Portable Batch System: External reference Specification. NASA, Ames Research Center, 1996.
• [7] Jackson D., Snell Q., Clement M.: Core Algorithms of the Maui Scheduler. [in:] Proceedings of 7th Workshop on Job Scheduling Strategies for Parallel Processing, 2001.
• [8] Laure E., Hemmer F., Prelz F., Beco S., Fisher S., Livny M., Guy L., Barroso M., Buncic P., Kunszt P., Di Meglio A., Aimar A., Edlund A., Groep D., Pacini F., Sgaravatto M., Mulmo O.: Middleware for the next generation Grid infrastructure. [in:] Computing in High Energy Physics and Nuclear Physics (CHEP 2004), 2004.
• [9] Matyska L., Ruda M., Toth S.: Peer-to-peer Cooperative Scheduling Architecture for National Grid Infrastructure. [in:] Data Driven e-Science, pp. 105–118, 2011.
• [10] Neuman C., Yu T., Hartman S., Raeburn K.: The Kerberos Network Authentication Service (V5). RFC 4120 (Proposed Standard), July 2005. Updated by RFCs 4537, 5021, 5896, 6111, 6112, 6113.
• [11] Ruda M., Toth S.: Transition to Inter-Cluster Scheduling Architecture in Meta- Centrum. Technical Report 21, Cesnet, 2009. 44 ˇSimon Tóth, Miroslav Ruda
• [12] Ruda M., Sustr Z., Sitera J., Antos D., Hejtmanek L., Holub P., Mulac M.: Virtual Clusters as a New Service of MetaCentrum, the Czech NGI. [in:] Cracow’09 Grid Workshop, 2010.
• [13] Toth S., Ruda M., Matyska L.: Towards Peer-to-Peer Scheduling Architecture for the Czech National Grid. [in:] Bubak M., Tura la M., Wiatr K., editors, Cracow’10 Grid Workshop, pp. 92–101. ACC CYFRONET AGH, Krak´ow, 2011.