BeesyCluster as Front-End for High Performance Computing Services

• Autorzy: Czarnul P.
• Języki publikacji: EN

Abstrakty

EN

The paper presents the BeesyCluster system as a middleware allowing invocation of services on high performance computing resources within the NIWA Centre of Competence project. Access is possible through both WWW and SOAP Web Service interfaces. The former allows non-experienced users to invoke both simple and complex services exposed through easyto-use servlets. The latter is meant for integration of external applications with services made available from clusters or servers. Details of services such as APIs used for development as MPI, OpenMP, OpenCL as well as queuing systems are hidden from the user. The paper describes both the WWW and Web Service interfaces extended for use with files of large sizes. Mechanisms for selection of devices for execution of services are described along with experiments including remote invocations.

Słowa kluczowe

EN

BeesyCluster; high performance computing; services; Web Service interface

• Wydawca: Politechnika Gdańska
• Czasopismo: TASK Quarterly : scientific bulletin of Academic Computer Centre in Gdansk
• Rocznik: 2015
• Tom: Vol. 19, No 4
• Strony: 387--396
• Opis fizyczny: Bibliogr. 23 poz., rys., tab.

Twórcy

autor

Czarnul P.

• Faculty of Electronics, Telecommunications and Informatics, Gdansk University of Technology, Narutowicza 11/12, 80-233 Gdansk, Poland

Bibliografia

• [1] TOP500 Supercomputer Sites http://www.top500.org/
• [2] Chapman B, Jost G and Pas R v. d. 2007 Using OpenMP: Portable Shared Memory Parallel Programming (Scientific and Engineering Computation), The MIT Press
• [3] Sanders J and Kandrot E 2010 CUDA by Example: An Introduction to General-Purpose GPU Programming, Addison-Wesley Professional
• [4] Stone J E, Gohara D and Shi G 2010 Opencl: A parallel programming standard for heterogeneous computing systems, Computing in Science and Engineering 12 66
• [5] Wienke S, Springer P, Terboven C and Mey D 2012 Openacc: first experiences with real-world applicatio s, Proceedings of the 18th international conference on Parallel Processing; Euro-Par’12, Springer-Verlag 859
• [6] Chrysos G 2012 Intel R xeon phiTM coprocessor – the architecture; the first intel R many integrated core (intel R mic) architecture product, Intel Corporation https://software.intel.com/ en-us/articles/intel-xeon-phi-coprocessor-codename-knights-corner
• [7] Rahman R 2013 Intel R xeon phiTM coprocessor vector microarchitecture, Intel Software and Services Group https://software.intel.com/en-us/articles/intel-xeon-phi-coprocessor-vectormicroarchitecture
• [8] Fang J, Sips H, Zhang L, Xu C, Che Y and Varbanescu A L 2014 Test-driving intel xeon phi, In: Proceedings of the 5th ACM/SPEC International Conference on Performance Engineering. ICPE’14, ACM 137
• [9] Rosales C 2013 Porting to the intel xeon phi: Opportunities and challenges, In: Extreme Scaling Workshop (XSCALE13)
• [10] Schmidl D, Cramer T, Wienke S, Terboven C and M¨uller M 2013 Assessing the performance of openmp programs on the intel xeon phi, Springer Berlin Heidelberg, In Wolf F, Mohr B, Mey D, eds.: Euro-Par 2013 Parallel Processing; Volume 8097 of Lecture Notes in Computer Science 547
• [11] Forum M P I 2012 MPI: A Message-Passing Interface Standard Version 3.0
• [12] Malawski M, Bubak M and Nabrzyski J 2011 GridSpace scripting environment – from common component architecture to cloud components, CCA’11: Cloud Computing and Its Applications
• [13] Demuth B, Schuller B, Holl S, Daivandy J, Giesler A, Huber V and Sild S 2010 The unicore rich client: Facilitating the automated execution of scientific workflows, IEEE Sixth International Conference on e-Science 238
• [14] Russell M, Dziubecki P, Grabowski P, Krysinski M, Kuczynski T, Szejnfeld D, Tarnawczyk D, Wolniewicz G and Nabrzyski J 2007 The vine toolkit: A java framework for developing grid applications, In Wyrzykowski R, Dongarra J, Karczewski K, Wasniewski J, eds.: PPAM; Volume 4967 of Lecture Notes in Computer Science, Springer 331
• [15] Szejnfeld D, Dziubecki P, Kopta P, Krysinski M, Kuczynski T, Kurowski K, Ludwiczak B, Piontek T, Tarnawczyk D, Wolniewicz M, Domagalski P, Nabrzyski J and Witkowski K 2010 Vine toolkit – towards portal based production solutions for scientific and engineering communities with grid-enabled resources support, Scalable Computing: Practice and Experience 11
• [16] Czarnul P 2015 Integration of Services into Workflow Applications, Chapman & Hall/CRC Computer and Information Science Series, Taylor & Francis http://www.taylorandfrancis.com/books/details/9781498706469/
• [17] Czarnul P 2013 Modeling, run-time optimization and execution of distributed workflow applications in the jee-based beesycluster environment, The Journal of Supercomputing 63 46
• [18] Czarnul P 2014 Teaching high performance computing using beesycluster and relevant usage statistics, Procedia Computer Science 29 1458
• [19] Czarnul P 2006 Integration of compute-intensive tasks into scientific workflows in beesycluster, In Alexandrov V, Albada G, Sloot P, Dongarra J, eds.: Computational Science – ICCS 2006; Volume 3993 of Lecture Notes in Computer Science, Springer 944
• [20] Czarnul P, Bajor M, Frączak M, Banaszczyk A, Fiszer M and Ramczykowska K 2006 Remote task submission and publishing in beesycluster: Security and efficiency of web service interface, Springer, In Wyrzykowski R, Dongarra J, Meyer N, Wasniewski J, eds.: Parallel Processing and Applied Mathematics; Volume 3911 of Lecture Notes in Computer Science 220
• [21] Czarnul P and Kurylowicz J 2010 Automatic conversion of legacy applications into services in beesycluster, 2nd International Conference on Information Technology (ICIT) 21
• [22] Krawczyk H and Proficz J 2010 KASKADA – multimedia processing platform architecture, In Tsihrintzis GA., Virvou M, eds.: SIGMAP 2010 – Proceedings of the International Conference on Signal Processing and Multimedia Applications; SIGMAP is part of ICETE – The International Joint Conference on e-Business and Telecommunications, SciTePress 26
• [23] Krawczyk H and Downar M 2012 Commonly accessible web service platform-wiki-ws, In: Intelligent Tools for Building a Scientific Information Platform, Springer 251