Towards implementing virtual data infrastructures - a case study with iRODS

• Autorzy: Roblitz T.
• Języki publikacji: EN

Abstrakty

EN

Scientists demand easy-to-use, scalable and flexible infrastructures for sharing, managing and processing their data spread over multiple resources accessible via different technologies and interfaces. In our previous work, we developed the conceptual framework VISPA for addressing these requirements. This paper provides a case study assessing the integrated Rule-Oriented Data System (iRODS) for implementing the key concepts of VISPA. We found that iRODS is already well suited for handling metadata and sharing data. Although it does not directly support provenance information of data and the temporal provisioning of data, basic forms of these capabilities may be provided through its customization mechanisms, ie rules and micro-services.

Słowa kluczowe

EN

data management; virtual infrastructures; metadata handling; provenance information; data provisioning

• Wydawca: Wydawnictwa AGH
• Czasopismo: Computer Science
• Rocznik: 2012
• Tom: Vol. 13 (4)
• Strony: 21--33
• Opis fizyczny: Bibliogr. 26 poz., rys., tab.

Twórcy

autor

Roblitz T.

• Gesellschaft für wissenschaftliche Datenverarbeitung mbH Göttingen, Germany,

Bibliografia

• [1] Amazon Simple Storage Service (Amazon S3), December 2011.
• [2] Aschenbrenner A.: Reference Framework for Distributed Repositories — Towards an Open Repository Environment. PhD thesis, Georg-August-Universit¨at Gottingen, Gottingen, 2009.
• [3] gLite — Lightweight Middleware for Grid Computing, September 2011.
• [4] GNDMS — Generation N Data Management System, September 2011.
• [5] Gottloeber S., Hoffman Y., Yepes G.: Constrained local universe simulations. In Proc. HPCSE ’09, Garching, Germany, 2010.
• [6] The Globus Toolkit, September 2011.
• [7] Hupfeld F., Cortes T., Kolbeck B., Stender J., Focht E., Hess M., Malo J., Marti J., Cesario E.: The XtreemFS architecture – a case for object-based file systems in Grids. CCPE, 20(17):2049–2060, 2008. Towards implementing virtual data infrastructures (...) 31
• [8] iRODS, December 2011.
• [9] Kahn R., Wilensky R.: A framework for distributed digital object services. International Journal on Digital Libraries, 6:115–123, 2006.
• [10] Kasztelnik M., Gubala T., Malawski M., Bubak M.: Development and execution of collaborative application on the virolab virtual laboratory. In Proc. of the Cracow Grid Workshop 2007, Cracow, Poland, pp. 41–46. ACC CYFRONET AGH, 2007.
• [11] Lagoze C., Payette S., Shin E., Wilper C.: Fedora: an architecture for complex objects and their relationships. International Journal on Digital Libraries, 6:124–138, 2006.
• [12] Marciano R., Moore R. W., Zhu B.: Enabling inter-repository access management between irods and fedora. In Proc. of the 4th International Conference on Open Repositories, Atlanta, Georgia, USA. Georgia Institute of Technology, 2009.
• [13] MultiDark Database, December 2011.
• [14] PANGAEA — Data Publisher for Earth & Environmental Science, December 2011.
• [15] Plale B., Gannon D., Alameda J., Wilhelmson B., Hampton S., Rossi A., Droegemeier K.: Active management of scientific data. Internet Computing, IEEE, 9(1):27–34, 2005.
• [16] Razum M., Schwichtenberg F., Wagner S., Hoppe M.: eSciDoc infrastructure: a fedora-based e-Research framework. Research and Advanced Technology for Digital Libraries, pp. 227–238, 2009.
• [17] RDF Primer. W3C Recommendation. Technical Report, February 2004.
• [18] Roblitz T., Enke H., Riebe K., Fritzsch B., Klump J.: A vision for virtual infrastructures for storing and processing scientific data. Technical Report 839, University of Technology Dortmund, Germany, September 2011.
• [19] Sandberg R., Goldberg D., Kleiman S., Walsh D., Lyon B.: Design and implementation of the sun network filesystem. In Proc. of the Summer 1985 USENIX Conference, pp. 119–130, 1985.
• [20] Schlauch T., Eifer A., Soddemann T., Schreiber A.: A data management system for unicore 6. In H.-X. Lin, M. Alexander, M. Forsell, A. Kn¨upfer, R. Prodan, L. Sousa, A. Streit, eds., Euro-Par 2009 Parallel Processing Workshops, vol. 6043 of Lecture Notes in Computer Science, pp. 353–362. Springer, Berlin / Heidelberg, 2010.
• [21] Schwan P.: Lustre: Building a file system for 1000-node clusters. In Proc. of the 2003 Linux Symposium. Citeseer, 2003.
• [22] Shu N. C., Housel B. C., Taylor R. W., Ghosh S.P., Lum V. Y.: Express: A data extraction, processing, and restructuring system. ACM Trans. Database Syst., pp. 134–174, 1977.
• [23] UNICORE — Distributed computing and data resources, September 2011. 32
• [24] Wan M., Moore R., Rajasekar A.: Integration of cloud storage with data grids. In Proc. of the Third International Conference on the Virtual Computing Initiative, Research Triangle Park, NC, USA, 2009.
• [25] Weil S. A., Brandt S. A., Miller E. L., Long D. D. E., Maltzahn C.: Ceph: a scalable, high-performance distributed file system. In Proc. of the 7th symposium on Operating systems design and implementation, OSDI ’06, pp. 307–320, Berkeley, CA, USA, 2006. USENIX Association.
• [26] Yang E., Matthews B., Wilson M.: Enhancing the core scientific metadata model to incorporate derived data. eScience, IEEE International Conference on, 0:145– 152, 2010.