Extracting and updating data performance during bulk numerical calculations in databases

• Autorzy: Nazdrowicz J.
• Języki publikacji: EN

Abstrakty

EN

Nowadays, more complex engineering problems need to carry out increasingly complex numerical calculations. In order to obtain the results as soon as possible, engineers must simplify the physical model on the one hand, apply appropriately efficient infrastructure to carry out calculations on the other. This infrastructure includes both hardware and software. Problems in numerical calculations in scientific applications are often caused by non-optimal front-end application code implementation or by ineffective system of scientific data management at back-end. In this article author presents some aspects of performance problems when relational database is used as backend storage. Of course, the biggest problem in numerical computation processing is that the large amount of data stored on the storage area can slow down the entire computing system and in turn directly affects the computational efficiency. Presented examples come from simulated OLTP (Online Transactional Processing) environments with large load and many queries executed. These examples can reflect real problems with data processing in numerical calculations on data extracted from MSSQL Server database with large storage system connected.

Słowa kluczowe

EN

flat file; relational database; numerical methods; data management; performance

PL

plik płaski; relacyjna baza danych; metody numeryczne; zarządzanie danymi; wydajność

• Wydawca: Lodz University of Technology. Department of Microelectronics and Computer Science
• Czasopismo: International Journal of Microelectronics and Computer Science
• Rocznik: 2016
• Tom: Vol. 7, nr 4
• Strony: 140--146
• Opis fizyczny: Bibliogr. 9 poz., il., wykr.

Twórcy

autor

Nazdrowicz J.

• Department of Microelectronics and Computer Science, Lodz University of Technology, Lodz, Poland

Bibliografia

• [1] J. Gray, et al.: „Scientific Data Management in the Coming Decade” Microsoft Research Technical Report MSR-TR- 2005-10, 2005, available at: http://arxiv.org/ftp/cs/papers/0502/0502008.pdf
• [2] FE. Karaoulanis, C.G. Panagiotopoulos, E.A. Paraskevopoulos, „Recent developments in Finite Element programming”, First South-East European Conference on Computational Mechanics, SEECCM-06, Kragujevac, Serbia and Montenegro, June 28-30, 2006.
• [3] G. Heber, J. Gray, „Supporting Finite Element Analysis with a Relational Database Backend”, Technical Report MSR-TR-2005-49, April 2005, available at: http://research.microsoft.com/apps/pubs/default.aspx?id=64535.
• [4] J. Peng, D. Liu, K. H. Law, „An Online Data Access System for a Finite Element Program”, http://eig.stanford.edu/publications/jun_peng/ data_access_system.doc.
• [5] R.I. Mackie, „Using Objects to Handle Complexity in Finite Element Software”, Engineering with Computers, 13(2), 1997, pp 99-111.
• [6] P. Gulutzan, T. Pelzer, „SQL Performance Tuning”. Addison-Wesley Professional, Boston, 2003.
• [7] S. Dam, G. Fritchey, „SQL Server 2008 Query Performance Tuning Distilled”, Apress, New York, 2009.
• [8] K. Delaney, „Inside Microsoft SQL Server 2005”, The storage engine, Microsoft Press, Redmond 2007.
• [9] J. Nazdrowicz, „A Relational Database Environment for Numerical Simulation Backend Storage”, Proceedings of the 22nd International Conference „Mixed Design of Integrated Circuits and Systems”, June 25-27, 2015, Torun, Poland.