Database replication for disconnected operations with quasi real-time synchronization

• Autorzy: Mucha Rafał , Baliś Bartosz , Grigoras Costin , Kitowski Jacek

Identyfikatory

DOI

10.7494/csci.2023.24.3.4831

• Języki publikacji: EN

Abstrakty

EN

Database replication is a way to improve system throughput or achieve high availability. In most cases, the use of an active-active replica architecture is efficient and easy to deploy. Such a system has CP properties (from the CAP theorem: consistency, availability, and network-partition tolerance). Creating an AP (available and partition-tolerant) system requires the use of multi-primary replication. Because of the many difficulties in its implementation, this approach is not widely used; however, ALICE’s deployment of CCDB (experiment conditions and calibration database) needs to be an AP system in two locations. This necessity became the inspiration for examining the state-of-the-art methods in this field and testing the available solutions. The tests that were performed evaluated the performance of the chosen replication tools: Bucardo, and EDB Replication Server; these showed that the tested tools could be successfully used for the continuous synchronization of two independent database instances.

Słowa kluczowe

EN

multi-primary database replication; Bucardo; EDB Replication Server; PostgreSQL; PostgresBDR; TPC; CAP theorem; continuous synchronization

• Wydawca: Wydawnictwa AGH
• Czasopismo: Computer Science
• Rocznik: 2023
• Tom: T. 24 (3)
• Strony: 407--426
• Opis fizyczny: Bibliogr. 37 poz., rys., tab.

Twórcy

autor

Mucha Rafał

• AGH University of Science and Technology, al. Mickiewicza 30, 30-059 Krakow

autor

Baliś Bartosz

• AGH University of Science and Technology, al. Mickiewicza 30, 30-059 Krakow

autor

Grigoras Costin

• CERN, Geneva

autor

Kitowski Jacek

• AGH University of Science and Technology, al. Mickiewicza 30, 30-059 Krakow

Bibliografia

• [1] 2ndquadrant – official page, https://www.2ndquadrant.com/en [Online; accessed25.05.2021].
• [2] ALICE experiment page, https : / / alice - collaboration.web.cern.ch [Online;accessed 22.10.2020].
• [3] Armstrong T.G., Ponnekanti V., Borthakur D., Callaghan M.: Linkbench: a database benchmark based on the facebook social graph. In: Proceedings of the 2013 ACM SIGMOD International Conference on Management of Data, pp. 1185–1196, 2013.
• [4] Azure Cosmos DB–conflicts handling documentation, https : / /docs.microsoft.com/en- us/azure/cosmos- db/how- to- manage- conflicts [Online;accessed 25.05.2021].
• [5] Backcountry company page, https : / / backcountry.com [Online;accessed25.05.2021].
• [6] Balis B., Bubak M., Harezlak D., Nowakowski P., Pawlik M., Wilk B.: Towards an operational database for real-time environmental monitoring and early warning systems. In: Procedia Computer Science, vol. 108, pp. 2250–2259, 2017.
• [7] BDR 1.0.7 Documentation, http : / / bdr - project.org / docs / stable/ [Online;accessed 30.03.2021].
• [8] Boicea A., Radulescu F., Agapin L.I.: MongoDB vs Oracle – database comparison. In: 2012 Third International Conference on Emerging Intelligent Data and Web Technologies, pp. 330–335, IEEE, 2012.
• [9] Brewer E.A.: Towards robust distributed systems. In: PODC’00: Proceedings of the nineteenth annual ACM symposium on Principles of distributed computing,vol. 7, pp. 343477–343502, Portland, OR, 2000.
• [10] Brun R., Rademakers F.: ROOT – an object oriented data analysis frame-work,Nuclear Instruments and Methods in Physics Research Section A:Accelerators, Spectrometers, Detectors and Associated Equipment, vol. 389(1–2),pp. 81–86, 1997.
• [11] Bucardo – official page, https : / / bucardo.org / Bucardo [Online; accessed25.05.2021].
• [12] Bucardo repository page, https://github.com/bucardo/bucardo [Online; accessed25.05.2021].
• [13] Chen S., Ailamaki A., Athanassoulis M., Gibbons P.B., Johnson R., Pandis I.,Stoica R.: TPC-E vs. TPC-C: Characterizing the new TPC-E benchmark via anI/O comparison study, ACM Sigmod Record, vol. 39(3), pp. 5–10, 2010.
• [14] Christensen D.:Bucardo presentation 1, https : / / bucardo.org / Bucardo /presentations / 2015 - Choosing - Logical - Replication.pdf [Online;accessed30.03.2021].
• [15] Cooper B.F., Silberstein A., Tam E., Ramakrishnan R., Sears R.: Benchmarking cloud serving systems with YCSB. In: Proceedings of the 1st ACM symposiumon Cloud computing, pp. 143–154, 2010.
• [16] Da Silva M.D., Tavares H.L.: Redis Essentials, Packt Publishing Ltd, 2015.
• [17] EDBReplication Server(6.2) Official Documentation, https : / /www.enterprisedb.com / edb - docs / static / docs / eprs / 6.2 / EDBPostgresReplicationServerUsersGuidev6.2.pdf [Online; accessed 30.03.2021].
• [18] EnterpriseDB – official page, https://www.enterprisedb.com [Online; accessed25.05.2021].
• [19] Eulisse G., Konopka P., Krzewicki M., Richter M., Rohr D., Wenzel S.: Evolutionof the ALICE Software Framework for Run 3. In: EPJ Web of Conferences, vol. 214, 05010, 2019.
• [20] Grastveit G., Helstrup H., Lindenstruth V., Loizides C., Roehrich D., Skaali B., Steinbeck T., et al.: FPGA co-processor for the ALICE high level trigger,arXivpreprint physics/0306017, 2003.
• [21] Grigoras C.: CCDB Conditions DB for Run 3, https : / / docs.google.com /presentation / d / 1RMIzqHL1JnDhwmqGjyTmxqjNb54hNoJwvFIgtldR6g /edit#slide=id.g25765cf80e03 [Online; accessed 25.05.2021].
• [22] Hsu W.W., Smith A.J., Young H.C.: Characteristics of production database workloads and the TPC benchmarks, IBM Systems Journal, vol. 40(3),pp. 781–802, 2001.
• [23] Hunt P., Konar M., Junqueira F.P., Reed B.: ZooKeeper: Wait-free Coordination for Internet-scale Systems. In: USENIXATC’10: Proceedings of the 2010 USENIX Conference on USENIX Annual Technical Conference, vol. 8, 2010.
• [24] Kemme B., Jimenez-Peris R., Patino-Martınez M.: Database replication, Synthesis Lectures on Data Management, vol. 5(1), 2010.
• [25] Kolonko K.: Performance comparison of the most popular relational and non-relational database management systems. Master thesis, Faculty of Computing Blekinge Institute of Technology, 2018.
• [26] Kreps J., Narkhede N., Rao J.: Kafka: A distributed messaging system for log processing. In: Proceedings of the NetDB, vol. 11, pp. 1–7, 2011.
• [27] Legrand I., Newman H.B., Voicu R., Cirstoiu C., Grigoras C., Toarta M., Do-bre C.: MonALISA: An agent based, dynamic service system to monitor, controland optimize grid based applications. In: Computing in High Energy Physicsand Nuclear Physics. Proceedings, Conference, CHEP’04, Interlaken, Switzerland, September 27 – October 1, 2004, CERN, 2004.
• [28] Moiz S.A., Sailaja P., Venkataswamy G., Pal S.N.: Database replication: A survey of open source and commercial tools, International Journal of Computer Applications, vol. 13(6), pp. 1–8, 2011.
• [29] Nakanishi H., Yamanaka K., Tokunaga S., Ozeki T., Homma Y., Ohtsu H.,Ishii Y.,et al.: Design for the distributed data locator service for multisite data repositories, Fusion Engineering and Design, vol. 165, 112197, 2021.doi: https://doi.org/10.1016/j.fusengdes.2020.112197.
• [30] Nambiar R., Poess M.: Keeping the TPC relevant! vol. 6, pp. 1186–1187, VLDB Endowment, 2013.
• [31] Naqvi S.N.Z., Yfantidou S., Zimanyi E.: Time series databases and influxdb. Universite Libre de Bruxelles, 2017.
• [32] Pgpool-II – official page, https://www.pgpool.net [Online; accessed 25.05.2021].
• [33] PostgresSQL – official documentation, https://www.postgresql.org/docs [Online;accessed 17.08.2021].
• [34] Reniers V., Van Landuyt D., Rafique A., Joosen W.: On the state of NoSQL benchmarks. In: CPE ’17 Companion: Proceedings of the 8th ACM/SPEC on International Conference on Performance Engineering Companion, pp. 107–112, 2017.
• [35] Stonebraker M., Rowe L.A.: The design of POSTGRES, ACM Sigmod Record, vol. 15(2), pp. 340–355, 1986.
• [36] Wall L., Christiansen T., Orwant J.: The Perl programming language, 1994.
• [37] Zeus supercomputer page in ACK Cyfronet, https://www.cyfronet.krakow.pl/13385,artykul,superkomputerzeus.html [Online; accessed 25.05.2021].