DSD : Maintain Data Cubes More Efficiently

• Autorzy: Li H. , Huang H. , Lin Y.
• Języki publikacji: EN

Abstrakty

EN

A well-known challenge in data warehousing is the efficient incremental maintenance of data cube in the presence of source data updates. In this paper, we present a new incremental maintenance algorithm, DSD, developed from Mumick's algorithm. Instead of using one auxiliary delta table, we use two tables to improve efficiency of data update. Moreover, when a materialized view has to be recomputed, we use its smallest ancestral view's data, while Mumick uses the fact table which is usually much lager than its smallest ancestor. We have implemented DSD algorithm and found that its performance shows a significant improvement.

Słowa kluczowe

EN

data warehousing; data cube; incremental maintenance

• Wydawca: IOS Press
• Czasopismo: Fundamenta Informaticae
• Rocznik: 2004
• Tom: Vol. 59, nr 2,3
• Strony: 173--190
• Opis fizyczny: Bibliogr. 31 poz., tab., wykr.

Twórcy

autor

Li H.

• Department of Computer Science and Technology, Northern Jiaotong University, Beijing, China, 100044

autor

Huang H.

• Department of Computer Science and Technology, Northern Jiaotong University, Beijing, China, 100044

autor

Lin Y.

• Department of Computer Science and Technology, Northern Jiaotong University, Beijing, China, 100044

Bibliografia

• [1] Agrawal, D., El Abbadi, A., Singh. A., Yurek. Т.: Efficient view maintenance at data warehouses. In Proceedings 1997 ACM International Conference on Management of Data, 1997,417-427
• [2] Agarwal, S., Agrawal, R., Deshpande, P.M., Gupta, A., Naughton, J. F., Ramakrishnan, R., Sarawagi, S.: On the computation of multidimensional aggregates. In Proceedings 22nd VLDB, Mumbai, 1996, 506-521
• [3] Ceri, S., Widom, J.: Deriving production rules for incremental view maintenance. In Proceedings of the Seventeenth International Conference on Very Large Data Bases, Barcelona, Spain, 1991, 577-589
• [4] Colby, L., Griffin, T., Libkin, L., Mumick, I., Trickey, H.: Algorithms for deferred view maintenance. In Proceedings SIGMOD'97, 1997,469-480
• [5] Ding, L., Zhang, X., Rundensteiner, E.A.: Scalable Maintenance of Multiple Interrelated Data Warehousing Systems. Technical Report WPI-CS-TR-00-16. Worcester Polytechnic Institute, Dept, of Computer Science, May 2000
• [6] Ding, L., Zhang, X., Rundensteiner. E.A.: The MRE wrapper approach: Enabling incremental view maintenance of data warehouses defined on multi-relation information sources. In Proceedings DOLAP. 1999, 292-299
• [7] О’Gorman, K., Agrawal, D., Amr El Abbadi: On the importance of tuning in incremental view maintenance: An experience case study. Technical Report TRCS00-04, University of California at Santa Barbara, Department of Computer Science, UCSB. Santa Barbara. CA, 92106, March 2000
• [8] O'Gorman, K., Agrawal, D., Amr El Abbadi: Posse: A Framework for Optimizing Incremental View Maintenance at Data Warehouse. Technical Report TRCS99-18, University of California at Santa Barbara, Department of Computer Science, UCSB, Santa Barbara, CA, 93106, June 1999
• [9] Gray, J., Bosworth, A., Layman, A., Pirahesh, H.: Data cube: A relational aggregation operator generalizing group-by, cross-tab, and sub-totals. In Proceedings 12th ICDE, New Orleans, 1996, 152-159
• [10] Gupta, A., Mumick, I.: Maintenance of materialized views: Problems, Techniques, and Applications. In IEEE Data Engineering Bulletin 18(2), 1995
• [11] Huyn, N.: Multiple-view self-maintenance in data warehousing environments. In Proceedings of the International Conference on Very Large Databases, 1997. 26-35
• [12] Inmon, W. H.: Building the Data Warehouse. Wiley, New York, 1996 2nd ed.
• [13] Kulkami, S., Mohania, M. K.: Concurrent maintenance of views using multiple versions. In Proceedings of International Database Engineering and Applications Symposium, 1999, 254-259
• [14] Labio, W., Yang, J., Cui, Y., Garcia-Molina, H., Widom, J.: Performance Issues in Incremental Warehouse Maintenance. Technical report, Stanford University Database Group, 1999
• [15] Ling, T.W., Sze, K.: Materialized view maintenance using version numbers. In Proceedings of the Sixth International Conference on Database Systems for Advanced Applications, 1999, 263-270
• [16] Liu, J., Vincent, M., Mohania, M. K.: Incremental maintenance of nested relational views. In Proceedings of 1999 IDEAS Conference, 1999, 197-205
• [17] Moro, G., Sartori, C.: Incremental Maintenance of multi-source views. In Proceedings Twelfth Australasian Database Conference, IEEE Computer Society. Brisbane. Australia. 2001
• [18] Mumick, I., Quass, D., Mumick, B.: Maintenance of data cubes and summary tables in a warehouse. In Proceedings ACM Intern. Conference on Management of Data, 1997
• [19] Papadias, D., Kalnis, P., Zhang, J., Tao, Y.: Efficient OLAP operations in spatial data warehouses. In Proceedings 7th Intern. Symposium on Spatial and Temporal Databases, Redondo Beach. 2001
• [20] Quass, D., Gupta, A., Mumick, I., Widom, J.: Making views self-maintainable for data warehousing. In Proceedings Parallel and Distributed Information Systems, 1996
• [21] Quass, D., Widom, J.: On-line warehouse view maintenance. In Proceedings of SIGMOD Conference. 1997, 393-404
• [22] Samtani, S., Mohania, M.K., Kumar, V., Kambayashi. Y.: Recent Advances and Research Problems in Data Warehousing. ER Workshops 1998
• [23] Samtani, S., Kumar, V., Mohania, M. K.: Self maintenance of multiple views in data warehousing. In Proceedings of ACM International Conference on Information and Knowledge Management, CIKM. 1999, 292-299
• [24] Sarawagi, S., Agrawal, R., Gupta, A.: On computing the data cube. Research report rj 10026. IBM Almadén Research Center. San Jose, California, 1996
• [25] Yang, J., Widom, J.: Incremental computation and maintenance of temporal aggregates. In Proceedings of the 17th International Conference on Data Engineering. Heidelberg, Germany, 2001, 51-60
• [26] Yang, J., Widom. J.: Temporal view self-maintenance. In Advances in Database Technology, EDBT'00, 2000, 395-412
• [27] Zhang. X., Rundensteiner, E. A.: DyDa: Dynamic Data Warehouse Maintenance in a Fully Concurrent Environment. Technical Report WPI-CS-TR-99-20, Worcester Polytechnic Institute, Dept, of Computer Science, July 1999
• [28] Zhang, X., Rundensteiner, E.A.: Integrating the maintenance and synchronization of data warehouses using a cooperative framework. Information Systems. 27(4) (2002) 219-243
• [29] Zhang, X., Ding, L., Rundensteiner, E.A.: PSWEEP: Parallel View Maintenance Under Concurrent Data Updates of Distributed Sources. Technical Report WPI-CS-TR-99-14, Worcester Polytechnic Institute, Dept, of Computer Science, 1999.
• [30] Yue Zhuge, Garcia-Molina, H., Hammer, J., Widom, J.: View maintenance in a warehousing environment. In Proceedings of SIGMOD Conference, 1995, 316-327
• [31] Yue Zhuge, Garcia-Molina., Wiener. J. L.: Consistency algorithms for multi-source warehouse view maintenance. Distributed and Parallel Databases 6(1) (1998) 7-40