Dynamic, semi-dynamic and static word-based compression: a comparison of effectiveness

• Autorzy: Swacha J. , Skibiński P.
• Języki publikacji: EN

Abstrakty

EN

In this paper we present state-of-the-art algorithms implementing three competitive approaches to text document compression, based respectively on dynamic, semi-dynamic and static word dictionaries. We test them experimentally on a preselected sets of English and multilingual documents then discuss the results, explaining the strengths and weaknesses of each approach.

Słowa kluczowe

EN

text compression; static dictionary; semi-dynamic dictionary

PL

kompresja tekstu; słowniki statyczne; słownik pół-dynamiczny

• Wydawca: Komisja Informatyki Polskiej Akademii Nauk, Oddział w Gdańsku
• Czasopismo: Metody Informatyki Stosowanej
• Rocznik: 2009
• Tom: nr 1 (18)
• Strony: 107--118
• Opis fizyczny: Bibliogr. 16 poz., tab.

Twórcy

autor

Swacha J.

autor

Skibiński P.

• University of Szczecin, Faculty of Economics and Management

Bibliografia

• [1] Abramson, N.: Information Theory and Coding, McGraw-Hill, 1963.
• [2] Adiego, J.: mPPM: A Natural Language Text Compressor [online] http://www.infor.uva.es/~jadiego/download.php#mppm [access: 2009].
• [3] Cleary, J. G., Witten, I. H.: Data compression using adaptive coding and partial string matching, IEEE Transactions on Communications, vol. 32, 4, 1984, p. 396–402.
• [4] De Bock, J.: Ultimate Command Line Compressors [online] http://uclc.info [access: 2009].
• [5] Deutsch, P.: DEFLATE Compressed Data Format Specification version 1.3 [online] http://tools.ietf.org/html/rfc1951 [access: 2009].
• [6] Gantz, J. F., Chute, C., Manfrediz, A., Minton, S., Reinsel, D., Schlichting, W., Toncheva, A.: The Diverse and Exploding Digital Universe [online] http://www.emc.com/collateral/analyst-reports/diverse-exploding-digital-universe.pdf [access: 2009].
• [7] Gilchrist, J.: Archive Comparison Test [online] http://compression.ca/act/act-win.html [access: 2009].
• [8] Kaufman, Y., Klein, S. T.: Semilossless text compression, Data Compression Conference Proceedings, IEEE, 2004, p. 544.
• [9] Mahoney, M.: Adaptive Weighing of Context Models for Lossless Data Compression, Technical Report CS-2005-16, Florida Institute of Technology, 2005.
• [10] Pavlov, I.: LZMA Software Development Kit [online] http://www.7-zip.org/sdk.html [access: 2009].
• [11] Shkarin, D.: PPM: One Step to Practicality, Data Compression Conference Proceedings, IEEE, 2002, p. 202-211.
• [12] Skibiński, P.: Two-level directory based compression, Data Compression Conference Proceedings, IEEE, 2005, p. 481.
• [13] Skibiński, P., Grabowski, Sz. and Deorowicz S.: Revisiting dictionary-based compression, Software - Practice & Experience, 35, 15, 2005, p. 1455-1476.
• [14] Skibiński, P., Swacha, J. and Grabowski Sz.: A Highly Efficient XML Compression Scheme for the Web, LNCS 4910, 2008, p. 766-777.
• [15] Ziganshin, B.: DICT compression preprocessor [online] http://haskell.org/bz/ [access: 2009].
• [16] Ziv, J., Lempel, A.: “Compression of Individual Sequences via Variable-Rate Coding”. IEEE Transactions on Information Theory, vol. 24, 5, 1978, p. 530-536.