An Uncertainty Measure Based on Lower and Upper Approximations for Generalized Rough set Models

• Autorzy: Wang Zhaohao , Yue Huifang , Deng Jianping

Identyfikatory

DOI

10.3233/FI-2019-1803

• Języki publikacji: EN

Abstrakty

EN

Uncertainty measures are an important tool for analyzing data. There is the uncertainty of a rough set caused by its boundary region in rough set models. Thus the uncertainty measurement issue is also an important topic for rough set theory. Shannon entropy has been introduced into rough set theory. However, there are relatively few studies on the uncertainty measure in generalized rough set models. We know that the boundary region of a rough set is closely related to the upper and lower approximations in rough set models. In this paper, from the viewpoint of the upper and lower approximations, we propose new uncertainty measures, the upper rough entropy and the lower rough entropy, in generalized rough set models. Then we focus on the investigations of the upper rough entropy, and give the concepts of the upper joint entropy, the upper conditional entropy and the mutual information with respect to a general binary relation. Some important properties of these measures are obtained. The connections among these measures are given. Furthermore, comparing with the existing uncertainty measures, the upper rough entropy has high distinguishing degree. Theoretical analysis and experimental results show that the proposed entropy is better effective than some existing measures.

Słowa kluczowe

EN

generalized rough set; granularity; rough entropy; uncertainty measure

• Wydawca: IOS Press
• Czasopismo: Fundamenta Informaticae
• Rocznik: 2019
• Tom: Vol. 166, nr 3
• Strony: 273--296
• Opis fizyczny: Bibliogr. 34 poz., tab., wykr.

Twórcy

autor

Wang Zhaohao

• School of Mathematics and Computer Science, Shanxi Normal University, Shanxi, Linfen, 041000, P.R. China

autor

Yue Huifang

• School of Mathematics and Computer Science, Shanxi Normal University, Shanxi, Linfen, 041000, P.R. China

autor

Deng Jianping

• School of Mathematics and Computer Science, Shanxi Normal University, Shanxi, Linfen, 041000, P.R. China

Bibliografia

• [1] Beaubouef T., Petry F., and Arora G. Information-theoretic measures of uncertainty for rough sets and rough relational databases, Information Sciences, 1998; 109(1-4):185-195. URL https://doi.org/10.1016/S0020-0255(98)00019-X.
• [2] Chen Y., Xue Y., Ma Y. and Xu F. Measures of uncertainty for neighborhood rough sets, Knowledge-Based Systems, 2017; 120:226-235. URL https://doi.org/10.1016/j.knosys.2017.01.008.
• [3] Düentsch I., and Gediga G. Uncertainty measures of rough set prediction, Artificial Intelligence, 1998; 106:109-137.
• [4] Dai J., and Hao W. Entropy measures and granularity measures for set-valued information systems, Information Sciences, 2013; 240:72-82. URL https://doi.org/10.1016/j.ins.2013.03.045.
• [5] Dai J., Wang W., and Xu Q. An uncertainty measure for incomplete decision tables and its applications, IEEE Transactions on Cybernetics, 2013; 43(4):1277-1289. doi:10.1109/TSMCB.2012.2228480.
• [6] Dai J., Wang W., Tian H., and Liu L. Attribute selection based on an new conditional entropy for incomplete decision systems, Knowledge-Based Systems, 2013; 39:207-213. URL https://doi.org/10.1016/j.knosys.2012.10.018.
• [7] Hernandez E., and Rcasens J. A reformulation of entropy in the presence of indistinguishability operators, Fuzzy Sets and Systems, 2002; 128:185-196. URL https://doi.org/10.1016/S0165-0114(01)00143-9.
• [8] Hu Q., Zhang L., Zhang D., Pan W., An S., and Pedrycz W. Measuring relevance between discrete and continuous features based on neighborhood mutual information, Expert Systems with Applications, 2011; 38:10737-10750. URL https://doi.org/10.1016/j.eswa.2011.01.023.
• [9] Kryszkiewicz M. Rough set approach to incomplete information systems, Information Sciences, 1998; 112:39-49. URL https://doi.org/10.1016/S0020-0255(98)10019-1.
• [10] Lin T.Y. Neighborhood systems-application to qualitative fuzzy and rough sets, in: P.P. Wang (Ed.), Advances in Machine Intelligence and Soft Computing IV, Department of Electrical Engineering Durham North Carolina, 1997, pp. 132-155.
• [11] Liang J., Dang C., Chin K., and Richard C. A new method for measuring uncertainty and fuzziness in rough set theory, International Journal of General Systems, 2002; 31(4):331-342. URL https://doi.org/10.1080/0308107021000013635.
• [12] Luo C., Li T., Yi Z., and Fujita H. Matrix approach to decision-theoretic rough sets for evolving data, Knowledge-Based Systems, 2016; 99:123-134. URL https://doi.org/10.1016/j.knosys.2016. 01.042.
• [13] Liu G. The axiomatization of the rough set upper approximation operations, Fundamenta Informaticae, 2006; 69:331-342.
• [14] Miao D., and Wang J. On the relationships between information entropy and roughness of knowledge in rough set theory, Pattern Recognition and Artificial Intelligence, 1998; 11:34-40 (in Chinese).
• [15] Miao D., and Wang J. An information representation of concepts and operations in rough set theory, Journal of Software, 1999; 10(2):113-116 (in Chinese).
• [16] Mi J., Leung Y., and Wu W. An uncertainty measure in partition-based fuzzy rough sets, International Journal of General Systems, 2005; 34:77-90. URL https://doi.org/10.1080/03081070512331318329.
• [17] Z. Pawlak, Rough sets, International Journal of Computer and Information Sciences 11 (1982) 341-356.
• [18] Pawlak Z., and Skowron A. Rudiments of rough sets, Information Sciences, 2007; 177:3-27. URL https://doi.org/10.1016/j.ins.2006.06.003.
• [19] Qian Y., and Liang J. Combination entropy and combination granulation in rough set theory, International Journal of Uncertainty, Fuzziness and Knowledge-Based Systems, 2008; 16:179-193. URL https://doi.org/10.1142/S0218488508005121.
• [20] Qian Y., Xu H., Liang J., Liu B., and Wang J. Fusing monotonic decision trees, IEEE Transactions on Knowledge and Data Engineering, 2015; 27(10):2717-2728. doi:10.1109/TKDE.2015.2429133.
• [21] Shannon C.E. A mathematical theory of communication, Bell System Technical Journal, 1948; 27:379-656.
• [22] Sierpiński W. General Topology (C. Krieger, Trans.), University of Toronto, Toronto, 1956.
• [23] Wang C., He Q., Shao M., Xu Y., and Hu Q. A unified information measure for general binary relations, Knowledge-Based Systems, 2017; 135:18-28. URL https://doi.org/10.1016/j.knosys.2017.07.017.
• [24] Wang G., Yu H., and Yang D. Decision table reduction based on conditional information entropy, Chinese Journal of Computers, 2002; 25(7):759-766.
• [25] Wierman M. Measuring uncertainty in rough set theory, International Journal of General Systems, 1999; 28:283-297. URL https://doi.org/10.1080/03081079908935239.
• [26] Xu W., and Yu J. A novel approach to information fusion in multi-source datasets: a granular computing viewpoint, Information Sciences, 2017;378:410-423. URL https://doi.org/10.1016/j.ins.2016.04.009.
• [27] Yao Y.Y. Relational interpretations of neighborhood operators and rough set approximation operators, Information Sciences, 1998; 111:239-259. URL https://doi.org/10.1016/S0020-0255(98)10006-3.
• [28] Yao Y.Y. Probabilistic approaches to rough sets, Expert Systems, 2003; 20:287-297. URL https://doi.org/10.1111/1468-0394.00253.
• [29] Yao Y.Y. Constructive and algebraic methods of theory of rough sets, Information Sciences, 1998; 109:21-47. URL https://doi.org/10.1016/S0020-0255(98)00012-7.
• [30] Zhang X., Mei C., Chen D., and Li J. Feature selection in mixed data: a method using a novel fuzzy rough set-based information entropy, Pattern Recognition, 2016; 56:1-15. URL https://doi.org/10.1016/j.patcog.2016.02.013.
• [31] Zhao H., Wang P., and Hu Q. Cost-sensitive feature selection based on adaptive neighborhood granularity with multi-level confidence, Information Sciences, 2016; 366:134-149. https://doi.org/10.1016/j.ins.2016.05.025.
• [32] Zhu P., and Wen Q. Information-theoretic measures associated with rough set approximations, Information Sciences, 2012; 212:33-43. URL https://doi.org/10.1016/j.ins.2012.05.014.
• [33] Zhu W. Relationship among basic concepts in covering-based rough sets, Information Sciences, 2009; 179(14):2478-2486. URL https://doi.org/10.1016/j.ins.2009.02.013.
• [34] Zheng T., and Zhu L. Uncertainty measures of neighborhood system-based rough sets, Knowledge-Based Systems, 2015; 86:57-65. URL https://doi.org/10.1016/j.knosys.2015.05.021.

Uwagi

Opracowanie rekordu w ramach umowy 509/P-DUN/2018 ze środków MNiSW przeznaczonych na działalność upowszechniającą naukę (2019).