A Multifaceted Analysis of Probabilistic Three-way Decisions

• Autorzy: Deng X. , Yao Y.

Identyfikatory

DOI

10.3233/FI-2014-1045

• Języki publikacji: EN

Abstrakty

EN

In situations where available information or evidence is incomplete or uncertain, probabilistic two-way decisions/classifications with a single threshold on probabilities for making either an acceptance or a rejection decision may be inappropriate. With the introduction of a third non-commitment option, probabilistic three-way decisions use a pair of thresholds and provide an effective and practical decision-making strategy. This paper presents a multifaceted analysis of probabilistic three-way decisions. By identifying an inadequacy of two-way decisions with respect to controlling the levels of various decision errors, we examine the motivations and advantages of three-way decisions. We present a general framework for computing the required thresholds of a three-way decision model as an optimization problem. We investigate two special cases, one is a decision-theoretic rough set model and the other is an information-theoretic rough set model. Finally, we propose a heuristic algorithm for finding the required thresholds.

Słowa kluczowe

EN

three-way decisions; probabilistic rough sets; decision-theoretic rough sets; information theoretic rough sets; information entropy; entropy minimization

• Wydawca: IOS Press
• Czasopismo: Fundamenta Informaticae
• Rocznik: 2014
• Tom: Vol. 132, nr 3
• Strony: 291--313
• Opis fizyczny: Bibliogr. 45 poz., tab.

Twórcy

autor

Deng X.

• Department of Computer Science, University of Regina Regina, Saskatchewan S4S 0A2, Canada

autor

Yao Y.

• Department of Computer Science, University of Regina Regina, Saskatchewan S4S 0A2, Canada

Bibliografia

• [1] Azam, N., Yao, J. T.: Analyzing uncertainties of probabilistic rough set regions with game-theoretic rough sets, International Journal of Approximate Reasoning, 55, 2014, 142–155.
• [2] Deng, X. F., Yao, Y. Y.: An information-theoretic interpretation of thresholds in probabilistic rough sets, Proc.7th International Conference on Rough Sets and Knowledge Technology (Li, T. R., Nguyen, H. S., Wang, G. Y., Grzymala-Busse, J., Janicki, R., Eds.), LNCS (LNAI) 7414, pp. 369–378, Springer, Heidelberg, 2012.
• [3] Duda, R. O., Hart, P. E., Stork, D. G.: Pattern Classification and Scene Analysis, Wiley-Interscience, New York, 1973.
• [4] Grzymala-Busse, J. W., Clark, P. G., Kuehnhausen, M.: Generalized probabilistic approximations of incomplete data, International Journal of Approximate Reasoning, 55, 2014, 180–196.
• [5] Herbert, J. P., Yao, J. T.: Learning optimal parameters in decision-theoretic rough sets, Proc. 4th International Conference on Rough Sets and Knowledge Technology (Wen, P., Li, Y., Polkowski, L., Yao, Y. Y., Tsumoto, S., Wang, G. Y., Eds.), LNCS (LNAI) 5589, pp. 610–617, Springer, Heidelberg, 2009.
• [6] Herbert, J. P., Yao, J. T.: Game-theoretic rough sets, Fundamenta Informaticae, 108, 2011, 267–286.
• [7] Jia, X. Y., Liao, W. H., Tang, Z. M., Shang, L.: Minimum cost attribute reduction in decision-theoretic rough set models, Information Sciences, 219, 2013, 151–167.
• [8] Jia, X. Y., Shang, L., Zhou, X. Z., Liang, J. Y., Miao, D. Q., Wang, G. Y., Li, T. R., Zhang, Y. P.: Theory of Three-way Decisions and Application (in Chinese), Nanjing University Press, Nanjing, China, 2012.
• [9] Jia, X. Y., Tang, Z. M., Liao, W. H., Shang, L.: On an optimization representation of decision-theoretic rough set model, International Journal of Approximate Reasoning, 55, 2014, 156–166.
• [10] Li, F., Ye, M., Chen, X. D.: An extension to rough c-means clustering based on decision-theoretic rough set model, International Journal of Approximate Reasoning, 55, 2014, 116–129.
• [11] Li, H. X., Zhou, X. Z.: Risk decision making based on decision-theoretic rough set: A three-way view decision model, International Journal of Computational Intelligence Systems, 4, 2011, 1–11.
• [12] Li, H. X., Zhou, X. Z., Li, T. R., Wang, G. Y., Miao, D. Q., Yao, Y. Y.: Decision-Theoretic Rough Set Theory and Recent Progress (in Chinese), Science Press, Beijing, China, 2011.
• [13] Li, H. X, Zhou, X. Z., Zhao, J. B., Huang, B.: Cost-sensitive classification based on decision-theoretic rough set model, Proc. 8th International Conference, Rough Sets and Current Trends in Computing (Yao, J. T., Yang, Y., Slowinski, R., Greco, S., Li, H., Mitra, S., Polkowski, L., Eds.), LNCS (LNAI) 7414, pp. 379–388,Springer, Heidelberg, 2012.
• [14] Li, H. X., Zhou, X. Z., Zhao, J. B., Liu, D.: Non-monotonic attribute reduction in decision-theoretic rough sets, Fundamenta Informaticae, 126, 1–18, 2013.
• [15] Li, T. J., Yang, X. P.: An axiomatic characterization of probabilistic rough sets, International Journal of Approximate Reasoning, 55, 2014, 130–141.
• [16] Liang, D. C., Liu, D., Pedrycz, W., Hu P.: Triangular fuzzy decision-theoretic rough sets, International Journal of Approximate Reasoning, 54, 2013, 1087–1106.
• [17] Lingras, P., Chen, M., Miao, D. Q.: Rough cluster quality index based on decision theory, IEEE Transactions on Knowledge and Data Engineering, 21, 1014–1026, 2009.
• [18] Lingras, P., Chen, M., Miao, D. Q.: Qualitative and quantitative combinations of crisp and rough clustering schemes using dominance relations, International Journal of Approximate Reasoning, 55, 2014, 238–258.
• [19] Liu, D., Li, H. X., Zhou, X. Z.: Two decades’ research on decision-theoretic rough sets, Proc. 9th IEEE International Conference on Cognitive Informatics and Cognitive Computing, 2010, pp. 968–973.
• [20] Liu, D., Li, T. R., Li, H. X.: A multiple-category classification approach with decision-theoretic rough sets, Fundamenta Informaticae, 115, 2012, 173–188.
• [21] Liu, D., Li, T. R., Liang, D. C.: Three-way government decision analysis with decision-theoretic rough sets, International Journal of Uncertainty, Fuzziness and Knowledge-Based Systems, 20, 119–132, 2012.
• [22] Liu, D., Li, T. R., Liang, D. C.: Incorporating logistic regression to decision-theoretic rough sets for classifications, International Journal of Approximate Reasoning, 55, 2014, 197–210.
• [23] Liu, D., Li, T. R., Miao, D. Q., Wang, G. Y., Liang, J. Y. (Eds.), Three-way Decisions and Granular Computing (in Chinese), Science Press, Beijing, China, 2013.
• [24] Liu, D., Li, T. R., Ruan, D.: Probabilistic model criteria with decision-theoretic rough sets, Information Sciences, 181, 2011, 3709–3722.
• [25] Liu, D., Yao, Y. Y., Li, T. R.: Three-way investment decisions with decision-theoretic rough sets, International Journal of Computational Intelligence Systems, 4, 2011, 66–74.
• [26] Min, F., Hu, Q. H., Zhu, W.: Feature selection with test cost constraint, International Journal of Approximate Reasoning, 55, 2014, 167–179.
• [27] Mitchell, T. M.: Machine Learning, McGraw Hill, New York, 1997.
• [28] Pawlak, Z.: Rough Sets: Theoretical Aspects of Reasoning about Data, Kluwer, Dordrecht, 1991.
• [29] Qian, Y. H., Zhang, H., Sang, Y. L., Liang, J. Y. Multigranulation Decision-theoretic Rough Sets, International Journal of Approximate Reasoning, 55, 2014, 255–237.
• [30] Quinlan, J. R.: Induction of decision trees, Machine Learning, 1, 1986, 81–106.
• [31] Wu, W. Z., Leung, Y.: Optimal scale selection for multi-scale decision tables, International Journal of Approximate Reasoning, 54, 2013, 1107–1129.
• [32] Yang, X. P., Yao, J. T.: Modelling multi-agent three-way decisions with decision-theoretic rough sets, Fundamenta Informaticae, 115, 157–171, 2012.
• [33] Yao, Y. Y.: Probabilistic approaches to rough sets, Expert Systems, 20, 2003, 287–297.
• [34] Yao, Y. Y.: Probabilistic rough set approximations, International Journal of Approximate Reasoning, 49, 2008, 255–271.
• [35] Yao, Y. Y.: Three-way decisions with probabilistic rough sets, Information Sciences, 180, 2010, 341–353.
• [36] Yao, Y. Y.: The superiority of three-way decisions in probabilistic rough set models, Information Sciences, 181, 2011, 1080–1096.
• [37] Yao, Y. Y.: An outline of a theory of three-way decisions, Proc. 7th International Conference, Rough Sets and Current Trends in Computing (Yao, J.T., Yang, Y., Slowinski, R., Greco, S., Li, H. X., Mitra, S., Polkowski, L., Eds.), LNCS (LNAI) 7413, pp. 1–17, Springer, Heidelberg, 2012.
• [38] Yao, Y. Y., Granular computing and sequential three-way decisions, Proc. 8th International Conference, Rough sets and Current Trends in Computing (Lingras, P., Wolski, M., Cornelis, C., Mitra, S., Wasilewski, P., Eds.), LNCS (LNAI) 8171, pp. 16–27, Springer, Heidelberg, 2013.
• [39] Yao, Y. Y., Deng, X. F.: Sequential three-way decisions with probabilistic rough sets, Proc. 10th IEEE International Conference on Cognitive Informatics and Cognitive Computing, 2011, pp. 120–125.
• [40] Yao, Y. Y., Wong, S. K. M.: A decision theoretic framework for approximating concepts, International Journal of Man-machine Studies, 37, 1992, 793–809.
• [41] Yao, Y. Y., Wong, S. K. M., Lingras, P. J.: A decision-theoretic rough set model, In: Methodologies for Intelligent Systems 5 (Z. W. Ras, M. Zemankova and M. L. Emrich, Eds.), North-Holland, New York, pp. 17–24,1990.
• [42] Yu, H., Chu, S. S., Yang, D. C.: Autonomous knowledge-oriented clustering using decision-theoretic rough set theory, Fundamenta Informaticae, 115, 141–156, 2012.
• [43] Yu, H., Liu, Z. G., Wang, G. Y.: An automatic method to determine the number of clusters using decision theoretic rough set, International Journal of Approximate Reasoning, 55, 2014, 101–115.
• [44] Zhang, Y.: Optimizing gini coefficient of probabilistic rough set regions using game-theoretic rough sets, Proc. the 26th Annual IEEE Canadian Conference on Electrical and Computer Engineering (CCECE 2013), Regina, Canada, 2013, DOI: http://dx.doi.org/10.1109/CCECE.2013.6567817
• [45] Zhou, B.: Multi-class decision-theoretic rough sets, International Journal of Approximate Reasoning, 55, 2014, 211–224.