Method for control of technical objects operation process with the use of semi - Markov decision processes

• Autorzy: Migawa K.
• Języki publikacji: EN

Abstrakty

EN

In this article there is presented a description of a method for control of the operation process in a complex operation system of technical objects operation where semi-Markov decision processes are used for control. The study has been based on the operation process of a real bus municipal transportation system. For complex systems of technical objects operation, it is possible to achieve the set goal – appropriate accomplishment of the assigned task (tasks) with required efficiency - only when the control decisions, made by the system decision-makers, are rational. In systems where the complex operation process of technical objects is carried out, the choice of rational control decisions (from possible variants) is an issue of great importance and difficulty. In real complex operation systems of technical objects operation, the process of making control decisions should be carried out using mathematical procedures and methods, rather than according to the system decision makers' intuition or experience. Use of appropriate mathematical methods for control of the operation process facilitates the choice of rational control decisions providing correct and efficient accomplishment of the assigned tasks. The presented method involves elaborating a mathematical operation model (semi-Markov model) and choosing the best control strategy (from possible decision variants), according to the accepted criterion (criteria) of technical objects operation system assessment.

Słowa kluczowe

EN

semi-Markov processes; control decisions; transport system

• Wydawca: Łukasiewicz Research Network - Institute of Aviation ; European Science Society of Powertrain and Transport KONES Poland ; Wydawnictwo Instytutu Technicznego Wojsk Lotniczych
• Czasopismo: Journal of KONES
• Rocznik: 2012
• Tom: Vol. 19, No. 4
• Strony: 439--447
• Opis fizyczny: Bibliogr. 18 poz., rys.

Twórcy

autor

Migawa K.

• University of Technology and Life Sciences Prof. S. Kaliskiego Street 7, 85-789 Bydgoszcz, Poland tel.: [phone],

Bibliografia

• [1] Cao, X.-R., Semi-Markov decision problems and performance sensitivity analysis, IEEE Transactions on Automatic Control, Vol. 48, No. 5, 2003.
• [2] Grabski, F., Analiza ryzyka w decyzyjnych semi-markowskich modelach procesu eksploatacji, XXXVIII Zimowa Szkoła Niezawodności, Szczyrk 2010.
• [3] Grabski, F., Semi-markowskie modele niezawodności i eksploatacji, Badania systemowe, Tom 30, Warszawa 2002.
• [4] Grabski, F., Teoria semi-markowskich procesów eksploatacji obiektów technicznych, Zeszyty Naukowe AMW, Nr 75A, Gdynia1982.
• [5] Grabski, F., Jaźwiński, J., Funkcje o losowych argumentach w zagadnieniach niezawodności, bezpieczeństwa i logistyki, WKiŁ, Warszawa 2009.
• [6] Goldberg, D. E., Algorytmy genetyczne i ich zastosowanie, WNT, Warszawa 2003.
• [7] Howard, R. A., Dynamic probabilistic systems, Semi-Markov and decision processes, Vol. 2, John Wiley, New York 1971.
• [8] Iosifescu, M., Skończone procesy Markowa i ich zastosowanie, PWN, Warszawa 1988.
• [9] Jaźwiński, J., Grabski, F., Niektóre problemy modelowania systemów transportowych,Instytut Technologii Eksploatacji, Warszawa-Radom 2003.
• [10] Kashtanov, V. A., Controlled semi-Markov processes in modelling of the reliability and Kashtanov, V. A., Controlled semi-Markov processes in modelling of the reliability and redundancy maintenance of queueing systems, Applied Statistics and Operation Research, Vol. 14, 2010.
• [11] Koroluk, V. S., Turbin, A. F., Semi-Markov processes and their application, Naukova Dumka, Kiev 1976.
• [12] Kowalenko, I. N., Kuzniecow, N. J., Szurienkow, W. M., Procesy stochastyczne. Poradnik, PWN, Warszawa 1989.
• [13] Kulkarni, V. G., Modelling and analysis of stochastic systems, Chapman & Hall, New York 1995.
• [14] Kusiak, J., Danielewska-Tułecka, A., Oprocha, P., Optymalizacja. Wybrane metody z przykładami zastosowań, PWN, Warszawa 2009.
• [15] Leszczyński, J., Modelowanie systemów i procesów transportowych, Wydawnictwo Politechniki Warszawskiej, Warszawa 1994.
• [16] Mine, H., Osaki, S., Markovian decision processes, AEPCI, New York 1970.
• [17] Migawa, K., Semi-Markov model of the availability of the means of municipal transport system, Zagadnienia Eksploatacji Maszyn, 3(159), Vol. 44, Radom 2009.
• [18] Puterman, M. L., Markov decision processes, John Wiley, New York 1994.