Turkish Journal of Computer and Mathematics Education
Journal license

Journal

Turkish Journal of Computer and Mathematics Education


Volume
& Issue

Volume 13, Issue 3


Published
on


Pages

1017-1033


DOI

Article

On the general transformation of Markov chains


Authors

Soumia Benbakreti Affiliation:
Laboratoire de Mathématiques (LDM), Université Djillali Liabès, BP 89, Sidi bel Abbès, 22000, Algeria
and Abderrahmane Yousfate Affiliation:
Laboratoire de Mathématiques (LDM), Université Djillali Liabès, BP 89, Sidi bel Abbès, 22000, Algeria


Abstract

In this work, we consider a class of homogeneous irreducible discrete states Markov process , taking values in a partition of some topological space . Using a notion of fractional state , we introduce a general transformation such that remains a Markov process. This general transformation includes also lumpability. Infinite kinds of this expanded Markov chain can be constructed, however lumped Markov chains are finite or may not exist . Using general transformation and fractional states, we give a necessary and sufficient condition under which the transformed process remains still a Markov chain.


Keywords

Expanded Markov chain, fractional state, Markov chain, multivalued transformation


Citation

Benbakreti, S. & Yousfate, A. (2022). On the general transformation of markov chains. Turkish Journal of Computer and Mathematics Education, 13(3), 1017–1033.

Published by: Engineering Journals

Engineering Journals Logo