Advanced search
1 file | 210.54 KB Add to list
Author
Organization
Abstract
We consider the problem of characterising expected hitting times and hitting probabilities for imprecise Markov chains. To this end, we consider three distinct ways in which imprecise Markov chains have been defined in the literature: as sets of homogeneous Markov chains, as sets of more general stochastic processes, and as game-theoretic probability models. Our first contribution is that all these different types of imprecise Markov chains have the same lower and upper expected hitting times, and similarly the hitting probabilities are the same for these three types. Moreover, we provide a characterisation of these quantities that directly generalises a similar characterisation for precise, homogeneous Markov chains.

Downloads

  • (...).pdf
    • full text
    • |
    • UGent only
    • |
    • PDF
    • |
    • 210.54 KB

Citation

Please use this url to cite or link to this publication:

MLA
Krak, Thomas, Natan T’Joens, and Jasper De Bock. “Hitting Times and Probabilities for Imprecise Markov Chains.” Proceedings of the Eleventh International Symposium on Imprecise Probabilities: Theories and Applications. Ed. Jasper De Bock et al. Vol. 103. Thagaste, Ghent, Belgium: PMLR, 2019. 265. Print.
APA
Krak, T., T’Joens, N., & De Bock, J. (2019). Hitting Times and Probabilities for Imprecise Markov Chains. In Jasper De Bock, C. P. de Campos}, G. de Cooman}, E. Quaeghebeur, & G. Wheeler (Eds.), Proceedings of the Eleventh International Symposium on Imprecise Probabilities: Theories and Applications (Vol. 103, p. 265). Thagaste, Ghent, Belgium: PMLR.
Chicago author-date
Krak, Thomas, Natan T’Joens, and Jasper De Bock. 2019. “Hitting Times and Probabilities for Imprecise Markov Chains.” In Proceedings of the Eleventh International Symposium on Imprecise Probabilities: Theories and Applications, ed. Jasper De Bock, Cassio P. de Campos}, Gert de Cooman}, Erik Quaeghebeur, and Gregory Wheeler, 103:265. Thagaste, Ghent, Belgium: PMLR.
Chicago author-date (all authors)
Krak, Thomas, Natan T’Joens, and Jasper De Bock. 2019. “Hitting Times and Probabilities for Imprecise Markov Chains.” In Proceedings of the Eleventh International Symposium on Imprecise Probabilities: Theories and Applications, ed. Jasper De Bock, Cassio P. de Campos}, Gert de Cooman}, Erik Quaeghebeur, and Gregory Wheeler, 103:265. Thagaste, Ghent, Belgium: PMLR.
Vancouver
1.
Krak T, T’Joens N, De Bock J. Hitting Times and Probabilities for Imprecise Markov Chains. In: De Bock J, de Campos} CP, de Cooman} G, Quaeghebeur E, Wheeler G, editors. Proceedings of the Eleventh International Symposium on Imprecise Probabilities: Theories and Applications. Thagaste, Ghent, Belgium: PMLR; 2019. p. 265.
IEEE
[1]
T. Krak, N. T’Joens, and J. De Bock, “Hitting Times and Probabilities for Imprecise Markov Chains,” in Proceedings of the Eleventh International Symposium on Imprecise Probabilities: Theories and Applications, 2019, vol. 103, p. 265.
@inproceedings{8627473,
  abstract     = {We consider the problem of characterising expected hitting times and hitting probabilities for imprecise Markov chains. To this end, we consider three distinct ways in which imprecise Markov chains have been defined in the literature: as sets of homogeneous Markov chains, as sets of more general stochastic processes, and as game-theoretic probability models. Our first contribution is that all these different types of imprecise Markov chains have the same lower and upper expected hitting times, and similarly the hitting probabilities are the same for these three types. Moreover, we provide a characterisation of these quantities that directly generalises a similar characterisation for precise, homogeneous Markov chains.},
  author       = {Krak, Thomas and T'Joens, Natan and De Bock, Jasper},
  booktitle    = {Proceedings of the Eleventh International Symposium on Imprecise Probabilities: Theories and Applications},
  editor       = {De Bock, Jasper and de Campos}, Cassio P. and de Cooman}, Gert and Quaeghebeur, Erik and Wheeler, Gregory},
  publisher    = {PMLR},
  title        = {Hitting Times and Probabilities for Imprecise Markov Chains},
  volume       = {103},
  year         = {2019},
}