Of Cores: A Partial-Exploration Framework for Markov Decision Processes.

Kretínský, Jan and Meggendorfer, Tobias (2019) Of Cores: A Partial-Exploration Framework for Markov Decision Processes. In: 30th International Conference on Concurrency Theory, CONCUR 2019 :. Leibniz International Proceedings in Informatics, LIPIcs . UNSPECIFIED, pp. 1-17. ISBN 9783959771214

Full text not available from this repository.

Abstract

We introduce a framework for approximate analysis of Markov decision processes (MDP) with bounded-, unbounded-, and infinite-horizon properties. The main idea is to identify a “core” of an MDP, i.e., a subsystem where we provably remain with high probability, and to avoid computation on the less relevant rest of the state space. Although we identify the core using simulations and statistical techniques, it allows for rigorous error bounds in the analysis. Consequently, we obtain efficient analysis algorithms based on partial exploration for various settings, including the challenging case of strongly connected systems.

Item Type:
Contribution in Book/Report/Proceedings
Additional Information:
DBLP License: DBLP's bibliographic metadata records provided through http://dblp.org/ are distributed under a Creative Commons CC0 1.0 Universal Public Domain Dedication. Although the bibliographic metadata records are provided consistent with CC0 1.0 Dedication, the content described by the metadata records is not. Content may be subject to copyright, rights of privacy, rights of publicity and other restrictions.
Uncontrolled Keywords:
/dk/atira/pure/subjectarea/asjc/1700/1712
Subjects:
?? approximationmarkov decision processesreachabilitysoftware ??
ID Code:
213820
Deposited By:
Deposited On:
06 Feb 2024 11:10
Refereed?:
Yes
Published?:
Published
Last Modified:
16 Jul 2024 05:25