Mathematics of Operations Research, Vol. 42, No. 4 (November 2017), pp. 945-978 (34 pages) Calculating optimal policies is known to be computationally difficult for Markov decision processes (MDPs) ...
In this paper we consider infinite horizon discrete-time optimal control of Markov decision processes (MDPs) with finite state spaces and compact action sets. We restrict attention to unicost MDPs, ...
Finite State Machines (FSMs) have long been a cornerstone of digital system design, and continuing advancements in logic synthesis have enabled increasingly optimised implementations. At its core, FSM ...