Average-Cost Markov Decision Processes with Weakly Continuous Transition Probabilities
Анотація
This paper presents sufficient conditions for the existence of stationary optimal policies for average-cost Markov Decision Processes with Borel state and action sets and with weakly continuous transition probabilities. The one-step cost functions may be unbounded, and action sets may be noncompact. The main contributions of this paper are: (i) general sufficient conditions for the existence of stationary discount-optimal and average-cost optimal policies and descriptions of properties of value functions and sets of optimal actions, (ii) a sufficient condition for the average-cost optimality of a stationary policy in the form of optimality inequalities, and (iii) approximations of average-cost optimal actions by discount-optimal actions.
Класифікація
Ідентифікатори
Рецензії (0)
Написати рецензіюРецензій ще немає. Будьте першим!
Схожі роботи
Extended weak convergence and utility maximisation with proportional transaction costs
Схоже за: Stochastic processes and financial applications · Economic theories and models
To parametric decision problems with money income
Схоже за: Stochastic processes and financial applications · Economic theories and models
The Method of Choosing Parameters for Margin Trading Protocols in the Constant Product Model
Схоже за: Stochastic processes and financial applications · Economic theories and models
Martingales and Super-Martingales Relative to a Convex Set of Equivalent Measures
Схоже за: Stochastic processes and financial applications · Economic theories and models
Description of Incomplete Financial Markets for Time Evolution of Risk Assets
Схоже за: Stochastic processes and financial applications · Economic theories and models
Optimal liquidation with high risk aversion and small linear price impact
Схоже за: Stochastic processes and financial applications · Economic theories and models