Simulation-based approximate policy iteration for dynamic patient scheduling for radiation therapy

Gocgun Y.

Health Care Management Science, vol.21, no.3, pp.317-325, 2018 (SSCI) identifier identifier identifier

  • Publication Type: Article / Article
  • Volume: 21 Issue: 3
  • Publication Date: 2018
  • Doi Number: 10.1007/s10729-016-9388-9
  • Journal Name: Health Care Management Science
  • Journal Indexes: Social Sciences Citation Index (SSCI), Scopus
  • Page Numbers: pp.317-325
  • Keywords: Patient scheduling, Markov decision processes, Approximate dynamic programming
  • Istanbul Medipol University Affiliated: No

Abstract

We study radiation therapy scheduling problem where dynamically and stochastically arriving patients of different types are scheduled to future days. Unlike similar models in the literature, we consider cancellation of treatments. We formulate this dynamic multi-appointment patient scheduling problem as a Markov Decision Process (MDP). Since the MDP is intractable due to large state and action spaces, we employ a simulation-based approximate dynamic programming (ADP) approach to approximately solve our model. In particular, we develop Least-square based approximate policy iteration for solving our model. The performance of the ADP approach is compared with that of a myopic heuristic decision rule.