Stochastic Dynamic Optimization for Dynamic Scheduling

Göçgün Y.

Proceedings of the 3rd South American International IEOM Conference, Asuncion, Paraguay, 19 - 21 July 2022, pp.327-335

  • Publication Type: Conference Paper / Full Text
  • City: Asuncion
  • Country: Paraguay
  • Page Numbers: pp.327-335
  • Istanbul Medipol University Affiliated: Yes


We study two classes of dynamic scheduling problems termed as "allocation" and "advanced" scheduling. In allocation scheduling, arriving jobs either wait in queue, are rejected, or served immediately, while in advanced scheduling, they are scheduled to time slots such as days in a booking horizon. We develop approximate dynamic programming (ADP) based on direct search that approximately solves the underlying Markov decision process models. We compare the performance of the proposed technique against the myopic policy under various scenarios. Numerical results demonstrate that the direct-search based ADP yields significant improvements over the myopic policy in all of the problem sets.