Learning to schedule job-shop problems: representation and policy learning using graph neural network and reinforcement learning

By Junyoung Park, J. Chun, Sangho Kim, Youngkook Kim, Jinkyoo Park. International Journal of Production Research, 2021

301 citations recorded by the source corpus.

We propose a framework to learn to schedule a job-shop problem (JSSP) using a graph neural network (GNN) and reinforcement learning (RL). We formulate the scheduling process of JSSP as a sequential decision-making problem with graph representation of the state to consider the structure of JSSP. In solving the formulated problem, the proposed framework employs a GNN to learn that node features that embed the spatial structure of the JSSP represented as a graph (representation learning) and derive the optimum scheduling policy that maps the embedded node features to the best scheduling action (policy learning). We employ Proximal Policy Optimization (PPO) based RL strategy to train these two modules in an end-to-end fashion. We empirically demonstrate that the GNN scheduler, due to its superb generalization capability, outperforms practically favoured dispatching rules and RL-based schedulers on various benchmark JSSP. We also confirmed that the proposed framework learns a transferable scheduling policy that can be employed to schedule a completely new JSSP (in terms of size and parameters) without further training.

Subfields: Computer Networks and Communications, Control and Systems Engineering, Industrial and Manufacturing Engineering

View Paper: https://www.semanticscholar.org/paper/3eedfc92689a99f468c562e41e8b7ee6e19e673d

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Industrial and Manufacturing Engineering

  1. Wen Song
  2. Qiqiang Li
  3. Zhiguang Cao

Citations in the corpus