A knowledge-driven cooperative scatter search algorithm with reinforcement learning for the distributed blocking flow shop scheduling problem

Abstract

The distributed flow shop scheduling problem has become one of the key problems related to the high efficiency impacted factor in the manufacturing industry due to its typical scenarios in real-world industrial applications. In this paper, a knowledge-driven cooperative scatter search (KCSS) is proposed to address the distributed blocking flow shop scheduling problem (DBFSP) to minimize the makespan. The scatter search (SS) is adopted as the basic optimization framework in KCSS. The neighborhood perturbation operator and the Q-learning algorithm are combined to select the appropriate perturbation operator in the search process. Firstly, considering the complexity of distributed scenarios, five search operators are used to construct a disturbance strategy pool. Secondly, the Q-learning algorithm dynamically chooses disturbance strategies to enhance exploration ability and search efficiency. Afterward, a local search method based on neighborhood reconstruction is proposed to perturb the currently found optimal solution to strengthen the ability of KCSS to develop in local areas. In addition, the path relinking mechanism is introduced into the subset combination method to guarantee the diversity of solutions in the optimization process. Finally, the performance of the KCSS algorithm is verified on the benchmark set, and the experimental results demonstrate the robustness and effectiveness of the KCSS algorithm. In addition, 518 of the best-known solutions out of 720 benchmark instances are updated.