Hybrid group formation simulation based on deep reinforcement learning

Abstract

A group formation problem is defined as the simulation of groups of agents, moving without collision while forming a specific shape. The development of this type of problem is usually done using velocity-based or deep-reinforcement learning methods. In velocity-based methods, it is possible to create complex environments with more realistic behaviours of the agents in the environment. However, the computational complexity and inflexibility in changing the formation are among the leading challenges. Using velocity-based and deep reinforcement learning techniques, agents learn to have a collision-free motion in the desired formations. The proposed algorithm, we called ‘DGB DRL’, takes advantage of a hybrid method by combining the two approaches as a formation control algorithm. The evaluation results of the proposed method show an improvement in reducing computational complexity and increasing flexibility in complex environments. Copyright © 2024 Inderscience Enterprises Ltd.