Investigating Suitable Combinations of Dynamic Models and Control Techniques for Offline Reinforcement Learning Based Navigation: Application of Universal Omni-Wheeled Robots1

Abstract

Omnidirectional locomotion provides wheeled mobile robots (WMR) with better maneuverability and flexibility, which enhances their energy efficiency and dexterity. Universal omni-wheels are one of the best categories of wheels that can be used to develop a WMR (Amarasiri et al., 2022, “Robust Dynamic Modeling and Trajectory Tracking Controller of a Universal Omni-Wheeled Mobile Robot,” ASME Letters Dyn. Sys. Control., 2(4), p. 040902. 10.1115/1.4055690). We study dynamic modeling and controllers for mobile robots to train in a reinforcement learning (RL)-based navigation algorithm. RL tasks require copious amounts of learning iteration episodes, which makes training very time consuming. The choice of dynamic model and controller has a significant impact on training time. In this paper, we compare a traditional Kane’s equations model to a non-holonomic canonical momenta model (Barhorst, 2019, “Generalized Momenta in Constrained Non-Holonomic Systems—Another Perspective on the Canonical Equations of Motion,” Int. J. Non-Linear Mech., 113, pp. 128–145.). We implemented four controllers: proportional integral derivative, linear quadratic regulator with integral action, pole placement, and a full nonlinear sliding mode controller. We summarize the pros and cons of each of the modeling techniques, and control laws implemented. The outcomes of our analysis will improve RL training time for path generation in unstructured environments.