Reinforcement Learning for PID Fine-Tuning in Nonlinear Temperature Control Systems

Abstract

This paper compares the traditional tuning techniques, i.e., Ziegler-Nichols and Cohen-Coon, with artificial intelligence-based techniques, i.e., Reinforcement Learning (RL) and Genetic Algorithms (GA), for tuning Proportional-Integral-Derivative (PID) controllers in nonlinear temperature control systems, which are modeled by an augmented Newton's Law of Cooling with a heat dissipation coefficient that varies with temperature. The analysis is done in a simulated setting that includes sensor noise, control delays, and different levels of nonlinearity. System performance is evaluated based on stability, response time, energy efficiency, and disturbance robustness. Results from the simulations demonstrate that the GA-based approach consistently achieves the highest accuracy and stability across all tested conditions, outperforming both classical methods and RL-based strategies, which show limitations in handling complex dynamics and noise. These findings offer practical insights for selecting effective PID tuning methods for nonlinear thermal systems.

More by Shirali Kadyrov

• Bounded continued fractions and quadratic orders in $\Q(\sqrt{127})$arXiv · 2026
• Code and data for "Reinforcement learning-based PID for nonlinear temperature control with delayed feedback and measurement noise"Zenodo · 2026
• Life expectancy in Kazakhstan: an integrated analysis and forecastZenodo · 2026
• Data-driven homotopic reinforcement learning for adaptive tracking control of completely unknown Takagi–Sugeno fuzzy Markovian jump systemsCommunications in Nonlinear Science and Numerical Simulation · 2026