arXiv ScienceSearch

arXiv subjects

Congcong Sun

Publications and source records attributed to Congcong Sun.

9 recordsLinked to original sources

Modeling and Optimal Control of Thermal Environment in Pig Houses

The management of thermal environments in pig farming is crucial for optimizing animal health, productivity, and operational energy efficiency. This study introduces a novel thermal ventilation model (TVM) based on enthalpy balance, which integrates both temperature and humidity control to address the specific thermal regulation requirements of pig housing in regions characterized by high temperatures and humidity, such as Guangdong, China. These challenging environmental conditions can lead to heat stress in pigs, adversely affecting their health and productivity. The TVM provides a precise representation of thermal comfort by accounting for the combined effects of temperature and humidity. Building on the TVM, we formulate an optimization problem using Model Predictive Control (MPC), which dynamically adjusts ventilation rates in real-time by modifying weight factors to minimize energy consumption while keeping the temperature and humidity within the comfort zone of the pigs. The accuracy of the TVM is validated against real-world environmental data from pig housing facilities in Guangdong. The root mean square error of temperature in winter, spring and summer were 1.23, 0.81, and 0.60, demonstrating its reliability and robustness across diverse climatic conditions. Furthermore, simulation results show that the proposed MPC strategy significantly improves energy efficiency and environmental comfort, achieving a 100% comfort temperature zone in spring and 83% in summer, compared to 91% and 43% with traditional rule-based control, respectively. However, the model's energy consumption in summer (91.2 kWh) was higher than that of rule-based control (80.8 kWh), reflecting the trade-off between maintaining optimal comfort and energy efficiency under extreme conditions.

math.OC

Grower-in-the-Loop Interactive Reinforcement Learning for Greenhouse Climate Control

Climate control is crucial for greenhouse production as it directly affects crop growth and resource use. Reinforcement learning (RL) has received increasing attention in this field, but still faces challenges, including limited training efficiency and high reliance on initial learning conditions. Interactive RL, which combines human (grower) input with the RL agent's learning, offers a potential solution to overcome these challenges. However, interactive RL has not yet been applied to greenhouse climate control and may face challenges related to imperfect inputs. Therefore, this paper aims to explore the possibility and performance of applying interactive RL with imperfect inputs into greenhouse climate control, by: (1) developing three representative interactive RL algorithms tailored for greenhouse climate control (reward shaping, policy shaping and control sharing); (2) analyzing how input characteristics are often contradicting, and how the trade-offs between them make grower's inputs difficult to perfect; (3) proposing a neural network-based approach to enhance the robustness of interactive RL agents under limited input availability; (4) conducting a comprehensive evaluation of the three interactive RL algorithms with imperfect inputs in a simulated greenhouse environment. The demonstration shows that interactive RL incorporating imperfect grower inputs has the potential to improve the performance of the RL agent. RL algorithms that influence action selection, such as policy shaping and control sharing, perform better when dealing with imperfect inputs, achieving 8.4% and 6.8% improvement in profit, respectively. In contrast, reward shaping, an algorithm that manipulates the reward function, is sensitive to imperfect inputs and leads to a 9.4% decrease in profit. This highlights the importance of selecting an appropriate mechanism when incorporating imperfect inputs.

cs.LG

A Teacher-Student MPC-PPO Coupled Reinforcement Learning Framework for Winter Temperature Control of Solar Greenhouses in Northern China

Solar greenhouses are crucial infrastructure of modern agricultural production in northern China. However, highly fluctuating temperature in winter season results in poor greenhouse temperature control, which affects crop growth and increases energy consumption. To tackle these challenges, an advanced control system that can efficiently optimize multiple objectives under dramatic climate conditions is essential. Therefore, this study propose a model predictive control-coupled proximal policy optimization (MPC-PPO) control framework. A teacher-student control framework is constructed in which the MPC generating high-quality control experiences to guide the PPO agent's learning process. An adaptive dynamic weighting mechanism is employed to balance the influence of MPC experiences during PPO training. Evaluation conducted in solar greenhouses across three provinces in northern China (Beijing, Hebei, and Shandong) demonstrates that: (1) the MPC-PPO method achieved the highest temperature control performance (96.31 on a 100-point scale), with a 5.46-point improvement compared to the non-experience integration baseline, when reduced standard deviation by nearly half and enhanced exploration efficiency; (2) the MPC-PPO method achieved a ventilation control reward of 99.19, optimizing ventilation window operations with intelligent time-differentiated strategies that reduced energy loss during non-optimal hours; (3) feature analysis reveals that historical window opening, air temperature, and historical temperature are the most influential features for effective control, i.e., SHAP values of 7.449, 4.905, and 4.747 respectively; and (4) cross-regional tests indicated that MPC-PPO performs best in all test regions, confirming generalization of the method.

math.OC

ADLM -- stega: A Universal Adaptive Token Selection Algorithm for Improving Steganographic Text Quality via Information Entropy

In the context of widespread global information sharing, information security and privacy protection have become focal points. Steganographic systems enhance information security by embedding confidential information into public carriers; however, existing generative text steganography methods face challenges in handling the long-tail distribution of candidate word pools, which impacts the imperceptibility of steganographic information. This paper proposes a quality control theory for steganographic text generation based on information entropy constraints, exploring the relationship between the imperceptibility of steganographic texts and information entropy. By controlling the information entropy of the candidate word pool within a specific range, we optimize the imperceptibility of the steganographic text. We establish upper and lower bounds for information entropy and introduce an adaptive truncation method to balance semantic coherence and lexical diversity. Experimental results demonstrate that reasonably controlling the candidate pool size and information entropy thresholds significantly enhances the quality and detection resistance of steganographic texts, showcasing broad application potential in the field of natural language processing.

cs.CR

Safe Stabilization using Nonsmooth Control Lyapunov Barrier Function

This paper addresses the challenge of safe stabilization, ensuring the system state reach the origin while avoiding unsafe regions. Existing approaches relying on smooth Lyapunov barrier functions often fail to guarantee a feasible controller. To overcome this limitation, we introduce the nonsmooth Control Lyapunov Barrier Function (NCLBF), which ensures the existence of a safe and stabilizing controller. We provide a systematic framework for designing NCLBF and feedback control strategies to achieve safe stabilization in the presence of multiple bounded unsafe regions. Theoretical analysis and simulations of both linear and nonlinear systems demonstrate the effectiveness and superiority of our approach compared to the existing smooth functions method.

eess.SY

Reinforcement Learning-based Model Predictive Control for Greenhouse Climate Control

Greenhouse climate control is concerned with maximizing performance in terms of crop yield and resource efficiency. One promising approach is model predictive control (MPC), which leverages a model of the system to optimize the control inputs, while enforcing physical constraints. However, prediction models for greenhouse systems are inherently inaccurate due to the complexity of the real system and the uncertainty in predicted weather profiles. For model-based control approaches such as MPC, this can degrade performance and lead to constraint violations. Existing approaches address uncertainty in the prediction model with robust or stochastic MPC methodology; however, these necessarily reduce crop yield due to conservatism and often bear higher computational loads. In contrast, learning-based control approaches, such as reinforcement learning (RL), can handle uncertainty naturally by leveraging data to improve performance. This work proposes an MPC-based RL control framework to optimize the climate control performance in the presence of prediction uncertainty. The approach employs a parametrized MPC scheme that learns directly from data, in an online fashion, the parametrization of the constraints, prediction model, and optimization cost that minimizes constraint violations and maximizes climate control performance. Simulations show that the approach can learn an MPC controller that significantly outperforms the current state-of-the-art in terms of constraint violations and efficient crop growth.

eess.SY

Data-driven sliding mode control for partially unknown nonlinear systems

This paper presents a new data-driven control for multi-input, multi-output nonlinear systems with partially unknown dynamics and bounded disturbances. Since exact nonlinearity cancellation is not feasible with unknown disturbances, we adapt sliding mode control (SMC) for system stability and robustness. The SMC features a data-driven robust controller to reach the sliding surface and a data-driven nominal controller from a semidefinite program (SDP) to ensure stability. Simulations show the proposed method outperforms existing data-driven approaches with approximate nonlinearity cancellation.

eess.SY

Reinforcement Learning Versus Model Predictive Control on Greenhouse Climate Control

Greenhouse is an important protected horticulture system for feeding the world with enough fresh food. However, to maintain an ideal growing climate in a greenhouse requires resources and operational costs. In order to achieve economical and sustainable crop growth, efficient climate control of greenhouse production becomes essential. Model Predictive Control (MPC) is the most commonly used approach in the scientific literature for greenhouse climate control. However, with the developments of sensing and computing techniques, reinforcement learning (RL) is getting increasing attention recently. With each control method having its own way to state the control problem, define control goals, and seek for optimal control actions, MPC and RL are representatives of model-based and learning-based control approaches, respectively. Although researchers have applied certain forms of MPC and RL to control the greenhouse climate, very few effort has been allocated to analyze connections, differences, pros and cons between MPC and RL either from a mathematical or performance perspective. Therefore, this paper will 1) propose MPC and RL approaches for greenhouse climate control in an unified framework; 2) analyze connections and differences between MPC and RL from a mathematical perspective; 3) compare performance of MPC and RL in a simulation study and afterwards present and interpret comparative results into insights for the application of the different control approaches in different scenarios.

math.OC

Chance-constrained Stochastic MPC of Astlingen Urban Drainage Benchmark Network

In urban drainage systems (UDS), a proven method for reducing the combined sewer overflow (CSO) pollution is real-time control (RTC) based on model predictive control (MPC). MPC methodologies for RTC of UDSs in the literature rely on the computation of the optimal control strategies based on deterministic rain forecast. However, in reality, uncertainties exist in rainfall forecasts which affect severely accuracy of computing the optimal control strategies. Under this context, this work aims to focus on the uncertainty associated with the rainfall forecasting and its effects. One option is to use stochastic information about the rain events in the controller; in the case of using MPC methods, the class called stochastic MPC is available, including several approaches such as the chance-constrained MPC method. In this study, we apply stochastic MPC to the UDS using the chance-constrained method. Moreover, we also compare the operational behavior of both the classical MPC with perfect forecast and the chance-constrained MPC based on different stochastic scenarios of the rain forecast. The application and comparison have been based on simulations using a SWMM model of the Astlingen urban drainage benchmark network.

eess.SY