TANG Jian, HOU Huijuan, WANG Shaojing, et al. Prediction Model for Dissolved Gas in Transformer Oil Based on Policy Gradient Optimization[J]. High voltage apparatus, 2025, 61(7): 91-100.
DOI:
TANG Jian, HOU Huijuan, WANG Shaojing, et al. Prediction Model for Dissolved Gas in Transformer Oil Based on Policy Gradient Optimization[J]. High voltage apparatus, 2025, 61(7): 91-100. DOI: 10.13296/j.1001-1609.hva.2025.07.011.
Prediction Model for Dissolved Gas in Transformer Oil Based on Policy Gradient Optimization
对变压器油中溶解气体浓度进行预测分析可为其运行状态评估提供重要依据,从而有效掌握设备状态发展趋势,为预警和检修提供参考。鉴于现有算法难以实现长期精确预测,文中首次提出一种基于策略梯度(policy gradient,PG)算法优化的变压器油中溶解气体体积分数预测模型。首先以门控循环单元(gate recurrent unit,GRU)为基础,引入编码器—解码器结构搭建Sequence to Sequence(Seq2Seq)网络模型,并且结合注意力机制和Scheduled Sampling算法,提高长时间多步预测的准确性及稳定性。其次运用强化学习中策略梯度算法对网络模型进行超参数调优,并由基线函数和经验池结构改进算法减小策略网络决策方差。算例分析表明,文中方法能够深度提取特征参量时序间关系,准确预测特征气体体积分数发展趋势。相比Seq2Seq模型,平均相对误差和最大相对误差分别降低了23.91%和10.22%;相比LSTM模型,分别降低了61.54%和59.02%。
Abstract
Predictive analysis of the dissolved gas concentration in transformer oil can provide an important basis for its operating status assessment so as to effectively grasp the development trend of the equipment status and provide reference for early warning and maintenance. Given that the existing algorithms are difficult to achieve long-term accurate predictions
a kind of prediction model of dissolved gas concentration in transformer oil based on policy gradient algorithm optimization is proposed firstly in this paper. Firstly
the gate recurrent unit (GRU) is taken as the base
the encoder-decoder structure is introduced to construct the Sequence to Sequence (Seq2Seq) network model
and the Attention mechanism and the Scheduled Sampling algorithm are combined to improve both accuracy and stability of long-term multi-step predictions. Then
the Policy Gradient algorithm in reinforcement learning is used to optimize the hyper-parameters of the network model
and the baseline function and experience pool structure improvement algorithm are added to reduce the strategy network decision variance. The case analysis shows that the method in this paper can deeply extract the relationship between the characteristic parameters time sequence and accurately predict the development trend of the characteristic gas concentration. Compared with the Seq2Seq model
the average relative error and maximum relative error are reduced by 23.91% and 10.22%
respectively. Compared with the LSTM model
the error indicators are reduced by 61.54% and 59.02%