Lagrange Neural Network for Nonsmooth Nonconvex Optimization Problems with Equality and Inequality Constrains
-
摘要: 非凸非光滑优化问题涉及科学与工程应用的诸多领域，是目前国际上的研究热点。该文针对已有基于早期罚函数神经网络解决非光滑优化问题的不足，借鉴Lagrange乘子罚函数的思想提出一种有效解决带等式和不等式约束的非凸非光滑优化问题的递归神经网络模型。由于该网络模型的罚因子是变量，无需计算罚因子的初始值仍能保证神经网络收敛到优化问题的最优解，因此更加便于网络计算。此外，与传统Lagrange方法不同，该网络模型增加了一个等式约束惩罚项，可以提高网络的收敛能力。通过详细的分析证明了该网络模型的轨迹在有限时间内必进入可行域，且最终收敛于关键点集。最后通过数值实验验证了所提出理论的有效性。Abstract: Nonconvex nonsmooth optimization problems are related to many fields of science and engineering applications, which are research hotspots. For the lack of neural network based on early penalty function for nonsmooth optimization problems, a recurrent neural network model is proposed using Lagrange multiplier penalty function to solve the nonconvex nonsmooth optimization problems with equality and inequality constrains. Since the penalty factor in this network model is variable, without calculating initial penalty factor value, the network can still guarantee convergence to the optimal solution, which is more convenient for network computing. Compared with the traditional Lagrange method, the network model adds an equality constraint penalty term, which can improve the convergence ability of the network. Through the detailed analysis, it is proved that the trajectory of the network model can reach the feasible region in finite time and finally converge to the critical point set. In the end, numerical experiments are given to verify the effectiveness of the theoretic results.
-
Key words:
- Lagrange neural network /
- Convergence /
- Nonsmooth nonconvex optimization
-
MIAO Peng, SHEN Yanjun, LI Yujiao, et al. Finite-time recurrent neural networks for solving nonlinear optimization problems and their application[J]. Neurocomputing, 2016, 177(7): 120-129. doi: 10.1016/j.neucom.2015.11.014. MESTARI M, BENZIRAR M, SABER N, et al. Solving nonlinear equality constrained multiobjective optimization problems using neural networks[J]. IEEE Transactions on Neural Networks and Learning Systems, 2015, 26(10): 19-35. doi: 10.1109/TNNLS.2015.2388511. HOSSEINI A. A non-penalty recurrent neural network for solving a class of constrained optimization problems[J]. Neural Networks, 2016, 73(1): 10-25. doi: 10.1016/j.neunet. 2015.09.013. FORTI M, NISTRI P, and QUINCAMPOIX M. Generalized neural network for nonsmooth nonlinear programming problems[J]. IEEE Transactions on Circuits and Systems I Regular Papers, 2004, 51(9): 1741-1754. doi: 10.1109/TCSI. 2004.834493. XUE Xiaoping and BIAN Wei. Subgradient-based neural networks for nonsmooth convex optimization problems[J]. IEEE Transactions on Circuits and Systems I Regular Papers, 2008, 55(8): 2378-2391. doi: 10.1109/TCSI.2008.920131. BIAN Wei and XUE Xiaoping. Subgradient-based neural networks for nonsmooth nonconvex optimization problems[J]. IEEE Transactions on Neural Networks, 2009, 20(6): 1024-1038. doi: 10.1109/TNN.2009.2016340. LIU Qingshan and WANG Jun. A one-layer projection neural network for nonsmooth optimization subject to linear equalities and bound constraints[J]. IEEE Transactions on Neural Networks and Learning Systems, 2013, 24(5): 812-824. doi: 10.1109/TNNLS.2013.2244908. BIAN Wei and CHEN Xiaojun. Smoothing neural network for constrained non-Lipschitz optimization with applications [J]. IEEE Transactions on Neural Networks and Learning Systems, 2012, 23(3): 399-411. doi: 10.1109/TNNLS.2011. 2181867. QIN Sitian, BIAN Wei, and XUE Xiaoping. A new one-layer recurrent neural network for nonsmooth pseudoconvex optimization[J]. Neurocomputing, 2013, 120(22): 655-662. doi: 10.1016/j.neucom.2013.01.025. -
计量
- 文章访问数: 2238
- HTML全文浏览量: 247
- PDF下载量: 342
- 被引次数: 0
下载:
