{"title":"以往外推方法与算子外推方法的收敛性","authors":"V. Semenov, S. Denisov, Dmitry Siryk, O. Kharkov","doi":"10.34229/1028-0979-2021-3-5","DOIUrl":null,"url":null,"abstract":"One of the popular areas of modern applied nonlinear analysis is the study of variational inequalities. Many important problems of operations research and mathematical physics can be written in the form of variational inequalities. With the advent of generating adversarial neural networks, interest in algorithms for solving variational inequalities arose in the ML-community. This paper is devoted to the study of three new algorithms with Bregman projection for solving variational inequalities in Hilbert space. The first algorithm is the result of a modification of the two-stage Bregman method by low-cost adjusting the step size that without the prior knowledge of the Lipschitz constant of operator. The second algorithm, which we call the operator extrapolation algorithm, is obtained by replacing the Euclidean metric in the Malitsky–Tam method with the Bregman divergence. An attractive feature of the algorithm is only one computation at the iterative step of the Bregman projection onto the feasible set. The third algorithm is an adaptive version of the second, where the used rule for updating the step size does not require knowledge of Lipschitz constants and the calculation of operator values at additional points. For variational inequalities with pseudo-monotone, Lipschitz-continuous, and sequentially weakly continuous operators acting in a Hilbert space, convergence theorems are proved.","PeriodicalId":54874,"journal":{"name":"Journal of Automation and Information Sciences","volume":" ","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2021-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"CONVERGENCE OF THE EXTRAPOLATION METHOD FROM THE PAST AND THE OPERATOR EXTRAPOLATION METHOD\",\"authors\":\"V. Semenov, S. Denisov, Dmitry Siryk, O. Kharkov\",\"doi\":\"10.34229/1028-0979-2021-3-5\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"One of the popular areas of modern applied nonlinear analysis is the study of variational inequalities. Many important problems of operations research and mathematical physics can be written in the form of variational inequalities. With the advent of generating adversarial neural networks, interest in algorithms for solving variational inequalities arose in the ML-community. This paper is devoted to the study of three new algorithms with Bregman projection for solving variational inequalities in Hilbert space. The first algorithm is the result of a modification of the two-stage Bregman method by low-cost adjusting the step size that without the prior knowledge of the Lipschitz constant of operator. The second algorithm, which we call the operator extrapolation algorithm, is obtained by replacing the Euclidean metric in the Malitsky–Tam method with the Bregman divergence. An attractive feature of the algorithm is only one computation at the iterative step of the Bregman projection onto the feasible set. The third algorithm is an adaptive version of the second, where the used rule for updating the step size does not require knowledge of Lipschitz constants and the calculation of operator values at additional points. For variational inequalities with pseudo-monotone, Lipschitz-continuous, and sequentially weakly continuous operators acting in a Hilbert space, convergence theorems are proved.\",\"PeriodicalId\":54874,\"journal\":{\"name\":\"Journal of Automation and Information Sciences\",\"volume\":\" \",\"pages\":\"\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2021-05-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Automation and Information Sciences\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.34229/1028-0979-2021-3-5\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"Engineering\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Automation and Information Sciences","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.34229/1028-0979-2021-3-5","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"Engineering","Score":null,"Total":0}
CONVERGENCE OF THE EXTRAPOLATION METHOD FROM THE PAST AND THE OPERATOR EXTRAPOLATION METHOD
One of the popular areas of modern applied nonlinear analysis is the study of variational inequalities. Many important problems of operations research and mathematical physics can be written in the form of variational inequalities. With the advent of generating adversarial neural networks, interest in algorithms for solving variational inequalities arose in the ML-community. This paper is devoted to the study of three new algorithms with Bregman projection for solving variational inequalities in Hilbert space. The first algorithm is the result of a modification of the two-stage Bregman method by low-cost adjusting the step size that without the prior knowledge of the Lipschitz constant of operator. The second algorithm, which we call the operator extrapolation algorithm, is obtained by replacing the Euclidean metric in the Malitsky–Tam method with the Bregman divergence. An attractive feature of the algorithm is only one computation at the iterative step of the Bregman projection onto the feasible set. The third algorithm is an adaptive version of the second, where the used rule for updating the step size does not require knowledge of Lipschitz constants and the calculation of operator values at additional points. For variational inequalities with pseudo-monotone, Lipschitz-continuous, and sequentially weakly continuous operators acting in a Hilbert space, convergence theorems are proved.
期刊介绍:
This journal contains translations of papers from the Russian-language bimonthly "Mezhdunarodnyi nauchno-tekhnicheskiy zhurnal "Problemy upravleniya i informatiki". Subjects covered include information sciences such as pattern recognition, forecasting, identification and evaluation of complex systems, information security, fault diagnosis and reliability. In addition, the journal also deals with such automation subjects as adaptive, stochastic and optimal control, control and identification under uncertainty, robotics, and applications of user-friendly computers in management of economic, industrial, biological, and medical systems. The Journal of Automation and Information Sciences will appeal to professionals in control systems, communications, computers, engineering in biology and medicine, instrumentation and measurement, and those interested in the social implications of technology.