由吉洪诺夫项正则化的重球法。值和轨迹的同时收敛

IF 1.3 4区 数学 Q1 MATHEMATICS
Akram Chahid Bagy, Z. Chbani, H. Riahi
{"title":"由吉洪诺夫项正则化的重球法。值和轨迹的同时收敛","authors":"Akram Chahid Bagy, Z. Chbani, H. Riahi","doi":"10.3934/eect.2022046","DOIUrl":null,"url":null,"abstract":"<p style='text-indent:20px;'>Let <inline-formula><tex-math id=\"M1\">\\begin{document}$ f: {\\mathcal H} \\rightarrow \\mathbb{R} $\\end{document}</tex-math></inline-formula> be a convex differentiable function whose solution set <inline-formula><tex-math id=\"M2\">\\begin{document}$ {{\\rm{argmin}}}\\; f $\\end{document}</tex-math></inline-formula> is nonempty. To attain a solution of the problem <inline-formula><tex-math id=\"M3\">\\begin{document}$ \\min_{\\mathcal H}f $\\end{document}</tex-math></inline-formula>, we consider the second order dynamic system <inline-formula><tex-math id=\"M4\">\\begin{document}$ \\;\\ddot{x}(t) + \\alpha \\, \\dot{x}(t) + \\beta (t) \\nabla f(x(t)) + c x(t) = 0 $\\end{document}</tex-math></inline-formula>, where <inline-formula><tex-math id=\"M5\">\\begin{document}$ \\beta $\\end{document}</tex-math></inline-formula> is a positive function such that <inline-formula><tex-math id=\"M6\">\\begin{document}$ \\lim_{t\\rightarrow +\\infty}\\beta(t) = +\\infty $\\end{document}</tex-math></inline-formula>. By imposing adequate hypothesis on first and second order derivatives of <inline-formula><tex-math id=\"M7\">\\begin{document}$ \\beta $\\end{document}</tex-math></inline-formula>, we simultaneously prove that the value of the objective function in a generated trajectory converges in order <inline-formula><tex-math id=\"M8\">\\begin{document}$ {\\mathcal O}\\big(\\frac{1}{\\beta(t)}\\big) $\\end{document}</tex-math></inline-formula> to the global minimum of the objective function, that the trajectory strongly converges to the minimum norm element of <inline-formula><tex-math id=\"M9\">\\begin{document}$ {{\\rm{argmin}}}\\; f $\\end{document}</tex-math></inline-formula> and that <inline-formula><tex-math id=\"M10\">\\begin{document}$ \\Vert \\dot{x}(t)\\Vert $\\end{document}</tex-math></inline-formula> converges to zero in order <inline-formula><tex-math id=\"M11\">\\begin{document}$ \\mathcal{O} \\big( \\sqrt{\\frac{\\dot{\\beta}(t)}{\\beta (t)}}+ e^{-\\mu t} \\big) $\\end{document}</tex-math></inline-formula> where <inline-formula><tex-math id=\"M12\">\\begin{document}$ \\mu<\\frac{\\alpha}2 $\\end{document}</tex-math></inline-formula>. We then present two choices of <inline-formula><tex-math id=\"M13\">\\begin{document}$ \\beta $\\end{document}</tex-math></inline-formula> to illustrate these results. On the basis of the Moreau regularization technique, we extend these results to non-smooth convex functions with extended real values.</p>","PeriodicalId":48833,"journal":{"name":"Evolution Equations and Control Theory","volume":"6 1","pages":""},"PeriodicalIF":1.3000,"publicationDate":"2022-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"2","resultStr":"{\"title\":\"The Heavy ball method regularized by Tikhonov term. Simultaneous convergence of values and trajectories\",\"authors\":\"Akram Chahid Bagy, Z. Chbani, H. Riahi\",\"doi\":\"10.3934/eect.2022046\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p style='text-indent:20px;'>Let <inline-formula><tex-math id=\\\"M1\\\">\\\\begin{document}$ f: {\\\\mathcal H} \\\\rightarrow \\\\mathbb{R} $\\\\end{document}</tex-math></inline-formula> be a convex differentiable function whose solution set <inline-formula><tex-math id=\\\"M2\\\">\\\\begin{document}$ {{\\\\rm{argmin}}}\\\\; f $\\\\end{document}</tex-math></inline-formula> is nonempty. To attain a solution of the problem <inline-formula><tex-math id=\\\"M3\\\">\\\\begin{document}$ \\\\min_{\\\\mathcal H}f $\\\\end{document}</tex-math></inline-formula>, we consider the second order dynamic system <inline-formula><tex-math id=\\\"M4\\\">\\\\begin{document}$ \\\\;\\\\ddot{x}(t) + \\\\alpha \\\\, \\\\dot{x}(t) + \\\\beta (t) \\\\nabla f(x(t)) + c x(t) = 0 $\\\\end{document}</tex-math></inline-formula>, where <inline-formula><tex-math id=\\\"M5\\\">\\\\begin{document}$ \\\\beta $\\\\end{document}</tex-math></inline-formula> is a positive function such that <inline-formula><tex-math id=\\\"M6\\\">\\\\begin{document}$ \\\\lim_{t\\\\rightarrow +\\\\infty}\\\\beta(t) = +\\\\infty $\\\\end{document}</tex-math></inline-formula>. By imposing adequate hypothesis on first and second order derivatives of <inline-formula><tex-math id=\\\"M7\\\">\\\\begin{document}$ \\\\beta $\\\\end{document}</tex-math></inline-formula>, we simultaneously prove that the value of the objective function in a generated trajectory converges in order <inline-formula><tex-math id=\\\"M8\\\">\\\\begin{document}$ {\\\\mathcal O}\\\\big(\\\\frac{1}{\\\\beta(t)}\\\\big) $\\\\end{document}</tex-math></inline-formula> to the global minimum of the objective function, that the trajectory strongly converges to the minimum norm element of <inline-formula><tex-math id=\\\"M9\\\">\\\\begin{document}$ {{\\\\rm{argmin}}}\\\\; f $\\\\end{document}</tex-math></inline-formula> and that <inline-formula><tex-math id=\\\"M10\\\">\\\\begin{document}$ \\\\Vert \\\\dot{x}(t)\\\\Vert $\\\\end{document}</tex-math></inline-formula> converges to zero in order <inline-formula><tex-math id=\\\"M11\\\">\\\\begin{document}$ \\\\mathcal{O} \\\\big( \\\\sqrt{\\\\frac{\\\\dot{\\\\beta}(t)}{\\\\beta (t)}}+ e^{-\\\\mu t} \\\\big) $\\\\end{document}</tex-math></inline-formula> where <inline-formula><tex-math id=\\\"M12\\\">\\\\begin{document}$ \\\\mu<\\\\frac{\\\\alpha}2 $\\\\end{document}</tex-math></inline-formula>. We then present two choices of <inline-formula><tex-math id=\\\"M13\\\">\\\\begin{document}$ \\\\beta $\\\\end{document}</tex-math></inline-formula> to illustrate these results. On the basis of the Moreau regularization technique, we extend these results to non-smooth convex functions with extended real values.</p>\",\"PeriodicalId\":48833,\"journal\":{\"name\":\"Evolution Equations and Control Theory\",\"volume\":\"6 1\",\"pages\":\"\"},\"PeriodicalIF\":1.3000,\"publicationDate\":\"2022-01-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"2\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Evolution Equations and Control Theory\",\"FirstCategoryId\":\"100\",\"ListUrlMain\":\"https://doi.org/10.3934/eect.2022046\",\"RegionNum\":4,\"RegionCategory\":\"数学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"MATHEMATICS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Evolution Equations and Control Theory","FirstCategoryId":"100","ListUrlMain":"https://doi.org/10.3934/eect.2022046","RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"MATHEMATICS","Score":null,"Total":0}
引用次数: 2

摘要

设\begin{document}$ f: {\mathcal H} \rightarrow \mathbb{R} $\end{document}是一个凸可微函数,其解集\begin{document}$ {\rm{argmin}}}\;F $\end{document}是非空的。为了得到问题\begin{document}$ \min_{\mathcal H}f $\end{document}的解,我们考虑二阶动态系统\begin{document}$ \;\ddot{x}(t) +\ alpha \, \dot{x}(t) +\ beta(t) \nabla f(x(t)) + c x(t) = 0 $\end{document},其中\begin{document}$ \beta $\end{document}是一个正函数,使得\begin{document}$ \lim_{t\rightarrow +\infty}\beta(t) = +\infty $\end{document}。通过对\begin{document}$ \beta $\end{document}的一阶和二阶导数施加适当的假设,我们同时证明了在生成的轨迹中目标函数的值以\begin{document}$ {\mathcal O}\big(\frac{1}{\beta(t)}\big) $\end{document}的阶收敛于目标函数的全局最小值,轨迹强收敛于\begin{document}$ {\rm{argmin}}}\的最小范数元素;f $\end{document}和\begin{document}$ \Vert \dot{x}(t)\Vert $\end{document}收敛于零的顺序为\begin{document}$ \mathcal{O} \big(\sqrt{\frac{\dot{\beta}(t)}{\beta (t)} + e^{-\mu t} \big) $\end{document}其中\begin{document}$ \mu。然后,我们给出\begin{document}$ \beta $\end{document}两个选项来说明这些结果。在Moreau正则化技术的基础上,我们将这些结果推广到具有扩展实值的非光滑凸函数。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
The Heavy ball method regularized by Tikhonov term. Simultaneous convergence of values and trajectories

Let \begin{document}$ f: {\mathcal H} \rightarrow \mathbb{R} $\end{document} be a convex differentiable function whose solution set \begin{document}$ {{\rm{argmin}}}\; f $\end{document} is nonempty. To attain a solution of the problem \begin{document}$ \min_{\mathcal H}f $\end{document}, we consider the second order dynamic system \begin{document}$ \;\ddot{x}(t) + \alpha \, \dot{x}(t) + \beta (t) \nabla f(x(t)) + c x(t) = 0 $\end{document}, where \begin{document}$ \beta $\end{document} is a positive function such that \begin{document}$ \lim_{t\rightarrow +\infty}\beta(t) = +\infty $\end{document}. By imposing adequate hypothesis on first and second order derivatives of \begin{document}$ \beta $\end{document}, we simultaneously prove that the value of the objective function in a generated trajectory converges in order \begin{document}$ {\mathcal O}\big(\frac{1}{\beta(t)}\big) $\end{document} to the global minimum of the objective function, that the trajectory strongly converges to the minimum norm element of \begin{document}$ {{\rm{argmin}}}\; f $\end{document} and that \begin{document}$ \Vert \dot{x}(t)\Vert $\end{document} converges to zero in order \begin{document}$ \mathcal{O} \big( \sqrt{\frac{\dot{\beta}(t)}{\beta (t)}}+ e^{-\mu t} \big) $\end{document} where \begin{document}$ \mu<\frac{\alpha}2 $\end{document}. We then present two choices of \begin{document}$ \beta $\end{document} to illustrate these results. On the basis of the Moreau regularization technique, we extend these results to non-smooth convex functions with extended real values.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Evolution Equations and Control Theory
Evolution Equations and Control Theory MATHEMATICS, APPLIED-MATHEMATICS
CiteScore
3.10
自引率
6.70%
发文量
5
期刊介绍: EECT is primarily devoted to papers on analysis and control of infinite dimensional systems with emphasis on applications to PDE''s and FDEs. Topics include: * Modeling of physical systems as infinite-dimensional processes * Direct problems such as existence, regularity and well-posedness * Stability, long-time behavior and associated dynamical attractors * Indirect problems such as exact controllability, reachability theory and inverse problems * Optimization - including shape optimization - optimal control, game theory and calculus of variations * Well-posedness, stability and control of coupled systems with an interface. Free boundary problems and problems with moving interface(s) * Applications of the theory to physics, chemistry, engineering, economics, medicine and biology
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信