几何保留图像编辑

IF 0.7 4区 工程技术 Q4 ENGINEERING, ELECTRICAL & ELECTRONIC
Taeeun Kwon, Junseok Kwon
{"title":"几何保留图像编辑","authors":"Taeeun Kwon,&nbsp;Junseok Kwon","doi":"10.1049/ell2.70011","DOIUrl":null,"url":null,"abstract":"<p>As generative models become more advanced and essential, interest in using these models for image editing is growing. Nevertheless, conventional image editing methods still have many problems and can alter the intrinsic properties (e.g. geometry) of an object during the editing process. In this article, a novel geometry-preserved image editing method is presented, where key points, keyframe, or canny edges are utilized as inputs for geometric constraints. A text prompt is fed into the inversion pipeline along with the input image and key points/keyframes/canny for editing. Then, new images are generated based on the editing pipeline of the denoising diffusion implicit model. Experiments demonstrate that the method outperforms its baselines.</p>","PeriodicalId":11556,"journal":{"name":"Electronics Letters","volume":null,"pages":null},"PeriodicalIF":0.7000,"publicationDate":"2024-09-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1049/ell2.70011","citationCount":"0","resultStr":"{\"title\":\"Geometry-preserved image editing\",\"authors\":\"Taeeun Kwon,&nbsp;Junseok Kwon\",\"doi\":\"10.1049/ell2.70011\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p>As generative models become more advanced and essential, interest in using these models for image editing is growing. Nevertheless, conventional image editing methods still have many problems and can alter the intrinsic properties (e.g. geometry) of an object during the editing process. In this article, a novel geometry-preserved image editing method is presented, where key points, keyframe, or canny edges are utilized as inputs for geometric constraints. A text prompt is fed into the inversion pipeline along with the input image and key points/keyframes/canny for editing. Then, new images are generated based on the editing pipeline of the denoising diffusion implicit model. Experiments demonstrate that the method outperforms its baselines.</p>\",\"PeriodicalId\":11556,\"journal\":{\"name\":\"Electronics Letters\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":0.7000,\"publicationDate\":\"2024-09-04\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://onlinelibrary.wiley.com/doi/epdf/10.1049/ell2.70011\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Electronics Letters\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://onlinelibrary.wiley.com/doi/10.1049/ell2.70011\",\"RegionNum\":4,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q4\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Electronics Letters","FirstCategoryId":"5","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1049/ell2.70011","RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q4","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0

摘要

随着生成模型变得越来越先进和重要,人们对使用这些模型进行图像编辑的兴趣也与日俱增。然而,传统的图像编辑方法仍然存在很多问题,在编辑过程中可能会改变对象的固有属性(如几何形状)。本文介绍了一种新颖的保留几何形状的图像编辑方法,利用关键点、关键帧或狡猾的边缘作为几何约束的输入。文本提示与输入图像、关键点/关键帧/canny 一起输入反转管道进行编辑。然后,根据去噪扩散隐含模型的编辑管道生成新图像。实验证明,该方法的性能优于基线方法。
本文章由计算机程序翻译,如有差异,请以英文原文为准。

Geometry-preserved image editing

Geometry-preserved image editing

As generative models become more advanced and essential, interest in using these models for image editing is growing. Nevertheless, conventional image editing methods still have many problems and can alter the intrinsic properties (e.g. geometry) of an object during the editing process. In this article, a novel geometry-preserved image editing method is presented, where key points, keyframe, or canny edges are utilized as inputs for geometric constraints. A text prompt is fed into the inversion pipeline along with the input image and key points/keyframes/canny for editing. Then, new images are generated based on the editing pipeline of the denoising diffusion implicit model. Experiments demonstrate that the method outperforms its baselines.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Electronics Letters
Electronics Letters 工程技术-工程:电子与电气
CiteScore
2.70
自引率
0.00%
发文量
268
审稿时长
3.6 months
期刊介绍: Electronics Letters is an internationally renowned peer-reviewed rapid-communication journal that publishes short original research papers every two weeks. Its broad and interdisciplinary scope covers the latest developments in all electronic engineering related fields including communication, biomedical, optical and device technologies. Electronics Letters also provides further insight into some of the latest developments through special features and interviews. Scope As a journal at the forefront of its field, Electronics Letters publishes papers covering all themes of electronic and electrical engineering. The major themes of the journal are listed below. Antennas and Propagation Biomedical and Bioinspired Technologies, Signal Processing and Applications Control Engineering Electromagnetism: Theory, Materials and Devices Electronic Circuits and Systems Image, Video and Vision Processing and Applications Information, Computing and Communications Instrumentation and Measurement Microwave Technology Optical Communications Photonics and Opto-Electronics Power Electronics, Energy and Sustainability Radar, Sonar and Navigation Semiconductor Technology Signal Processing MIMO
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信