Patch-Based Class-Conditioned Diffusion Augmentation of TEM Images: Effects of Training Patch Size on Dispersion-Relevant Morphology in Epoxy Nanocomposites

IF 4.3 Q2 ENGINEERING, ELECTRICAL & ELECTRONIC
Takahiro Umemoto, Takahiro Imai, Toshikatsu Tanaka
{"title":"Patch-Based Class-Conditioned Diffusion Augmentation of TEM Images: Effects of Training Patch Size on Dispersion-Relevant Morphology in Epoxy Nanocomposites","authors":"Takahiro Umemoto,&nbsp;Takahiro Imai,&nbsp;Toshikatsu Tanaka","doi":"10.1049/nde2.70038","DOIUrl":null,"url":null,"abstract":"<p>Transmission electron microscopy (TEM) is widely used to evaluate nanoparticle dispersion in polymer nanocomposites, which strongly influences their dielectric and insulation performance. However, the limited availability of TEM images restricts data-driven analysis. In our previous work, we established a framework to extract dispersion-related descriptors from TEM images and relate them to three-dimensional dispersion states. This study investigates the feasibility of augmenting limited TEM datasets using a patch-based, class-conditioned diffusion model and clarifies the effect of training patch size on reconstruction fidelity. Three TEM images (640 × 640 pixels) with different filler sizes and dispersion states were used. Training datasets were generated by cropping patches of various sizes (16–512 pixels), followed by rotation and flipping. A class-conditioned denoising diffusion probabilistic model with a U-Net backbone was employed to generate synthetic images. Quantitative evaluation was conducted using particle area fraction, Feret diameter distribution and Delaunay-based interparticle distance. An integrated error metric revealed a nonmonotonic dependence on patch size for all three samples, with the largest errors at the smallest patch size and an interior minimum in every case. The error varied only slowly near the minimum in each case, so that the result is better described as a range of comparable patch sizes than as a single optimum; for the samples examined here the position of this range was larger for the sample with the larger modal Feret diameter of the segmented features. These results provide an initial, empirically derived basis for selecting the patch size in diffusion-based augmentation of TEM images, subject to the limited number of source images used here.</p>","PeriodicalId":36855,"journal":{"name":"IET Nanodielectrics","volume":"9 1","pages":""},"PeriodicalIF":4.3000,"publicationDate":"2026-10-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1049/nde2.70038","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IET Nanodielectrics","FirstCategoryId":"1085","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1049/nde2.70038","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0

Abstract

Transmission electron microscopy (TEM) is widely used to evaluate nanoparticle dispersion in polymer nanocomposites, which strongly influences their dielectric and insulation performance. However, the limited availability of TEM images restricts data-driven analysis. In our previous work, we established a framework to extract dispersion-related descriptors from TEM images and relate them to three-dimensional dispersion states. This study investigates the feasibility of augmenting limited TEM datasets using a patch-based, class-conditioned diffusion model and clarifies the effect of training patch size on reconstruction fidelity. Three TEM images (640 × 640 pixels) with different filler sizes and dispersion states were used. Training datasets were generated by cropping patches of various sizes (16–512 pixels), followed by rotation and flipping. A class-conditioned denoising diffusion probabilistic model with a U-Net backbone was employed to generate synthetic images. Quantitative evaluation was conducted using particle area fraction, Feret diameter distribution and Delaunay-based interparticle distance. An integrated error metric revealed a nonmonotonic dependence on patch size for all three samples, with the largest errors at the smallest patch size and an interior minimum in every case. The error varied only slowly near the minimum in each case, so that the result is better described as a range of comparable patch sizes than as a single optimum; for the samples examined here the position of this range was larger for the sample with the larger modal Feret diameter of the segmented features. These results provide an initial, empirically derived basis for selecting the patch size in diffusion-based augmentation of TEM images, subject to the limited number of source images used here.

基于贴片的TEM图像类条件扩散增强:训练贴片尺寸对环氧纳米复合材料分散相关形貌的影响
透射电子显微镜(TEM)被广泛用于评价纳米颗粒在聚合物纳米复合材料中的分散,这对聚合物纳米复合材料的介电和绝缘性能有很大的影响。然而,TEM图像的有限可用性限制了数据驱动的分析。在我们之前的工作中,我们建立了一个框架,从TEM图像中提取色散相关描述符,并将它们与三维色散状态联系起来。本研究探讨了使用基于贴片的类别条件扩散模型增强有限TEM数据集的可行性,并阐明了训练贴片大小对重建保真度的影响。采用三张不同填充尺寸和分散状态的TEM图像(640 × 640像素)。训练数据集是通过裁剪不同大小的patch(16-512像素),然后进行旋转和翻转来生成的。采用U-Net骨干的类条件去噪扩散概率模型生成合成图像。利用颗粒面积分数、Feret直径分布和delaunay基粒子间距离进行定量评价。综合误差度量揭示了对所有三个样本的斑块大小的非单调依赖,最小斑块大小的最大误差和每种情况下的内部最小误差。在每种情况下,误差仅在最小值附近缓慢变化,因此结果可以更好地描述为可比较的补丁大小范围,而不是单个最优;对于这里检查的样本,该范围的位置对于具有较大模态Feret直径的分割特征的样本更大。这些结果为在基于扩散的TEM图像增强中选择斑块大小提供了初步的、经验推导的基础,但这里使用的源图像数量有限。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
IET Nanodielectrics
IET Nanodielectrics Materials Science-Materials Chemistry
CiteScore
5.60
自引率
3.70%
发文量
7
审稿时长
21 weeks
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书