Machine learning for analyzing atomic force microscopy (AFM) images generated from polymer blends†

IF 6.2 Q1 CHEMISTRY, MULTIDISCIPLINARY
Aanish Paruchuri, Yunfei Wang, Xiaodan Gu and Arthi Jayaraman
{"title":"Machine learning for analyzing atomic force microscopy (AFM) images generated from polymer blends†","authors":"Aanish Paruchuri, Yunfei Wang, Xiaodan Gu and Arthi Jayaraman","doi":"10.1039/D4DD00215F","DOIUrl":null,"url":null,"abstract":"<p >In this paper, we present a new machine learning (ML) workflow with unsupervised learning techniques to identify domains within atomic force microscopy (AFM) images obtained from polymer films. The goal of the workflow is to (i) identify the spatial location of two types of polymer domains with little to no manual intervention (Task 1) and (ii) calculate the domain size distributions, which in turn can help qualify the phase separated state of the material as macrophase or microphase ordered/disordered domains (Task 2). We briefly review existing approaches used in other fields – computer vision and signal processing – that can be applicable to the above tasks frequently encountered in the field of polymer science and engineering. We then test these approaches from computer vision and signal processing on the AFM image dataset to identify the strengths and limitations of each of these approaches for our first task. For our first domain segmentation task, we found that the workflow using discrete Fourier transform (DFT) or discrete cosine transform (DCT) with variance statistics as the feature works the best. The popular ResNet50 deep learning approach from the computer vision field exhibited relatively poorer performance in the domain segmentation task for our AFM images as compared to the DFT and DCT based workflows. For the second task, for each of the 144 input AFM images, we then used an existing Porespy Python package to calculate the domain size distribution from the output of that image from the DFT-based workflow. The information and open-source codes we share in this paper can serve as a guide for researchers in the fields of polymers and soft materials who need ML modeling and workflows for automated analyses of AFM images from polymer samples that may have crystalline/amorphous domains, sharp/rough interfaces between domains, or micro- or macro-phase separated domains.</p>","PeriodicalId":72816,"journal":{"name":"Digital discovery","volume":" 12","pages":" 2533-2550"},"PeriodicalIF":6.2000,"publicationDate":"2024-10-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://pubs.rsc.org/en/content/articlepdf/2024/dd/d4dd00215f?page=search","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Digital discovery","FirstCategoryId":"1085","ListUrlMain":"https://pubs.rsc.org/en/content/articlelanding/2024/dd/d4dd00215f","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"CHEMISTRY, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 0

Abstract

In this paper, we present a new machine learning (ML) workflow with unsupervised learning techniques to identify domains within atomic force microscopy (AFM) images obtained from polymer films. The goal of the workflow is to (i) identify the spatial location of two types of polymer domains with little to no manual intervention (Task 1) and (ii) calculate the domain size distributions, which in turn can help qualify the phase separated state of the material as macrophase or microphase ordered/disordered domains (Task 2). We briefly review existing approaches used in other fields – computer vision and signal processing – that can be applicable to the above tasks frequently encountered in the field of polymer science and engineering. We then test these approaches from computer vision and signal processing on the AFM image dataset to identify the strengths and limitations of each of these approaches for our first task. For our first domain segmentation task, we found that the workflow using discrete Fourier transform (DFT) or discrete cosine transform (DCT) with variance statistics as the feature works the best. The popular ResNet50 deep learning approach from the computer vision field exhibited relatively poorer performance in the domain segmentation task for our AFM images as compared to the DFT and DCT based workflows. For the second task, for each of the 144 input AFM images, we then used an existing Porespy Python package to calculate the domain size distribution from the output of that image from the DFT-based workflow. The information and open-source codes we share in this paper can serve as a guide for researchers in the fields of polymers and soft materials who need ML modeling and workflows for automated analyses of AFM images from polymer samples that may have crystalline/amorphous domains, sharp/rough interfaces between domains, or micro- or macro-phase separated domains.

Abstract Image

用于分析聚合物共混物产生的原子力显微镜(AFM)图像的机器学习
在本文中,我们提出了一种新的机器学习(ML)工作流程,采用无监督学习技术来识别从聚合物薄膜中获得的原子力显微镜(AFM)图像中的域。工作流程的目标是(i)确定两种类型聚合物区域的空间位置,几乎没有人工干预(任务1)和(ii)计算区域大小分布。这反过来可以帮助确定材料的相分离状态为巨相或微相有序/无序域(任务2)。我们简要回顾了其他领域使用的现有方法-计算机视觉和信号处理-可以适用于聚合物科学和工程领域中经常遇到的上述任务。然后,我们在AFM图像数据集上从计算机视觉和信号处理中测试这些方法,以确定这些方法在我们的第一个任务中的优点和局限性。对于我们的第一个领域分割任务,我们发现使用离散傅立叶变换(DFT)或离散余弦变换(DCT)作为方差统计特征的工作流效果最好。与基于DFT和DCT的工作流程相比,计算机视觉领域流行的ResNet50深度学习方法在AFM图像的领域分割任务中表现出相对较差的性能。对于第二个任务,对于144个输入AFM图像中的每一个,我们然后使用现有的Porespy Python包从基于dft的工作流的图像输出中计算域大小分布。我们在本文中分享的信息和开源代码可以作为聚合物和软材料领域的研究人员的指南,他们需要ML建模和工作流程来自动分析来自聚合物样品的AFM图像,这些样品可能具有晶体/非晶态域,域之间的锐/粗糙界面,或微观或宏观相分离域。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
CiteScore
2.80
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信