Fast penalized generalized estimating equations for large longitudinal functional datasets.

IF 1.6 4区 数学 Q3 BIOLOGY
Biometrics Pub Date : 2026-07-01 DOI:10.1093/biomtc/ujag106
Gabriel Loewinger, Alexander W Levis, Erjia Cui, Francisco Pereira
{"title":"Fast penalized generalized estimating equations for large longitudinal functional datasets.","authors":"Gabriel Loewinger, Alexander W Levis, Erjia Cui, Francisco Pereira","doi":"10.1093/biomtc/ujag106","DOIUrl":null,"url":null,"abstract":"<p><p>Longitudinal binary or count functional data are common in neuroscience, but are often too large to analyze with existing functional regression methods. We propose one-step penalized generalized estimating equations that support generalized functional outcomes (e.g., count, binary, proportion, continuous-valued) and is fast even when datasets have a large number of clusters and large cluster sizes. The method applies to functional and scalar covariates and the one-step estimation framework enables efficient smoothing parameter selection and joint confidence interval construction. Importantly, this semi-parametric approach yields coefficient confidence intervals that are provably valid asymptotically even under working correlation misspecification. By developing a general theory for adaptive one-step M-estimation, we prove that the coefficient estimates are asymptotically normal and as efficient as the fully-iterated estimator; we verify these theoretical properties in simulations. We illustrate the benefits of our approach for analyzing large-scale neural recordings by applying it to a recent calcium imaging dataset published in Nature. We show that our method reveals important timing effects obscured in non-functional analyses. In doing so, we also demonstrate scaling to common neuroscience dataset sizes: the one-step estimator fits to a dataset with 150,000 (binary) functional outcomes, each observed at 120 functional domain points, in only $\\sim 6.5$ minutes on a laptop without parallelization. We release our methods in the $\\tt {R}$ package $\\tt {fastFGEE}$, which supports a wide range of link functions and working covariances.</p>","PeriodicalId":8930,"journal":{"name":"Biometrics","volume":"82 3","pages":""},"PeriodicalIF":1.6000,"publicationDate":"2026-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC13320155/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Biometrics","FirstCategoryId":"100","ListUrlMain":"https://doi.org/10.1093/biomtc/ujag106","RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"BIOLOGY","Score":null,"Total":0}
引用次数: 0

Abstract

Longitudinal binary or count functional data are common in neuroscience, but are often too large to analyze with existing functional regression methods. We propose one-step penalized generalized estimating equations that support generalized functional outcomes (e.g., count, binary, proportion, continuous-valued) and is fast even when datasets have a large number of clusters and large cluster sizes. The method applies to functional and scalar covariates and the one-step estimation framework enables efficient smoothing parameter selection and joint confidence interval construction. Importantly, this semi-parametric approach yields coefficient confidence intervals that are provably valid asymptotically even under working correlation misspecification. By developing a general theory for adaptive one-step M-estimation, we prove that the coefficient estimates are asymptotically normal and as efficient as the fully-iterated estimator; we verify these theoretical properties in simulations. We illustrate the benefits of our approach for analyzing large-scale neural recordings by applying it to a recent calcium imaging dataset published in Nature. We show that our method reveals important timing effects obscured in non-functional analyses. In doing so, we also demonstrate scaling to common neuroscience dataset sizes: the one-step estimator fits to a dataset with 150,000 (binary) functional outcomes, each observed at 120 functional domain points, in only $\sim 6.5$ minutes on a laptop without parallelization. We release our methods in the $\tt {R}$ package $\tt {fastFGEE}$, which supports a wide range of link functions and working covariances.

大型纵向函数数据集的快速惩罚广义估计方程。
纵向二元或计数功能数据在神经科学中很常见,但通常太大而无法用现有的功能回归方法进行分析。我们提出了一步惩罚广义估计方程,支持广义函数结果(例如,计数,二进制,比例,连续值),并且即使数据集具有大量聚类和大聚类大小也快速。该方法适用于函数协变量和标量协变量,一步估计框架实现了高效的平滑参数选择和联合置信区间构建。重要的是,这种半参数方法产生的系数置信区间即使在工作相关错配的情况下也是渐近有效的。通过发展自适应一步m估计的一般理论,我们证明了系数估计是渐近正态的,并且与全迭代估计一样有效;我们在模拟中验证了这些理论性质。我们通过将其应用于最近发表在《自然》杂志上的钙成像数据集,说明了我们分析大规模神经记录的方法的好处。我们表明,我们的方法揭示了在非功能分析中被掩盖的重要时序效应。在此过程中,我们还演示了扩展到常见的神经科学数据集大小:一步估计器适合具有150,000(二进制)功能结果的数据集,每个结果在120个功能域点上观察,在笔记本电脑上仅花费6.5美元,没有并行化。我们在$\tt {R}$包$\tt {fastFGEE}$中发布我们的方法,该包$\tt {fastFGEE}$支持广泛的链接函数和工作协方差。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Biometrics
Biometrics 生物-生物学
CiteScore
2.70
自引率
5.30%
发文量
178
审稿时长
4-8 weeks
期刊介绍: The International Biometric Society is an international society promoting the development and application of statistical and mathematical theory and methods in the biosciences, including agriculture, biomedical science and public health, ecology, environmental sciences, forestry, and allied disciplines. The Society welcomes as members statisticians, mathematicians, biological scientists, and others devoted to interdisciplinary efforts in advancing the collection and interpretation of information in the biosciences. The Society sponsors the biennial International Biometric Conference, held in sites throughout the world; through its National Groups and Regions, it also Society sponsors regional and local meetings.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书