Minorization-Maximization (MM) Algorithm for Semiparametric Logit Models: Bottlenecks, Extensions, and Comparisons

P. Bansal, Ricardo A. Daziano, E. Guerra
{"title":"Minorization-Maximization (MM) Algorithm for Semiparametric Logit Models: Bottlenecks, Extensions, and Comparisons","authors":"P. Bansal, Ricardo A. Daziano, E. Guerra","doi":"10.2139/ssrn.3156835","DOIUrl":null,"url":null,"abstract":"Motivated by the promising performance of alternative estimation methods for mixed logit models, in this paper we derive, implement, and test expectation-maximization (EM) and minorization-maximization (MM) algorithms to estimate the semiparametric logit mixed logit (LML) and mixture-of-normals multinomial logit (MON-MNL) models. In particular, we show that the reported computational efficiency of the MM algorithm is actually lost for large choice sets. Because the logit link that represents the parameter space in LML is intrinsically treated as a large choice set, the MM algorithm for LML actually becomes unfeasible to use in practice. We thus propose a faster MM algorithm that revisits a simple step-size correction. In a Monte Carlo study, we compare the maximum simulated likelihood estimator (MSLE) with the algorithms that we derive to estimate LML and MON-MNL models. Whereas in LML estimation alternative algorithms are computationally uncompetitive with MSLE, the faster-MM algorithm appears emulous in MON-MNL estimation. Both algorithms – faster-MM and MSLE – could recover parameters as well as standard errors at a similar precision in both models. We further show that parallel computation could reduce estimation time of faster-MM by 45% to 80%. Even though faster-MM could not surpass MSLE with analytical gradient (because MSLE also leveraged similar computational gains), parallel faster-MM is a competitive replacement to MSLE for MON-MNL that obviates computation of complex analytical gradients, which is a very attractive feature to integrate it into a flexible estimation software. We also compare different algorithms in an empirical application to estimate consumer’s willingness to adopt electric motorcycles in Solo, Indonesia. The results of the empirical application are consistent with those of the Monte Carlo study.","PeriodicalId":260073,"journal":{"name":"Mathematics eJournal","volume":"32 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2018-06-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Mathematics eJournal","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.2139/ssrn.3156835","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

Motivated by the promising performance of alternative estimation methods for mixed logit models, in this paper we derive, implement, and test expectation-maximization (EM) and minorization-maximization (MM) algorithms to estimate the semiparametric logit mixed logit (LML) and mixture-of-normals multinomial logit (MON-MNL) models. In particular, we show that the reported computational efficiency of the MM algorithm is actually lost for large choice sets. Because the logit link that represents the parameter space in LML is intrinsically treated as a large choice set, the MM algorithm for LML actually becomes unfeasible to use in practice. We thus propose a faster MM algorithm that revisits a simple step-size correction. In a Monte Carlo study, we compare the maximum simulated likelihood estimator (MSLE) with the algorithms that we derive to estimate LML and MON-MNL models. Whereas in LML estimation alternative algorithms are computationally uncompetitive with MSLE, the faster-MM algorithm appears emulous in MON-MNL estimation. Both algorithms – faster-MM and MSLE – could recover parameters as well as standard errors at a similar precision in both models. We further show that parallel computation could reduce estimation time of faster-MM by 45% to 80%. Even though faster-MM could not surpass MSLE with analytical gradient (because MSLE also leveraged similar computational gains), parallel faster-MM is a competitive replacement to MSLE for MON-MNL that obviates computation of complex analytical gradients, which is a very attractive feature to integrate it into a flexible estimation software. We also compare different algorithms in an empirical application to estimate consumer’s willingness to adopt electric motorcycles in Solo, Indonesia. The results of the empirical application are consistent with those of the Monte Carlo study.
半参数Logit模型的最小化-最大化(MM)算法:瓶颈,扩展和比较
由于混合logit模型的替代估计方法具有良好的性能,本文推导、实现并测试了期望最大化(EM)和最小化最大化(MM)算法来估计半参数logit混合logit (LML)和正态混合多项式logit (MON-MNL)模型。特别是,我们表明,报告的MM算法的计算效率对于大的选择集实际上是损失的。由于在LML中表示参数空间的logit链接本质上被视为一个大的选择集,因此LML的MM算法实际上在实践中变得不可行。因此,我们提出了一种更快的MM算法,重新访问简单的步长校正。在蒙特卡罗研究中,我们将最大模拟似然估计器(MSLE)与我们导出的用于估计LML和MON-MNL模型的算法进行比较。在LML估计中,替代算法在计算上与MSLE没有竞争,而在MON-MNL估计中,更快的mm算法显得很仿真。两种算法——faster-MM和MSLE——都可以在两种模型中以相似的精度恢复参数和标准误差。我们进一步表明,并行计算可以使快速mm的估计时间减少45%到80%。尽管faster-MM无法在分析梯度上超越MSLE(因为MSLE也利用了类似的计算增益),但并行faster-MM是MON-MNL的MSLE的竞争性替代品,它避免了复杂分析梯度的计算,这是将其集成到灵活估计软件中的一个非常有吸引力的功能。我们也比较了不同的算法在经验应用,以估计消费者的意愿采用电动摩托车在独奏,印度尼西亚。实证应用的结果与蒙特卡洛研究的结果一致。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信