添加二进制搜索连接以提高DenseNet性能

Ravin Kumar
{"title":"添加二进制搜索连接以提高DenseNet性能","authors":"Ravin Kumar","doi":"10.2139/ssrn.3545071","DOIUrl":null,"url":null,"abstract":"Convolutional neural networks have significantly improved the field of computer vision. Most of the standard deep learning models for vision are based on convolutional neural networks. One such model is DenseNet, which is well known for providing comparable results to ResNet with fewer trainable variables. This paper proposes a mechanism to improve the performance of DenseNet architecture. We have compared our proposed approach with the original DenseNet architecture on CIFAR100 dataset. Effects of applying dropout mechanism with our proposed mechanism is also studied on DenseNet model and the obtained results showed that our approach helps DenseNet to significantly improve the performance and helping the model to learn faster. Even in situations where original DenseNet-121 would have overfit, our mechanism helped DenseNet-121 to keep improving the accuracy without overfitting on the dataset assuring better accuracy on testing data.","PeriodicalId":404477,"journal":{"name":"Mechanical Engineering eJournal","volume":"1205 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2020-02-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"8","resultStr":"{\"title\":\"Adding Binary Search Connections to Improve DenseNet Performance\",\"authors\":\"Ravin Kumar\",\"doi\":\"10.2139/ssrn.3545071\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Convolutional neural networks have significantly improved the field of computer vision. Most of the standard deep learning models for vision are based on convolutional neural networks. One such model is DenseNet, which is well known for providing comparable results to ResNet with fewer trainable variables. This paper proposes a mechanism to improve the performance of DenseNet architecture. We have compared our proposed approach with the original DenseNet architecture on CIFAR100 dataset. Effects of applying dropout mechanism with our proposed mechanism is also studied on DenseNet model and the obtained results showed that our approach helps DenseNet to significantly improve the performance and helping the model to learn faster. Even in situations where original DenseNet-121 would have overfit, our mechanism helped DenseNet-121 to keep improving the accuracy without overfitting on the dataset assuring better accuracy on testing data.\",\"PeriodicalId\":404477,\"journal\":{\"name\":\"Mechanical Engineering eJournal\",\"volume\":\"1205 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2020-02-27\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"8\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Mechanical Engineering eJournal\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.2139/ssrn.3545071\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Mechanical Engineering eJournal","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.2139/ssrn.3545071","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 8

摘要

卷积神经网络极大地改善了计算机视觉领域。大多数标准的视觉深度学习模型都是基于卷积神经网络的。DenseNet就是这样一个模型,它以使用更少的可训练变量提供与ResNet相当的结果而闻名。本文提出了一种提高DenseNet体系结构性能的机制。我们将我们提出的方法与CIFAR100数据集上的原始DenseNet架构进行了比较。研究了在DenseNet模型上应用dropout机制的效果,结果表明,我们的方法帮助DenseNet显著提高了性能,帮助模型更快地学习。即使在原始DenseNet-121会过度拟合的情况下,我们的机制帮助DenseNet-121在不过度拟合数据集的情况下不断提高准确性,确保测试数据的更好准确性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Adding Binary Search Connections to Improve DenseNet Performance
Convolutional neural networks have significantly improved the field of computer vision. Most of the standard deep learning models for vision are based on convolutional neural networks. One such model is DenseNet, which is well known for providing comparable results to ResNet with fewer trainable variables. This paper proposes a mechanism to improve the performance of DenseNet architecture. We have compared our proposed approach with the original DenseNet architecture on CIFAR100 dataset. Effects of applying dropout mechanism with our proposed mechanism is also studied on DenseNet model and the obtained results showed that our approach helps DenseNet to significantly improve the performance and helping the model to learn faster. Even in situations where original DenseNet-121 would have overfit, our mechanism helped DenseNet-121 to keep improving the accuracy without overfitting on the dataset assuring better accuracy on testing data.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信