发布求助
文献互助 智能选刊 最新文献

Proceedings of the Workshop on Deep Learning and Formal Languages: Building Bridges最新文献

筛选
英文 中文
Relating RNN Layers with the Spectral WFA Ranks in Sequence Modelling 序列建模中RNN层与谱WFA秩的关联
Proceedings of the Workshop on Deep Learning and Formal Languages: Building Bridges Pub Date : 2019-08-01 DOI: 10.18653/v1/W19-3903
F. F. Liza, M. Grzes
{"title":"Relating RNN Layers with the Spectral WFA Ranks in Sequence Modelling","authors":"F. F. Liza, M. Grzes","doi":"10.18653/v1/W19-3903","DOIUrl":"https://doi.org/10.18653/v1/W19-3903","url":null,"abstract":"We analyse Recurrent Neural Networks (RNNs) to understand the significance of multiple LSTM layers. We argue that the Weighted Finite-state Automata (WFA) trained using a spectral learning algorithm are helpful to analyse RNNs. Our results suggest that multiple LSTM layers in RNNs help learning distributed hidden states, but have a smaller impact on the ability to learn long-term dependencies. The analysis is based on the empirical results, however relevant theory (whenever possible) was discussed to justify and support our conclusions.","PeriodicalId":293591,"journal":{"name":"Proceedings of the Workshop on Deep Learning and Formal Languages: Building Bridges","volume":"21 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115773809","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 7
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整，为了账户安全，请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
请完成安全验证×
相关产品
×
本文献相关产品
联系我们：info@booksci.cn Book学术提供免费学术资源搜索服务，方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号：481959085
Book学术官方微信