{"title":"Scale-Dependent Relationships in Natural Language.","authors":"Aakash Sarkar, Marc W Howard","doi":"10.1007/s42113-020-00094-8","DOIUrl":"10.1007/s42113-020-00094-8","url":null,"abstract":"<p><p>Language, like other natural sequences, exhibits statistical dependencies at a wide range of scales (Lin & Tegmark, 2016). However, many statistical learning models applied to language impose a sampling scale while extracting statistical structure. For instance, Word2Vec creates vector embeddings by sampling context in a window around each word, the size of which defines a strong scale; relationships over much larger temporal scales would be invisible to the algorithm. This paper examines the family of Word2Vec embeddings generated while systematically manipulating the size of the context window. The primary result is that different linguistic relationships are preferentially encoded at different scales. Different scales emphasize different syntactic and semantic relations between words, as assessed both by analogical reasoning tasks in the Google Analogies test set and human similarity rating datasets WordSim-353 and SimLex-999. Moreover, the neighborhoods of a given word in the embeddings change considerably depending on the scale. These results suggest that sampling at any individual scale can only identify a subset of the meaningful relationships a word might have, and point toward the importance of developing scale-free models of semantic meaning.</p>","PeriodicalId":72660,"journal":{"name":"Computational brain & behavior","volume":"4 ","pages":"164-177"},"PeriodicalIF":0.0,"publicationDate":"2021-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1007/s42113-020-00094-8","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"39268103","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Bayes Factor Model Comparisons Across Parameter Values for Mixed Models","authors":"M. Linde, D. van Ravenzwaaij","doi":"10.1007/s42113-021-00117-y","DOIUrl":"https://doi.org/10.1007/s42113-021-00117-y","url":null,"abstract":"","PeriodicalId":72660,"journal":{"name":"Computational brain & behavior","volume":"91 1","pages":"14-27"},"PeriodicalIF":0.0,"publicationDate":"2021-05-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"83769816","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Embracing New Techniques in Deep Learning for Estimating Image Memorability","authors":"Coen D. Needell, Wilma A. Bainbridge","doi":"10.1007/s42113-022-00126-5","DOIUrl":"https://doi.org/10.1007/s42113-022-00126-5","url":null,"abstract":"","PeriodicalId":72660,"journal":{"name":"Computational brain & behavior","volume":"1 1","pages":"168 - 184"},"PeriodicalIF":0.0,"publicationDate":"2021-05-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"76353339","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Sidney T. Scott-Sharoni, Yusuke Yamani, Cara M. Kneeland, Shelby K. Long, Jing Chen, Joseph W. Houpt
{"title":"Exploring the Effects of Perceptual Separability on Human-Automation Team Efficiency","authors":"Sidney T. Scott-Sharoni, Yusuke Yamani, Cara M. Kneeland, Shelby K. Long, Jing Chen, Joseph W. Houpt","doi":"10.1007/s42113-021-00108-z","DOIUrl":"https://doi.org/10.1007/s42113-021-00108-z","url":null,"abstract":"","PeriodicalId":72660,"journal":{"name":"Computational brain & behavior","volume":"28 1","pages":"486 - 496"},"PeriodicalIF":0.0,"publicationDate":"2021-05-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"74582651","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Dynamic Perception of Well-Learned Perceptual Objects","authors":"Samuel M. Harding, D. Cousineau, R. Shiffrin","doi":"10.1007/s42113-021-00107-0","DOIUrl":"https://doi.org/10.1007/s42113-021-00107-0","url":null,"abstract":"","PeriodicalId":72660,"journal":{"name":"Computational brain & behavior","volume":"12 1","pages":"497 - 518"},"PeriodicalIF":0.0,"publicationDate":"2021-05-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1007/s42113-021-00107-0","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"72530484","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"The Discovery and Interpretation of Evidence Accumulation Stages","authors":"Leendert van Maanen, Oscar Portoles, J. Borst","doi":"10.1007/s42113-021-00105-2","DOIUrl":"https://doi.org/10.1007/s42113-021-00105-2","url":null,"abstract":"","PeriodicalId":72660,"journal":{"name":"Computational brain & behavior","volume":"78 1","pages":"395 - 415"},"PeriodicalIF":0.0,"publicationDate":"2021-04-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"75084038","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Exploring the Performance Consequences of Target Prevalence and Ecological Display Designs When Using an Automated Aid","authors":"Cara M. Kneeland, Joseph W. Houpt, K. Bennett","doi":"10.1007/s42113-021-00104-3","DOIUrl":"https://doi.org/10.1007/s42113-021-00104-3","url":null,"abstract":"","PeriodicalId":72660,"journal":{"name":"Computational brain & behavior","volume":"27 1","pages":"335 - 354"},"PeriodicalIF":0.0,"publicationDate":"2021-04-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"91291856","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Maarten van der Velde, Florian Sense, J. Borst, H. van Rijn
{"title":"Alleviating the Cold Start Problem in Adaptive Learning using Data-Driven Difficulty Estimates","authors":"Maarten van der Velde, Florian Sense, J. Borst, H. van Rijn","doi":"10.1007/s42113-021-00101-6","DOIUrl":"https://doi.org/10.1007/s42113-021-00101-6","url":null,"abstract":"","PeriodicalId":72660,"journal":{"name":"Computational brain & behavior","volume":"406 5","pages":"231 - 249"},"PeriodicalIF":0.0,"publicationDate":"2021-03-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1007/s42113-021-00101-6","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"72448313","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Jeffrey B Inglis, Vivian V Valentin, F Gregory Ashby
{"title":"Modulation of Dopamine for Adaptive Learning: A Neurocomputational Model.","authors":"Jeffrey B Inglis, Vivian V Valentin, F Gregory Ashby","doi":"10.1007/s42113-020-00083-x","DOIUrl":"https://doi.org/10.1007/s42113-020-00083-x","url":null,"abstract":"<p><p>There have been many proposals that learning rates in the brain are adaptive, in the sense that they increase or decrease depending on environmental conditions. The majority of these models are abstract and make no attempt to describe the neural circuitry that implements the proposed computations. This article describes a biologically detailed computational model that overcomes this shortcoming. Specifically, we propose a neural circuit that implements adaptive learning rates by modulating the gain on the dopamine response to reward prediction errors, and we model activity within this circuit at the level of spiking neurons. The model generates a dopamine signal that depends on the size of the tonically active dopamine neuron population and the phasic spike rate. The model was tested successfully against results from two single-neuron recording studies and a fast-scan cyclic voltammetry study. We conclude by discussing the general applicability of the model to dopamine mediated tasks that transcend the experimental phenomena it was initially designed to address.</p>","PeriodicalId":72660,"journal":{"name":"Computational brain & behavior","volume":"4 1","pages":"34-52"},"PeriodicalIF":0.0,"publicationDate":"2021-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1007/s42113-020-00083-x","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"39250531","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}