{"title":"Neither rhyme nor reason? Understanding science evaluation today","authors":"P. Wagner","doi":"10.1177/05390184211025205","DOIUrl":"https://doi.org/10.1177/05390184211025205","url":null,"abstract":"After illustrating by comparison why large segments of the current practices of science evaluation should be seen as absurd in procedure or outcome and often in both, this contribution asks why these practices have emerged in the first place and why they persist despite widespread criticism.","PeriodicalId":47697,"journal":{"name":"Social Science Information Sur Les Sciences Sociales","volume":"60 1","pages":"378 - 383"},"PeriodicalIF":1.1,"publicationDate":"2021-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1177/05390184211025205","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43825215","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"When two science disciplines meet: Evaluating dynamics of conjunction. The encounter between astrophysics and artificial intelligence","authors":"A. Marcovich, T. Shinn","doi":"10.1177/05390184211025848","DOIUrl":"https://doi.org/10.1177/05390184211025848","url":null,"abstract":"This article points out some issues raised by the encounter between astrophysics (AP) and a newly emergent mathematical tool/discipline, namely artificial intelligence (AI). We suggest that this encounter has interesting consequences in terms of science evaluation. Our discussion favors an intra science perspective, both on the institutional and cognitive side. This encounter between machine learning (ML) and astrophysics points to three different consequences. (1) As a transverse tool, a same ML algorithm can be used for a diversity of very different disciplines and questions. This ambition and analytic intellectual architecture frequently identify similarities among apparently differentiated fields. (2) The perimeter of the disciplines involved in a research can lead to many and novel ways of collaboration between scientists and to new ways of evaluation of their work. And (3), the impossibility for the human mind to understand the processes involved in ML work raises the question of the reliability of results.","PeriodicalId":47697,"journal":{"name":"Social Science Information Sur Les Sciences Sociales","volume":"60 1","pages":"372 - 377"},"PeriodicalIF":1.1,"publicationDate":"2021-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1177/05390184211025848","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"42597251","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"‘Science’ has always been evaluated. . . and will always be","authors":"Y. Gingras","doi":"10.1177/05390184211025204","DOIUrl":"https://doi.org/10.1177/05390184211025204","url":null,"abstract":"Science has always been evaluated and will always be. The reasons justifying evaluations and the methods used to carry them have varied over time in relation to the many transformations of the sciences over the last fifty years. The uses of bibliometric methods are not limited to ‘evaluations’ of scientists and their institutions as they also provide a unique way to map global trends. One cannot stop evaluating science, but one can use the right tools at the right scale (individuals, institutions, countries) to better understand the dynamic of scientific change.","PeriodicalId":47697,"journal":{"name":"Social Science Information Sur Les Sciences Sociales","volume":"60 1","pages":"303 - 307"},"PeriodicalIF":1.1,"publicationDate":"2021-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1177/05390184211025204","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43415158","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Missed marks: This is no longer the 20th century","authors":"Alexandre Hannud Abdo","doi":"10.1177/05390184211018536","DOIUrl":"https://doi.org/10.1177/05390184211018536","url":null,"abstract":"Following an invitation by the editors of Social Science Information to react to an article by Olof Hallonsten, this article joins a debate about ways of evaluating science in our current context. This article presents an argument in support of the following four assertions and their importance to properly approach today the transformations of science evaluation and governance in the last decades: (a) scientific communities have failed to update their self-governance as societies transitioned from ‘rural-labor societies’ to ‘urban-knowledge societies’; (b) the ensuing discrepancy from expectations contributed to the economization of science; (c) we must consider two distinct processes of democratization; and (d) geopolitics plays an important role in the establishment of commodification in wealthy nations.","PeriodicalId":47697,"journal":{"name":"Social Science Information Sur Les Sciences Sociales","volume":"60 1","pages":"318 - 323"},"PeriodicalIF":1.1,"publicationDate":"2021-07-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1177/05390184211018536","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43934950","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"If you do not deign to quantify, someone else will do it for you: In support of a balanced approach to the evaluation of science","authors":"Mathieu Lizotte","doi":"10.1177/05390184211021364","DOIUrl":"https://doi.org/10.1177/05390184211021364","url":null,"abstract":"This is a commentary in support of Olof Hallonsten’s historical-sociological argument for countering the growing distrust and governance of science. From this starting point, the problem of quantification in the evaluation of science is addressed and several examples of the unintended consequences of the currently available metrics are discussed. In particular, the issue of quantification is discussed in regard to the modality of scientific research, power and research and the peer relationship. Although in approval with Hallonsten’s argument for reversing the burden of proof, reasonable skepticism is expressed regarding the persuasiveness that this counter-rhetoric will have on members of parliament, public servants and university administrators. If this long-term goal is to be accomplished, it is argued that concrete actions must be pursued in the short and medium term. In this spirit, several suggestions are formulated to further this agenda, most notably greater support for intellectual diversity, greater participation and readership in science studies by science practitioners and the promotion of the comparative approach for understanding the different ways that metrics are actually used in practice. Finally, I argue that the refusal of participating in the quantification of science is bound to hinder applied critical thinking and will most likely and regrettably exacerbate its current perverse effects.","PeriodicalId":47697,"journal":{"name":"Social Science Information Sur Les Sciences Sociales","volume":"60 1","pages":"363 - 371"},"PeriodicalIF":1.1,"publicationDate":"2021-06-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1177/05390184211021364","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47686863","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Why are conspiracy theories more successful in some countries than in others? An exploratory study on Internet users from 22 Western and non-Western countries","authors":"Laurent Cordonier, F. Cafiero, G. Bronner","doi":"10.1177/05390184211018961","DOIUrl":"https://doi.org/10.1177/05390184211018961","url":null,"abstract":"This exploratory study aims at identifying macro-social factors associated with the international variance of belief in conspiracy theories. We computed a Conspiracy Index for 22 Western and non-Western countries based on the results of an online survey on conspiratorial beliefs. Stepwise regression analyses show that more than 70% of the international variance of this Conspiracy Index is explained by the following three national variables: the level of democracy, the unemployment rate, and the perceived level of public sector corruption. Conspiracy theories thus appear to be more commonly endorsed in countries where people cannot take an active part in the political life of their country (low level of democracy), where they may feel socially threatened (high unemployment rate), and where institutions and authorities are perceived as untrustworthy (high perception of public sector corruption).","PeriodicalId":47697,"journal":{"name":"Social Science Information Sur Les Sciences Sociales","volume":"60 1","pages":"436 - 456"},"PeriodicalIF":1.1,"publicationDate":"2021-06-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1177/05390184211018961","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"42469768","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Science evaluation and social transformations","authors":"P. Wagner","doi":"10.1177/05390184211019831","DOIUrl":"https://doi.org/10.1177/05390184211019831","url":null,"abstract":"This editorial and introductory article outlines some of the aspects that are being addressed and questions that are being raised in the subsequent special section on science evaluation. It sets the emergence of new evaluation practices in the context of changing state forms; it reflects on the distinction between internal and external evaluation procedures as an expression of boundaries between fields of social practice or between orders of justification; it suggests the need for distinguishing between foci of evaluation: on research results, on researchers, or on research proposals; and it asks the question if and how different modes of critique lead to different conclusions for remedy.","PeriodicalId":47697,"journal":{"name":"Social Science Information Sur Les Sciences Sociales","volume":"60 1","pages":"299 - 302"},"PeriodicalIF":1.1,"publicationDate":"2021-06-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1177/05390184211019831","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"46111236","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Evaluation and innovation: An antagonistic pair?","authors":"F. D’Agostino, J. Malpas","doi":"10.1177/05390184211018670","DOIUrl":"https://doi.org/10.1177/05390184211018670","url":null,"abstract":"Picking up on Olof Hallonsten’s contention that contemporary science evaluation is ‘mostly counterproductive’, we argue that the contemporary focus on evaluation is antagonistic to innovation or novelty in science, even though innovation is one of the values that evaluation is often supposed to support. In arguing for the antagonistic relation between evaluation and innovation, we consider arguments from the nature of audit and the situational logic of scientific practice.","PeriodicalId":47697,"journal":{"name":"Social Science Information Sur Les Sciences Sociales","volume":"60 1","pages":"345 - 349"},"PeriodicalIF":1.1,"publicationDate":"2021-06-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1177/05390184211018670","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47597342","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Keep discussing evaluation – A personal and appreciative reflection","authors":"Olof Hallonsten","doi":"10.1177/05390184211020154","DOIUrl":"https://doi.org/10.1177/05390184211020154","url":null,"abstract":"In an attempt to summarize and draw preliminary conclusions from the many fine responses to my article ‘Stop evaluating science’, this short piece brings some additional reflections on the topic with the primary intent not to close the debate but to keep it open. Discussing, in turn, three main topics of the responses and an additional topic that arguably is of particular interest, the article’s intent is to celebrate the great insights and contributions that surfaced in the debate so far by adding some notes on how to take the issue further in future scholarly inquiry and discussion.","PeriodicalId":47697,"journal":{"name":"Social Science Information Sur Les Sciences Sociales","volume":"60 1","pages":"384 - 394"},"PeriodicalIF":1.1,"publicationDate":"2021-06-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1177/05390184211020154","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"49347483","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Arguments against efficiency in science","authors":"David Peterson, Aaron Panofsky","doi":"10.1177/05390184211021383","DOIUrl":"https://doi.org/10.1177/05390184211021383","url":null,"abstract":"A recent commentary critiqued the embrace of performance metrics at research universities. Drawing on our research studying the metascience movement, we suggest that the drive to maximize efficiency in science is increasingly extending beyond performance metrics, into labs themselves. Because institutional and public audiences are predisposed to viewing science in simple terms, it can be challenging for scientists to articulate counterarguments to policies that increase transparency and accountability in the name of efficiency. This short piece offers a sketch of an argument against treating efficiency as the lodestar for science.","PeriodicalId":47697,"journal":{"name":"Social Science Information Sur Les Sciences Sociales","volume":"60 1","pages":"350 - 355"},"PeriodicalIF":1.1,"publicationDate":"2021-06-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1177/05390184211021383","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43979162","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}