{"title":"Online academic exams: Does multiplicity of exam versions mitigate cheating?","authors":"Flip Klijn , Mehdi Mdaghri Alaoui , Marc Vorsatz","doi":"10.1016/j.iree.2024.100305","DOIUrl":"10.1016/j.iree.2024.100305","url":null,"abstract":"<div><div>We study academic integrity in a final exam of a game theory course with 463 undergraduate students at a major Spanish university. The exam is an unproctored online multiple-choice exam without backtracking. A key characteristic is that for each (type of) problem, groups of students receive different versions. Moreover, each problem version is assigned to one subgroup during one stage of the exam and to another subgroup during an immediately consecutive later stage. Thus, we can exploit grade points and timestamps to study students’ academic integrity. We observe a significant decrease in completion time at each later stage; however, surprisingly, there is no corresponding impact on average grade points. The precise number of different versions does not seem to have an effect on either variable. Our findings thus suggest that employing a limited number of distinct problem versions (as few as two) can diminish cheating effectiveness in online exams.</div></div>","PeriodicalId":45496,"journal":{"name":"International Review of Economics Education","volume":"48 ","pages":"Article 100305"},"PeriodicalIF":1.3,"publicationDate":"2024-11-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142747105","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Equity in hybrid microeconomics classes: Effects on diverse student groups","authors":"Savannah Adkins","doi":"10.1016/j.iree.2024.100304","DOIUrl":"10.1016/j.iree.2024.100304","url":null,"abstract":"<div><div>The Covid-19 pandemic created a sudden increased uptake of online teaching, and though the end of the pandemic signaled a shift back to more in-person learning, many schools have used the existing infrastructure to expand their offerings of online and hybrid courses. While previous studies have identified the impact of online teaching on student score, little work has been done on the heterogenous impact that online and hybrid teaching can have, particularly for underrepresented groups of students. I utilize a randomized control trial in an introductory microeconomics course to test whether there are any differences in quiz score with a lecture delivered online as compared to in-person, mimicking a hybrid class environment. I find that when students watch a lecture online, they score 5 percentage points lower on average than attending a lecture in-person. This estimate is based on an intent-to-treat study design and estimates within-individual effects. I also assess heterogeneous effects across various demographic variables, including gender, race, and First-Generation status, and find that this result is particularly salient for non-White and first-generation students, highlighting the equity implications of moving to online teaching.</div></div>","PeriodicalId":45496,"journal":{"name":"International Review of Economics Education","volume":"47 ","pages":"Article 100304"},"PeriodicalIF":1.3,"publicationDate":"2024-10-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142416356","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Measuring economic graph competence","authors":"Malte Ring , Luis Oberrauch","doi":"10.1016/j.iree.2024.100302","DOIUrl":"10.1016/j.iree.2024.100302","url":null,"abstract":"<div><div>The ability to work with graphs is at the core of the economic domain and is also one of the central challenges for novices in the field. To accurately assess the graph competence of higher education students, we developed and tested an 18-item graph competence instrument with different economics graphs. The sample consisted of 579 students from multiple higher education institutions in southwestern Germany. Our findings reveal that while students generally perform well on basic graph operations, they struggle with complex tasks such as comparing quantities and understanding economic implications, particularly with supply and demand models and indifference curves. The results highlight the need for instructional focus on integrating graph reading with economic concepts and provide a diagnostic tool for further research. The study underscores the challenges faced by learners, especially those with limited economic background and female students, and offers insights for improving economic graph education.</div></div>","PeriodicalId":45496,"journal":{"name":"International Review of Economics Education","volume":"47 ","pages":"Article 100302"},"PeriodicalIF":1.3,"publicationDate":"2024-09-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142359184","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Improving student outcomes using automated feedback in a first-year economics class","authors":"Sinead Huskisson , Tom O'Mahony , Seán Lacey","doi":"10.1016/j.iree.2024.100303","DOIUrl":"10.1016/j.iree.2024.100303","url":null,"abstract":"<div><div>The assessment literature advocates utilising formative assessment strategies to support and enhance student learning. This study uses online practice tests with inbuilt feedback, that students could repeatedly use, as a formative feedback strategy in a first-year introductory microeconomics module. The key question explored is whether repeated engagement with online practice tests had a statistically significant impact on students’ subsequent performance on a summative assessment. Quantitative engagement and performance data (N = 223) were collected from a cohort of first-year students. An analysis of this data reveals that engaging with the online practice test multiple times has a statistically significant impact on final performance. Controlling for the mid-term grade, on average, each cycle of ‘seeking and acting’ increases grades in the final exam by 1.3 % (p = 0.003). Hence, the data suggests that incorporating multiple opportunities to take an online practice test, which includes feedback, is an important feature of the strategy. A smaller sample of qualitative survey data (N = 131) reveals that these economics students hold traditional views of feedback with little awareness of their own role in seeking and acting on feedback. We argue that formative practice tests have the potential to support the development of student feedback literacy.</div></div>","PeriodicalId":45496,"journal":{"name":"International Review of Economics Education","volume":"47 ","pages":"Article 100303"},"PeriodicalIF":1.3,"publicationDate":"2024-09-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142416355","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Turn the camera on to get better grade: Evidence from a field experiment","authors":"Jan L. Anderson, Leonid A. Krasnozhon","doi":"10.1016/j.iree.2024.100301","DOIUrl":"10.1016/j.iree.2024.100301","url":null,"abstract":"<div><p>The economics literature provides mixed results on the effect of online classroom technology on student outcomes. An emerging body of behavioral studies suggests that videoconferencing is a cognitively exhausting activity and that the camera that is a salient feature of virtual meetings is a leading cause of this fatigue, with a more pronounced effect on women. Thus, economists and behavioral scientists debate whether online education and its technology provide an effective method of instruction. We use a field experimental design to examine how camera use in online synchronous economics classes affects learning outcomes. We find that changing the method of student engagement from turning the camera off to turning it on increases quiz grades by 0.18 standard deviations while we control for students’ gender and aptitude.</p></div>","PeriodicalId":45496,"journal":{"name":"International Review of Economics Education","volume":"47 ","pages":"Article 100301"},"PeriodicalIF":1.3,"publicationDate":"2024-09-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142158216","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Environmental economics in the wild: Using long-form journalism and other mass media in the classroom","authors":"Patrick Gourley","doi":"10.1016/j.iree.2024.100295","DOIUrl":"10.1016/j.iree.2024.100295","url":null,"abstract":"<div><p>Instructors in principles of economics classes are incorporating more popular press material into their classes. This helps breathe life into economics and shows students that economic concepts can be applied in the real world. The current pedagogical literature on this topic often includes examples of popular media and assignments to go along with them. This approach has, by and large, not been extended to intermediate or upper-level courses. This paper develops an extensive list of long-form articles, podcasts, documentaries, and even a Hollywood film related to environmental economics that instructors can use in the classroom. Also included are discussion questions, response prompts, and a term paper assignment. By incorporating some of the myriad popular media artifacts that cover environmental issues into their courses, instructors of environmental economics can help their students apply what they learn in the textbook to real-life events.</p></div>","PeriodicalId":45496,"journal":{"name":"International Review of Economics Education","volume":"47 ","pages":"Article 100295"},"PeriodicalIF":1.3,"publicationDate":"2024-07-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141842500","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Investigating the link between students’ learning intentions and their learning outcomes: A clustered randomised controlled trial","authors":"Erkal Ersoy, Rachel Forshaw, Suzanne Lampert","doi":"10.1016/j.iree.2024.100299","DOIUrl":"10.1016/j.iree.2024.100299","url":null,"abstract":"<div><p>We investigate the impact of repeated contextual nudging on task com- pletion and performance within the setting of traditional face-to-face education, adding to a literature which has focused on non-contextual nudges, provided contextual nudges in online learning settings, or used one-time nudges. We undertake a clustered randomised controlled trial on first-year Business School students at Heriot-Watt University, employing weekly nudges during tutorials to encourage students to establish learning intentions for the upcoming week. We rule out significant treatment effects from the nudging intervention on tutorial attendance, the most important predictor of final marks of all intermediate outcomes that we consider. We are unable to make causal statements on the effects of the intervention on final marks. Nonetheless, this experiment yields valuable insights into the dynamics of repeated contextual nudging within traditional educational settings as well as shedding light on aspects of student behaviour.</p></div>","PeriodicalId":45496,"journal":{"name":"International Review of Economics Education","volume":"47 ","pages":"Article 100299"},"PeriodicalIF":1.3,"publicationDate":"2024-07-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141688763","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A mixed methods evaluation of online discussion tools in higher education","authors":"Alex Squires, Dan Rigby","doi":"10.1016/j.iree.2024.100298","DOIUrl":"10.1016/j.iree.2024.100298","url":null,"abstract":"<div><p>We present a mixed methods comparative assessment of three online discussion tools widely used in higher education. We combine different data types (quantitative, qualitative) and sources (usage data, survey responses) to assess Piazza, Padlet, and Blackboard discussion boards. We highlight and discuss the differences between, and relative merits of, the tools and report the preferences of students on a large introductory Economics unit for them. We summarise lessons learnt from using the tools and make recommendations to engender greater student engagement with online discussion spaces.</p></div>","PeriodicalId":45496,"journal":{"name":"International Review of Economics Education","volume":"47 ","pages":"Article 100298"},"PeriodicalIF":1.3,"publicationDate":"2024-07-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S1477388024000161/pdfft?md5=fa53615608b6dabbe802c17203cb738d&pid=1-s2.0-S1477388024000161-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141630084","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Markus Fritsch , Andrew Adrian Yu Pua , Joachim Schnurbus
{"title":"Teaching advanced topics in econometrics using introductory textbooks: The case of dynamic panel data methods","authors":"Markus Fritsch , Andrew Adrian Yu Pua , Joachim Schnurbus","doi":"10.1016/j.iree.2024.100297","DOIUrl":"10.1016/j.iree.2024.100297","url":null,"abstract":"<div><p>We show how to use the introductory econometrics textbook by <span><span>Stock and Watson (2019)</span></span> as a starting point for teaching and studying dynamic panel data methods. The materials are intended for undergraduate students taking their second econometrics course, undergraduate students in seminar-type courses, independent study courses, capstone, or thesis projects, and beginning graduate students in a research methods course. First, we distill the methodological core necessary to understand dynamic panel data methods. Second, we design an empirical and a theoretical case study to highlight the capabilities, downsides, and hazards of the method. The empirical case study is based on the cigarette demand example in <span><span>Stock and Watson (2019)</span></span> and illustrates that economic and methodological issues are interrelated. The theoretical case study shows how to evaluate current empirical practices from a theoretical standpoint. We designed both case studies to boost students’ confidence in working with technical material and to provide instructors with more opportunities to let students develop econometric thinking and to actively communicate with applied economists. Although we focus on <span><span>Stock and Watson (2019)</span></span> and the statistical software <em>R</em>, we also show how to modify the material for use with another introductory textbook by <span><span>Wooldridge (2020)</span></span> and Stata, and highlight some possible further pathways for instructors and students to reuse and extend our materials.</p></div>","PeriodicalId":45496,"journal":{"name":"International Review of Economics Education","volume":"47 ","pages":"Article 100297"},"PeriodicalIF":1.3,"publicationDate":"2024-07-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S147738802400015X/pdfft?md5=81c7fa3b3a9c3cf1de50e882b110dd62&pid=1-s2.0-S147738802400015X-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141700156","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A picture is worth a thousand words: The effectiveness of infographics in microeconomic principles courses","authors":"Lauren Calimeris , Edward Kosack","doi":"10.1016/j.iree.2024.100300","DOIUrl":"https://doi.org/10.1016/j.iree.2024.100300","url":null,"abstract":"<div><p>We investigate the impact of infographics on student learning in principles of economics classes. Infographics display facts, data, and information about a specific topic in a clear and easy to understand manner, using graphics and pictures to help summarize, explain, and display information. Creating an infographic can be a fun, engaging, and powerful educational tool for learning new topics in both introductory and advanced courses. We use a randomized classroom experiment to evaluate the effect of creating infographics on student learning in principles of microeconomics courses as measured by exam performance. The randomization across topics enables a student-fixed effects estimation of the effect of infographics. We find students were 2.1–2.2 percentage points more likely to answer a multiple-choice question correctly relating to the topics for which they completed an infographic relative to those they did not. We provide suggestive evidence that infographics may help higher ability students most, increasing their scores on both multiple choice and short answer questions.</p></div>","PeriodicalId":45496,"journal":{"name":"International Review of Economics Education","volume":"47 ","pages":"Article 100300"},"PeriodicalIF":1.3,"publicationDate":"2024-07-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141605521","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}