Evaluation Review最新文献

{"title":"Outcome Evaluation of a Transnational Postgraduate Capacity-Building Program Using the Objective Structured Clinical Examination.","authors":"Kye-Yeung Park, Hoon-Ki Park, Jwa-Seop Shin, Taejong Kim, Youngjoo Jung, Min Young Seo, Ketsomsouk Bouphavanh, Sourideth Sengchanh, Ketmany Inthachack","doi":"10.1177/0193841X231160805","DOIUrl":"10.1177/0193841X231160805","url":null,"abstract":"<p><p>Previous studies have applied interview-oriented self-reported or peer-centered evaluation methods, rather than an objective and quantitative method, to evaluate outcome of a postgraduate capacity-building program and have mainly focused on the cognitive level. To investigate the feasibility of the objective structured clinical examination (OSCE) in an international setting and report the results of the outcome evaluation for the behavioral aspect. A case-control study. Ninety examinees divided into 2 case-control groups: 17 program-experienced doctors and 17 control doctors in the first group, and 28 mentees of the program-experienced doctors and 28 control doctors in the second group. A six-station OSCE was implemented. The OSCE scores were measured to evaluate (1) the direct educational effect regarding learning in the first group and (2) the indirect educational effects regarding transfer in the second group. Written questionnaire and interview data were collected for qualitative analysis. The quantitative results of the overall or subcomponent OSCE scores indicated no significant differences in the comparisons of the first and second case-control groups. The qualitative data indicated that the program improved participants' medical knowledge, skills, and self-confidence, however, it also revealed limited learning environment provided by the program. This transnational study has demonstrated the process for introducing and successfully completing the testing of an OSCE in Laos. Discrepancy in the goals of the OSCE and the education program limited the usefulness of OSCE as an assessment tool, leading to the lack of significant differences in its results.</p>","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":"47 4","pages":"680-700"},"PeriodicalIF":0.9,"publicationDate":"2023-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9645451","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"The Design of Making Pre-K count and High Fives: Two-Stage, Multiyear Random Assignment at Different Levels.","authors":"Shira Mattera, Marie-Andree Somers, Robin Jacob, Pamela Morris-Perez","doi":"10.1177/0193841X231159472","DOIUrl":"10.1177/0193841X231159472","url":null,"abstract":"<p><p>The Making Pre-K Count and High 5s studies represent a recent application of a phased two-stage, multi-level design, which was used to examine the effects of two aligned math programs implemented in early childhood settings. The purpose of this paper is to describe the challenges encountered in implementing this two-stage design and to describe approaches to resolving them. We then present a set of sensitivity analyses the study team used to examine the robustness of the findings. During the pre-K year, pre-K <i>centers</i> were randomly assigned either to receive an evidence-based early math curriculum and associated professional development (Making Pre-K Count) or to a pre-K-as-usual control condition. In the kindergarten year, <i>students</i> who had been in Making Pre-K Count program classrooms in pre-K were then individually randomly assigned within schools to small-group supplemental math clubs that were designed to sustain the gains from the pre-K program, or to a business-as-usual kindergarten experience. Making Pre-K Count took place in 69 pre-K sites, comprising 173 classrooms across New York City. High 5s took place in the 24 sites that were part of the public school treatment arm of the Making Pre-K Count study and included 613 students. The study focuses on the effect of the Making Pre-K Count and High 5s programs on children's math skills at the end of kindergarten as measured by two instruments, the Research-Based Early Math Assessment-Kindergarten (REMA-K) and the Woodcock-Johnson Applied Problems test. The multi-armed design, while logistically and analytically challenging, balanced multiple considerations of power, the number of research questions that could be answered, and efficiency of resources. Robustness checks suggest that the design created groups that were both meaningfully and statistically equivalent. Decisions to use a phased multi-armed design should consider both its strengths and weaknesses. While the design allows for a more flexible, expansive research study, it also introduces complexities that need to be addressed both logistically and analytically.</p>","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":"47 4","pages":"701-726"},"PeriodicalIF":0.9,"publicationDate":"2023-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9647583","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Dynamics and Co-movements Between the COVID-19 Outbreak and the Stock Market in Latin American Countries: An Evaluation Based on the Wavelet-Partial Wavelet Coherence Model.","authors":"Faik Bilgili,&nbsp;Emrah Koçak,&nbsp;Sevda Kuşkaya","doi":"10.1177/0193841X221134847","DOIUrl":"https://doi.org/10.1177/0193841X221134847","url":null,"abstract":"<p><p>The COVID-19 outbreak and the global uncertainty it causes produce an apparent panic in stock markets. Efforts to explain the economic spillover effects of COVID-19 can guide authorities to design a control policy against the financial impacts of pandemics. The paper examines the effects of the COVID-19 cases on the stock markets in the emerging Latin American countries of Argentina, Brazil, Chile, Colombia, Mexico, and Peru. The paper employs a continuous partial wavelet methodology to observe lead-lag relations between the daily variables of new COVID-19 cases and the stock market index for each Latin American country. Brazilian new COVID-19 cases led the Bovespa (BVSP) index to decline during the whole period, except February and June 2020, at one month-two month-frequency band. The wavelet and phase difference analyses indicate that, except for Brazil, COVID-19 cases did not affect the stock market indexes adversely during the whole sample period but did affect the stock exchange markets negatively during some sub-sample periods of the entire sample of each country. Dynamics of Latin American stock exchange markets in the short and long run can be explained by some other parameters of real and financial sectors and COVID-19 cases.</p>","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":"47 4","pages":"630-652"},"PeriodicalIF":0.9,"publicationDate":"2023-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9606642/pdf/10.1177_0193841X221134847.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9665834","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Investigating the Role of Information and Communication Technologies, Economic Growth, and Foreign Direct Investment in the Mitigation of Ecological Damages for Achieving Sustainable Development Goals.","authors":"Atif Jahanger,&nbsp;Muhammad Usman","doi":"10.1177/0193841X221135673","DOIUrl":"https://doi.org/10.1177/0193841X221135673","url":null,"abstract":"<p><p>At the present time, information and communication technology (ICT) has played a vital role in socio-economic development such as economic growth, literacy, life expectancy, and employment levels in societies, however, such development has come with various environmental damages perspectives. This study scrutinizes the impact of ICT, economic growth, and foreign direct investment (FDI) on carbon dioxide (CO₂) emissions in the 44 One Belt and Road Initiative (OBRI) countries split into sub-region from 1991 to 2019. This study applied various econometrics approaches such as cross-sectional dependence, second-generation unit root, and Westerlund panel cointegration techniques are executed to analyze the panel data set. The full modified ordinary lease square and dynamic ordinary lease square estimators are applied to investigate the long-term influence of ICT development, GDP (economic growth), and FDI on CO₂ emissions. The empirical analysis was performed at a disaggregated level to assess the possible environmental influences across the OBRI countries. Overall, the results reported that broadband and mobile development have an adverse effect on CO₂ emissions. The finding further reveals that the broadband indicator negatively affects CO₂ emissions in all OBRI regions except South Asia. Similarly, the mobile use indicator protects the environmental quality in all OBRI regions except MENA (Middle East and North Africa) and Central Asia. Regarding country-wise analysis, broadband has alleviated the pollution level in 21 countries, while mobile has alleviated it in 15 countries. Moreover, economic growth is responsible to increase pollution levels in all panels and regions except Europe. Besides, the results highlight that higher FDI reduces environmental pollution whereby, the pollution halo hypothesis is supported to hold for all OBRI panels and regions except MENA countries. Based on the empirical findings, the policymakers and governments of these economies should design policies to grow smarter cities, transportation systems, electrical grids, industrial processes, and energy-saving production through ICT development on a macro level.</p>","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":"47 4","pages":"653-679"},"PeriodicalIF":0.9,"publicationDate":"2023-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9647017","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Key Attributes of a Medical Learning Community Mentor at One Medical School: The Mentee Perspective.","authors":"Waqas Zia Haque,&nbsp;Jennifer Coias,&nbsp;E Whitney Pollio,&nbsp;Rana Yazdani,&nbsp;James M Wagner,&nbsp;Carol S North,&nbsp;David E Pollio","doi":"10.1177/0193841X221144338","DOIUrl":"https://doi.org/10.1177/0193841X221144338","url":null,"abstract":"<p><p>To assess the elements necessary to be a successful learning community (ClinCalc) mentor to medical students from the mentee's perspective. Few such studies have utilized the in-depth and richness of detail obtained in qualitative studies. This qualitative study analyzed four focus group discussions lasting 45-90 min conducted at the University of Texas Southwestern Medical School, which has an established LC, in the year 2018. The groups included 14 pre-clerkship and 8 clerkship students. Investigators evaluated transcriptions of the focus group discussions using ATLAS.ti software. Three overarching categories of discussion emerged from the group discussions: (1) Relationship Competence, (2) Teaching Competence, and (3) Ethical and Compassionate Medical Practice Competence. Relationship Competence themes included \"walk with me,\" relationship is most important, and one-on-one. Teaching Competence themes included above and beyond, recognize and address mentor limitations, and safe and enriching environment. Ethical and Compassionate Medical Practice Competence themes included ethical decision making and compassionate care for diverse patient populations. Mentees focused on various aspects of the mentor-mentee relationship as the single most essential competence. Themes mentees discussed as important qualities of a successful mentor may denote qualities to be prioritized in faculty development and mentor recruitment. Future studies could investigate how the LC environment informs former medical students and promotes patient outcomes.</p>","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":"47 3","pages":"504-531"},"PeriodicalIF":0.9,"publicationDate":"2023-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9477508","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Can Non-Randomised Studies of Interventions Provide Unbiased Effect Estimates? A Systematic Review of Internal Replication Studies.","authors":"Hugh Sharma Waddington,&nbsp;Paul Fenton Villar,&nbsp;Jeffrey C Valentine","doi":"10.1177/0193841X221116721","DOIUrl":"https://doi.org/10.1177/0193841X221116721","url":null,"abstract":"<p><p>Non-randomized studies of intervention effects (NRS), also called quasi-experiments, provide useful decision support about development impacts. However, the assumptions underpinning them are usually untestable, their verification resting on empirical replication. The internal replication study aims to do this by comparing results from a causal benchmark study, usually a randomized controlled trial (RCT), with those from an NRS conducted at the same time in the sampled population. We aimed to determine the credibility and generalizability of findings in internal replication studies in development economics, through a systematic review and meta-analysis. We systematically searched for internal replication studies of RCTs conducted on socioeconomic interventions in low- and middle-income countries. We critically appraised the benchmark randomized studies, using an adapted tool. We extracted and statistically synthesized empirical measures of bias. We included 600 estimates of correspondence between NRS and benchmark RCTs. All internal replication studies were found to have at least \"some concerns\" about bias and some had high risk of bias. We found that study designs with selection on unobservables, in particular regression discontinuity, on average produced absolute standardized bias estimates that were approximately zero, that is, equivalent to the estimates produced by RCTs. But study conduct also mattered. For example, matching using pre-tests and nearest neighbor algorithms corresponded more closely to the benchmarks. The findings from this systematic review confirm that NRS can produce unbiased estimates. Authors of internal replication studies should publish pre-analysis protocols to enhance their credibility.</p>","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":"47 3","pages":"563-593"},"PeriodicalIF":0.9,"publicationDate":"2023-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ftp.ncbi.nlm.nih.gov/pub/pmc/oa_pdf/e0/ef/10.1177_0193841X221116721.PMC10186563.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9486562","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"The Dynamic Nexus Between International Tourism and Environmental Degradation in Top Twenty Tourist Destinations: New Insights From Quantile-on-Quantile Approach.","authors":"Ilhan Ozturk,&nbsp;Arshian Sharif,&nbsp;Danish Iqbal Godil,&nbsp;Adnan Yousuf,&nbsp;Iram Tahir","doi":"10.1177/0193841X221149809","DOIUrl":"https://doi.org/10.1177/0193841X221149809","url":null,"abstract":"<p><p>Tourism is one of the important factors that can affect the environmental and economic situation of any economy. This study investigates the relationship between tourist arrivals and CO2 emission in the top 20 tourist destinations using data from quarterly observations from 1995 to 2018. A unique technique via quantile-on-quantile regression and Granger causality in quantiles was used. In particular, how the quantiles of tourist arrivals impact quantiles of CO2 emission was analyzed. The empirical results suggest a combination of both positive and negative effects of tourist arrivals and CO2 emission in most tourist destinations. Predominantly, at both high and low tails, in the USA, Spain, Hong Kong, and Austria, tourist arrival has a positive effect on CO2 emission, whereas in the case of Canada, France, Germany, Mexico, and Malaysia, the association was negative. On the other hand, China, Greece, Russia, Japan, Italy, South Korea, Thailand, and Turkey have both positive and negative effects of tourism on CO2 emissions at low and high tails. Tourism can be an important factor while formulating policy for environmental and climate aspects.</p>","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":"47 3","pages":"532-562"},"PeriodicalIF":0.9,"publicationDate":"2023-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9470699","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Linking Trait Affectivity, Cognitive Ability, and Preferences Among Top Managers: Insights From a Lab-In-The-Field Experiment.","authors":"Huong Trang Kim","doi":"10.1177/0193841X221143829","DOIUrl":"10.1177/0193841X221143829","url":null,"abstract":"<p><p>Even though there has been increasing interest in the role of cognition in leadership and in identifying the personality traits of effective leaders, there is a paucity of studies that investigate the unique influence of managers' trait affectivity and cognitive ability on their different risk and time preferences. This paper investigates the role of managers' trait affectivity and cognitive ability in their loss aversion and present bias among 623 top managers at textile and garment firms in Vietnam. We combine data on preferences elicited through a lab-in-the-field experiment with survey data. We find that managers with high positive affectivity (PA) or cognitive ability are less subject to loss aversion and present bias. In contrast, a manager with high negative affectivity (NA) is more likely to be impatient and loss averse. Furthermore, heterogeneity of trait affectivity and cognitive ability determines different loss aversion and present bias levels of managers in SMEs vis-à-vis their counterparts in large firms. Remarkably, we observe striking evidence that trait affectivity and cognitive ability significantly affect loss aversion and present bias levels of managers who were born during the Vietnam War. Still, it is not the story of their counterparts born after the Vietnam War. The results of our study are expected to provide valuable information regarding the role played by trait affectivity and cognitive ability in determining managers' loss aversion and present bias in different pathways.</p>","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":"47 3","pages":"479-503"},"PeriodicalIF":0.9,"publicationDate":"2023-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9476531","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Government Bonds and COVID-19. An International Evaluation Under Different Market States.","authors":"Francisco Jareño,&nbsp;María-Isabel Martínez-Serna,&nbsp;María Chicharro","doi":"10.1177/0193841X221143680","DOIUrl":"https://doi.org/10.1177/0193841X221143680","url":null,"abstract":"<p><p>This study evaluates the sensitivity of government bond yields from the countries most affected by the COVID-19 pandemic to variations in some international risk factors during the period between January 2020 and April 2021. This sample period allows us to focus the study on the first, and the subsequent waves of the COVID-19 pandemic. Specifically, we propose an extended risk factor model estimated using the quantile regression approach. In addition, this study compares the COVID-19 pandemic period with a pre-pandemic and a post-vaccination period. Interesting differences among them are observed, remarking that gold is the key risk factor during the pandemic, whereas VIX and crude oil play that role in the pre-pandemic and the post-vaccination periods, respectively, mainly for bearish states. As expected, the explanatory power of the model is better at extreme quantiles, showing relevant differences between sensitivities, because the found effects are quantile-, country- and risk factor-dependent. The results during the pandemic are robust to the inclusion of a country-specific factor and a factor accounting for the mutual influence of the government bonds.</p>","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":"47 3","pages":"433-478"},"PeriodicalIF":0.9,"publicationDate":"2023-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9720420/pdf/10.1177_0193841X221143680.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10095150","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Evaluating the Safe-Haven Abilities of Bitcoin and Gold for Crude Oil Market: Evidence During the COVID-19 Pandemic.","authors":"Qian Wang, Yu Wei, Yifeng Zhang, Yuntong Liu","doi":"10.1177/0193841X221141812","DOIUrl":"10.1177/0193841X221141812","url":null,"abstract":"<p><p>The COVID-19 pandemic poses a serious threat to investors in the crude oil market. Furthermore, investors have an increasing need to find a safe haven in their investment portfolios when facing unprecedented risks in crude oil markets during the COVID-19 pandemic. According to a review of the literature, there are contradictory findings on which investment is the safer haven for the oil market. Therefore, this paper aims to evaluate whether bitcoin is a safer haven for the crude oil market than the commonly used gold during the COVID-19 pandemic. Three spillover measurements based on the time, and frequency domains, and a network framework are employed to quantify the return spillover effects among bitcoin, gold and three major crude oil futures markets. We divide the sample into two periods, pre-COVID-19 and post-COVID-19. The results show that bitcoin has a weak safe-haven effect on the crude oil market only over a short period, while gold maintains a good safe-haven ability for crude oil futures across various time horizons (frequencies), both before and after the outbreak of the COVID-19 pandemic. The findings of this study have important implications for policy-makers, crude oil producers and global investors. In particularly, investors cannot ignore the importance of bitcoin and gold in selecting more profitable portfolio policies when searching for safe-haven assets.</p>","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":"47 3","pages":"391-432"},"PeriodicalIF":3.0,"publicationDate":"2023-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9720065/pdf/10.1177_0193841X221141812.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9481915","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}