{"title":"Form the Stakeholder Group (Step 1)","authors":"E. Ricci, E. Pretto, K. O. Sundnes","doi":"10.1093/med/9780198796862.003.0005","DOIUrl":"https://doi.org/10.1093/med/9780198796862.003.0005","url":null,"abstract":"If an evaluation study is ultimately to be used to change and improve the medical and public health response to disasters it is essential to involve those who have the strongest interest and reasons for making improvements and who have the power and resources to do so. These individuals are referred to as ‘stakeholders’. Experience has shown clearly that if the key stakeholders are involved from the beginning in the planning and implementation of the evaluation, and in the process of preparing recommendations for change in future preparedness and response efforts, the evaluation recommendations are much more likely to be adopted. The evaluation team leader, after review of source material such as governmental reports, organization charts, newspaper and agency descriptions, should select appropriate members of the group.","PeriodicalId":304773,"journal":{"name":"Disaster Evaluation Research","volume":"156 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114850619","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Select and Train a Field Research Team and Collect Data (Step 7)","authors":"E. Ricci, E. Pretto, K. O. Sundnes","doi":"10.1093/med/9780198796862.003.0011","DOIUrl":"https://doi.org/10.1093/med/9780198796862.003.0011","url":null,"abstract":"Before beginning data collection in disaster areas, extensive preparations must be made; economical use of time and resources are prime considerations. These may be based on the scout team’s report described in Chapter 10. One member of the evaluation team assumes major responsibility for those preparations and is designated team leader or field research coordinator. The team leader insures optimal use of time spent in the field and adequate preparation of the research team and the community for the research visit. Training all members of the data collection team in the use of all data collection instruments, and in the field protocol, is an essential step in the process. The reliability and validity of the data collected are a function of the ability of the data collectors to properly use the instruments. Often the data required are culturally sensitive. Cultural factors are important confounders in data collection. All data collectors must be familiarized with key aspects of the culture of the area in which they will work; persons from within the disaster region must be incorporated into the research design process, the preparation of the data collection instruments, and in the data collection process itself, as these individuals can assist the ‘out of country’ team members identify and negotiate cultural barriers and sensitivities that could impede the research. This is facilitated by conducting an initial scout survey of the disaster zone and by using a multinational team in the design of research instruments and in the implementation of the evaluation study.","PeriodicalId":304773,"journal":{"name":"Disaster Evaluation Research","volume":"9 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127950355","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A General Framework for Evaluation","authors":"E. Ricci, E. Pretto, K. O. Sundnes","doi":"10.1093/med/9780198796862.003.0002","DOIUrl":"https://doi.org/10.1093/med/9780198796862.003.0002","url":null,"abstract":"Evaluation science emerged in the 1960s as a conceptual framework and methodology for using scientific methods to assess the structure, operation, costs, and outcomes of public health and other social programs. Evaluation is both a scientific specialty, which follows the rules of science, and a profession that operates within a framework of quality and ethical standards. The great challenge for evaluation is not only to motivate organizations to more effectively and consistently conduct scientific evaluation studies but also to use what has been learned through such studies to redesign programs based upon evaluation findings. The ultimate purpose of scientific evaluation is to improve human health and well-being through the application of evaluation findings to the design and implementation of public health and all other human service programs.","PeriodicalId":304773,"journal":{"name":"Disaster Evaluation Research","volume":"21 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115072104","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Introduction to a Model for Disaster Evaluation","authors":"E. Ricci, E. Pretto, K. O. Sundnes","doi":"10.1093/med/9780198796862.003.0003","DOIUrl":"https://doi.org/10.1093/med/9780198796862.003.0003","url":null,"abstract":"In this chapter we move to a discussion of the determination of objectives for a disaster evaluation study and the rationale behind the design and use of a logic model. Logic models are now widely used throughout the domain of public health as a tool for both designing and evaluating health programs (typically referred to as ‘interventions’). This chapter is offered as a general introduction to the detailed discussion of eight steps for conducting a disaster evaluation as presented in Part 2 of this Field Manual. The selection of two key components of our general evaluation framework, ‘evaluation objectives’ and ‘program theory/logic model’ for further discussion, is to highlight the centrality and importance of these ideas and concepts for scientific evaluations.","PeriodicalId":304773,"journal":{"name":"Disaster Evaluation Research","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114503776","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Conduct a Scout Survey (Step 6)","authors":"E. Ricci, E. Pretto, Knut Ole Sundnes","doi":"10.1093/med/9780198796862.003.0010","DOIUrl":"https://doi.org/10.1093/med/9780198796862.003.0010","url":null,"abstract":"We strongly recommend that a ‘scout survey’ of the disaster site be implemented prior to the initiation of the principal study, in order to obtain the types of detailed information required to prepare a research plan and a plan for working with a full research team during the data collection period. The scout survey step requires that one or two researchers go to the disaster site within two or three weeks following the disaster to prepare for a larger team visit, which would initiate work within two to three months post disaster. ‘Scout team’ visits are an essential mechanism for developing and/or revising the data collection instruments, for securing collaboration of local officials who will facilitate the study, for identifying key informants and members of the stakeholder group, and for obtaining background information needed for the sample design. We believe it is essential that the initial data collection be completed as soon as possible after the disaster event ends, in order to minimize memory loss. It is also of great importance that the primary data collection phase be conducted efficiently, within a period of approximately seven to ten days, although additional data may be added subsequent to the primary data collection period as the need for it becomes apparent. It is also likely that a data gathering effort, such as a survey involving large numbers of individuals, may continue after the main data collection team members have returned to their home institutions. The amount of thorough and detailed planning required to achieve the 7–10 day goal virtually mandates a pre-visit by a scout team.","PeriodicalId":304773,"journal":{"name":"Disaster Evaluation Research","volume":"9 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115227808","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Construct a Sampling Plan (Step 5)","authors":"E. Ricci, E. Pretto, K. O. Sundnes","doi":"10.1093/med/9780198796862.003.0009","DOIUrl":"https://doi.org/10.1093/med/9780198796862.003.0009","url":null,"abstract":"In disaster studies it is necessary to obtain information from several groups of those involved and affected by the disaster and from various types of medical and administrative documents. We have suggested in Chapter 8 that information be obtained from, at a minimum, (1) survivors/victims/families; (2) professional responders and coordinators (both public safety and EMS/medical); (3) officials of governmental and non-governmental organizations; (4) medical records; and (5) administrative documents. This typically involves accessing a large number of individuals and reports. It is therefore almost always necessary to select a sample from each group and source. When possible some form of random (probability) sampling should be used; a different type of sampling called ‘purposive’ may be employed for key informants. ‘Convenience samples’ are not generally used in scientific evaluation studies due to their great potential for introducing bias into the data. Preparing and implementing a scientific sample design will prove to be one of the most challenging aspects of disaster evaluation studies. It will usually be necessary to consult with an individual who has statistical expertise when preparing the sampling plan; therefore, in this chapter we present some basic concepts in sampling and then conclude with four descriptions of sample designs used in past evaluation studies.","PeriodicalId":304773,"journal":{"name":"Disaster Evaluation Research","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129530226","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Ethical Considerations in Disaster Evaluation Studies","authors":"E. Ricci, E. Pretto, K. O. Sundnes","doi":"10.1093/med/9780198796862.003.0013","DOIUrl":"https://doi.org/10.1093/med/9780198796862.003.0013","url":null,"abstract":"It is only within the recent past that bioethicists and legal scholars have begun to address the highly complex domain of ethical and legal issues related to the conduct of research in the context of disaster conditions. Since the year 2000, several national and international committees and organizations have developed guidelines for the ethical conduct of research under disaster conditions. These guidelines focus upon three unique characteristics of the disaster situation that researchers must consider: (1) the unique vulnerability of disaster victims; (2) the complications related to obtaining ‘ethics review’ during and immediately after a disaster impact; and (3) threats to research team members, victims and rescue workers during the data collection period. Suggestions for managing these threats and their associated risks are offered in this chapter. The framework and suggestions are drawn from reviews prepared by the World Health Organization and by a team of bioethics and legal scholars who have carefully reviewed and summarized the relevant national and international guideline statements.","PeriodicalId":304773,"journal":{"name":"Disaster Evaluation Research","volume":"27 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125843576","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Analyze Data and Prepare a Final Report (Step 8)","authors":"E. Ricci, E. Pretto, K. O. Sundnes","doi":"10.1093/med/9780198796862.003.0012","DOIUrl":"https://doi.org/10.1093/med/9780198796862.003.0012","url":null,"abstract":"In this chapter we present an overall approach to data analysis and the preparation of a final report. We suggest that the final report should initially be organized to address each major research question. However, as the research plan is implemented, additional questions may emerge or, even more likely, the original questions could have become more nuanced. It is necessary to involve some or all members of the stakeholder groups in the preparation of findings and recommendations. Initially, a simple straightforward presentation of findings, promptly prepared, will best serve the cause of improving medical and public health response efforts. In this chapter we describe a process which will lead to the completion of the type of report that will be useful to stakeholders and decision-makers. It is essential that the report be generated in a timely manner in order to enable decision-makers to draw upon recent public memory to gain support for change where required. Some general comments about data analyses are offered; however, it is not our intent in this book to provide a full discussion about data analysis for mixed-methods studies. It is therefore essential that a methodologist/data analyst be included within the evaluation team.","PeriodicalId":304773,"journal":{"name":"Disaster Evaluation Research","volume":"4 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125194289","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A Brief History of Disaster Evaluation Studies","authors":"E. Ricci, E. Pretto, K. O. Sundnes","doi":"10.1093/med/9780198796862.003.0001","DOIUrl":"https://doi.org/10.1093/med/9780198796862.003.0001","url":null,"abstract":"The scientific study of disasters has a long history, albeit limited in scope and structure. The first studies tended to focus on the societal and human impact of these horrific events and to report numbers of casualties. Later studies examined more deeply the impact and stresses disasters have placed upon the individuals and communities affected and upon the emergency public health and medical care systems in the affected geographic areas. The methodological challenges to conducting these studies have been great in that disasters are typically unexpected, and there is little time for recording and collecting data concurrently. However, a methodology for collecting data descriptive of the medical and public health response to disasters is evolving through much trial and error. This chapter is not intended to be a comprehensive review of disaster evaluation research and evaluation. It is, rather, a portrait of some highlights in the complex and difficult pathway traversed by those who have attempted to study disasters while using the methods of science.","PeriodicalId":304773,"journal":{"name":"Disaster Evaluation Research","volume":"52 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122463757","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Formulate Evaluation Questions (Step 2)","authors":"E. Ricci, E. Pretto, K. O. Sundnes","doi":"10.1093/med/9780198796862.003.0006","DOIUrl":"https://doi.org/10.1093/med/9780198796862.003.0006","url":null,"abstract":"In this chapter we define the five basic categories of evaluation, namely structure (resources), process (activities), outcomes, adequacy, and costs associated with the response(s). Structure refers to the equipment and personnel and the way in which these resources were organized for use in the medical response. Process refers to the activities carried out during the disaster response. Outcome assessment concerns the results of the care provided on the patients served, usually measured over time. Adequacy describes the extent to which the search-and-rescue, pre-hospital and hospital, and public health responses were able to meet the needs of the community during the disaster response. In general, these categories are consistent with the design of a typical logic model. Following the discussion of ‘evaluation categories’ we suggest questions that the evaluation team might consider for inclusion in the evaluation study. For each category we suggest questions which could be addressed in any disaster evaluation study which focuses on the medical and public health response. The stakeholder group should be fully involved in the selection of questions to be addressed by the evaluation team.","PeriodicalId":304773,"journal":{"name":"Disaster Evaluation Research","volume":"14 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114407121","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
京公网安备 11010802042870号
求助内容：
应助结果提醒方式：