Developing and Refining a Knowledge Assessment Instrument for Individuals Involved in Managing Occupational Heat Stress: Paper A.

Abstract

Introduction: Occupational heat stress poses a critical threat to workers' health, safety, and productivity. To effectively manage this hazard, occupational health and safety (OHS) representatives must comprehensively understand heat stress, heat-associated injury and disease outcomes, and heat mitigation measures to protect workers. We developed the Human and Environmental Physiology Research Unit-Occupational Heat Stress Knowledge Assessment Test (HEPRU-OHSKAT) as an initial step toward facilitating research in this area.

Method: The HEPRU-OHSKAT was developed using a mixed-methods approach. Preliminary items were developed after reviewing the academic and gray literature. A standardized content validity assessment was conducted with heat stress and OHS experts (n = 9); a trial distribution to refine and test feasibility was performed with an internal pilot group (n = 18). The instrument was then distributed to individuals involved with OHS (n = 216) and members of the general working population (n = 101) in Ontario, Canada (n = 317). Item analysis and item response theory modelling were used to refine the scale and scope of the instrument.

Results: Thirty-two items were developed for the preliminary instrument. Following expert consultation, a review of content validity, and the internal pilot, 31 items were retained in four subscales: General Heat Stress Knowledge (n = 8), Recognizing the Signs and Symptoms of Heat Stress and First Aid (n = 7), Exposure Limits and Heat Monitoring Practices (n= 13), and Workplace Controls for Heat (n = 3). Following item selection, the broader instrument was reduced to 20 items grouped into one scale.

Conclusions: The HEPRU-OHSKAT is the first instrument to assess knowledge of heat stress among those responsible for OHS. The instrument showed good reliability and internal consistency across knowledge categories.

Practical applications: The instrument can help OHS representatives better evaluate knowledge of, and manage training about, heat stress.