Considerations for the epidemiological evaluation of hyperlocal interventions: A case study of the New York City overdose prevention centers

Abstract

To meet the needs of diverse communities, public health authorities are increasingly reliant on hyperlocal interventions targeting specific health issues and distinct populations. To facilitate epidemiological evaluation of hyperlocal interventions on community-level outcomes, we developed a framework of six practice-based considerations for researchers: spatial zone of impact, temporal resolution of impact, outcome of interest, definition of a plausible comparison group, micro vs. macro impacts, and practitioner engagement. We applied this framework to a case study of an impact evaluation of the New York City (NYC) overdose prevention centers (OPCs) on neighborhood-level drug-related arrests. We used drug arrest data from NYC from January 1, 2014, to September 30, 2023 and US Census data to conduct synthetic control modeling, comparing pre- and post-OPC arrests in the neighborhoods surrounding the two NYC OPCs (East Harlem and Washington Heights). We conducted sensitivity analyses to validate our results and compare our findings with those from a prior published study. Our findings indicate no significant change in drug-related arrests following the OPC openings. The mean absolute differences in daily drug-related arrests between the OPCs and their synthetic controls were 0.63 (p = 0.19) in East Harlem and 0.14 (p = 0.22) in Washington Heights. Sensitivity analyses corroborated our main results. Overall, findings demonstrate how our framework can be used to guide future epidemiological evaluations of diverse, hyperlocal public health interventions.