A comparison of electronic health records and the Oregon state immunization registry for human papilloma virus vaccine delivery (2005–2022)

Introduction: Immunization Information Systems (IIS) play an important information-sharing role at the point of care, and provide vital vaccination data for research studies and policy-makers. Previous validation studies comparing the accuracy of state registry data to health records have had mixed results. Methods: We conducted a retrospective review of EHR vaccination data for 9–17 year-old patients from 10 Oregon primary care clinics who had at least one ambulatory care visit in the past 3 years from the date of validation data collection. Data on 100 age eligible youth were captured per clinic. We compared HPV and Tdap vaccinations captured in the EHR to the Oregon ALERT IIS. All clinics were located in rural areas with both family medicine (n = 7) and pediatric (n = 3) primary care clinics. Results: Overall agreement for HPV vaccination between EHR and ALERT IIS was 89.4 % (k = 0.83; p < 0.05). For Tdap vaccination overall agreement was 80.8 % (k = 0.60; p < 0.05). Pediatric clinics showed a higher overall vaccine agreement for both HPV at 93.3 % (k = 0.89; p < 0.05) and Tdap at 95.3 % (k = 0.90; p < 0.05). Among clinics that used bidirectional data exchange (only family medicine clinics), HPV agreement was higher at 91 % (k = 0.85) versus 88 % (k = 0.81; p < 0.05) and was lower for Tdap 75 % with bidirectional data exchange (k = 0.50) versus 86 % without bidirectional data exchange (k = 0.70; p < 0.05). When the EHR and ALERT IIS disagreed, ALERT ISS usually had additional vaccines. Conclusions: ALERT IIS data provides more accurate data than EHRs can provide when measuring vaccine delivery among adolescents in rural Oregon.