Journal List > J Korean Med Sci > v.40(16) > 1516090632

Hyun, Heo, Choi, Nham, Yoon, Noh, Song, Kim, Choi, Choi, Seo, Lee, and Cheong: Sentinel Safety Monitoring System for Adverse Events of Special Interest Associated With Non-NIP Vaccines in Korea

Abstract

South Korea’s current vaccination policies leave a surveillance gap for non-National Immunization Program (NIP) vaccines. In this study, we proposed a sentinel surveillance approach for monitoring the safety of non-NIP vaccines. Vaccination data were collected retrospectively among patients hospitalized with pre-defined adverse events of special interest (AESI) by reviewing electronic medical records in five university hospitals. This approach incorporates expert assessment to determine the causal relationship. We confirmed that 16 patients had received non-NIP vaccines among 860 patients diagnosed with AESI. We concluded one case of preeclampsia was possibly related to tetanus-diphtheria-pertussis vaccination. We propose a multi-hospital-based, retrospective assessment system for pre-defined AESIs as an alternative to active vaccine safety monitoring method. These efforts are expected to enhance both the accuracy and timeliness of safety monitoring in South Korea.

Graphical Abstract

jkms-40-e152-abf001.jpg

Vaccines have played a crucial role in public health, and their role is expected to expand substantially in the future with the development of novel vaccines. Demographic factors such as sex, age, race, and ethnicity can affect not only immune responses post-vaccination, but also the adverse events.12 The maintenance of effective surveillance system for adverse events following immunization (AEFI), aligned with national vaccination policies and demographic characteristics, is important to ensure the timely detection and responses to vaccine safety issues.
In South Korea, the surveillance system for AEFI was first implemented in 1995, and has maintained a passive surveillance system depending on reports from patients and physicians.3 Passive surveillance systems, while convenient to implement, have limitations in accessing complete clinical data and determining population-level incidence.4 These limitations pose challenges in determining the causality between vaccination and adverse events. South Korea’s online registration system for vaccination, which requires recording vaccine name, administration date, and lot number, helps to overcome some of the limitations of passive surveillance.56 However, this registration system applies only to National Immunization Program (NIP) vaccines, excluding non-NIP vaccines.
As of 2024, the NIP in South Korea recommends 17 infectious diseases under the Infectious Disease Control and Prevention Act.7 Most these NIP vaccines are for infants and young children, while only the influenza vaccines and 23-valent pneumococcal polysaccharide vaccine are for older adults. Most newly introduced vaccines are classified as non-NIP; therefore, a gap in safety monitoring may arise under the current system until these vaccines are incorporated into the NIP.
Active surveillance offers several advantages over passive surveillance, including more accurate incidence rate estimation and improved assessment of causality.8 The Vaccine Safety Datalink (VSD) in the United States (U.S.) and the Immunization Monitoring Program ACTive (IMPACT) in Canada are representative examples of active surveillance systems.91011 The VSD regularly monitors the incidence rate of pre-defined adverse events of special interest (AESIs) after vaccination using electronic medical record (EMR) data from 11 large healthcare institutions. Through rapid cycle analysis of data shared under a common data model, VSD can identify the safety concerns highlighted in medical literature or by a U.S. passive surveillance system such as Vaccine Adverse Event Reporting System (VAERS).91012
We have previously reported on various attempts to establish a system for monitoring AEFI of non-NIP vaccines.13 In the present study, we provide a tool which can function as a sentinel surveillance on AESIs following non-NIP vaccination in South Korea.
This study was conducted at five university hospitals in South Korea (Korea University Guro and Ansan Hospital; Hallym University Kangnam Sacred Heart Hospital; Catholic Kwandong University International St. Mary’s Hospital; and Ajou University Hospital) from September 2022 to August 2024. We received a monthly list of patients discharged with pre-defined AESI diagnoses from the medical information team. The AESI diagnoses were identified based on the International Classification of Diseases, Tenth Revision (ICD-10) codes. Adults aged 18 years and older were included in the study and the patients who had the same AESI codes within the past year were excluded. We reviewed the EMR and collected data on patient demographics, pre-existing medical conditions, and the vaccination history in the three months prior to admission. Prior to the beginning of the study, we requested the departments and wards related to the AESI diseases to conduct a thorough investigation of vaccination history, with particular emphasis on confirming the vaccination status of non-NIP vaccines among patients with AESIs. Additionally, we asked them to notify the researchers if any non-NIP vaccination history is identified. For patients with non-NIP vaccination history, infectious diseases specialists at each hospital reviewed their EMRs and conducted interviews to assess causality between vaccination and AESIs. For those who were discharged, interviews were conducted over the phone. The causality was assessed based on the guidelines of the Korea Disease Control and Prevention Agency (Table 1).14 Non-NIP vaccines included pneumococcal conjugate vaccines, tetanus-diphtheria-pertussis (Tdap), live attenuated and recombinant zoster vaccines. The pre-defined AESIs were classified into six categories, with the corresponding diagnoses and ICD-10 codes as follows: neurologic disorders (G03.8, G03.9, G04.0, G04.8, G04.9, G05.8, G36.8, G36.9, G37.3, G37.8, G37.9, G51.0, G61.0, G61.8, G61.9, M53.1, M54.1, R27.0, R56.8), including seizure, radiculopathy, aseptic meningitis, Guillain-Barré syndrome, transverse myelitis, encephalitis, Bell’s palsy, acute disseminated encephalomyelitis, and ataxia/cerebritis; autoimmune disorders (E10, M05, M06, M32), such as rheumatoid arthritis, systemic lupus erythematosus, aseptic arthritis, and type 1 diabetes mellitus; cardiologic disorders (I30.8, I30.9, I40.8, I40.9, I51.4), including myocarditis and pericarditis; obstetric disorders (P95, O03, O06), such as spontaneous abortion, stillbirth, and preeclampsia; hematologic disorders (D69.0, D69.3), including immune thrombocytopenia and Henoch–Schönlein purpura; and allergic disorders (T78.2, T88.6), specifically anaphylaxis.
A total of 860 patients were included in the study. The median age of the patients was 55 years (interquartile range, 39–67 years) and 436 patients (50.7%) were male (Table 2). Neurologic disorders were the most frequent category of AESI, accounting for 88.0% of cases. Seizure was the most common individual diagnosis (36.3%). Among the 16 patients who received non-NIP vaccines, the most frequent AESI diagnosis was radiculopathy (31.3%), followed by seizure (18.8%), aseptic meningitis (12.5%), Bell's palsy (6.3%), ataxia/cerebritis (6.3%), aseptic arthritis (6.3%), stillbirth (6.3%), and preeclampsia (6.3%). The characteristics of patients who received non-NIP vaccines and the results of causality assessment are presented in Table 3. In 15 cases, the causality between vaccination and AESI were determined to be unlikely or not related. In one case of preeclampsia following Tdap vaccination, a possible causal relationship was identified. The case involved a 34-week pregnant patient with pre-existing gestational diabetes and hypertension who presented with vomiting, dizziness, proteinuria, and elevated blood pressure four days after receiving the Tdap vaccine. This temporal and clinical association led to a causality assessment of “possibly related.”
This is the first study reporting the AESI after non-NIP vaccination in South Korea using multi-center sentinel surveillance by medical record review. We identified 860 patients diagnosed with AESI, among whom 16 had received non-NIP vaccines. Ultimately, we concluded that one case of preeclampsia was possibly related to the Tdap vaccination.
The VSD, an active surveillance system in the U.S., compares the incidence rate of AESI between vaccinated and unvaccinated individuals using multi-institutional EMR data. It detects safety warnings for vaccines when the incidence rate of AESI in vaccinated individuals significantly exceeds that in unvaccinated individuals.910 In the present study, we retrospectively confirmed the vaccination status of patients with AESI diagnoses, and infectious diseases specialists directly assessed the causality between non-NIP vaccines and AESI. Although our approach does not allow for the calculation of the incidence rate as done in the U.S. VSD, it may provide a signal indicating the need for further evaluation of the causal relationship between AESI and non-NIP vaccination.
In the past, efforts in South Korea to establish an active surveillance system attempted to conduct post-vaccination surveys via phone or email; however, these efforts faced limitations due to low response rates and high labor demands, which precluded practical implementation.15 The sentinel surveillance in the present study may serve as a useful method for monitoring AESIs—key considerations in vaccine safety—while requiring relatively low cost and labor.
This study has several limitations. First, the vaccination status of non-NIP vaccines may have been underestimated, as it was identified solely through EMRs of each hospital where the patient admitted. Along with the underestimation, the number of non-NIP vaccine recipients was low. Increasing the number of participating institutions may be required to overcome these limitations. Second, we identified study participants solely based on ICD-10 codes. This was intended to establish a system that could be easily implemented and reduce labor.
In 2019, the World Health Organization Global Vaccine Safety Blueprint 2.0 (2021–2023) proposed to develop active and hospital-based sentinel surveillance systems. It also emphasized the need to strengthen countries’ capacity for investigating serious AEFIs and providing high-quality data for causality assessments.16 Our approach addresses the global need for improved vaccine safety surveillance. The key elements for improving our approach include the establishment of a centralized and trustworthy database of vaccination records led by public health authorities. All vaccination records should be mandatorily registered in online database, and this data should be accessible to institutions participating in the sentinel surveillance. Additionally, the implementation of a common data model across participating institutions is also necessary to ensure data standardization. These efforts are expected to enhance both the accuracy and timeliness of safety monitoring.
In conclusion, we propose a multi-hospital-based, retrospective assessment system for pre-defined AESIs as an alternative to active vaccine safety monitoring method. This approach can serve as an effective alternative in South Korea, where a functioning active surveillance system is currently lacking.

Ethics statement

This study was approved by the Institutional Review Board of each participating hospital (approval No. Korea University Guro Hospital, 2022GR0339; Korea University Ansan Hospital, 2022AS0238; Hallym University Kangnam Sacred Heart Hospital, 2022-07-014; Catholic Kwandong University International St. Mary’s Hospital, IS22ENME0051; and Ajou University Hospital, AJOUIRB-OB-2024-170).

Notes

Funding: This study was funded by the Ministry of Food and Drug Safety of South Korea (Grant No. 22183MFDS435).

Disclosure: The authors have no potential conflicts of interest to disclose.

Author Contributions:

  • Conceptualization: Cheong HJ.

  • Data curation: Hyun H, Yoon JG, Choi YJ, Nham E, Choi MJ, Seo YB, Lee J, Choi WS, Heo JY, Noh JY, Song JY, Kim WJ, Cheong HJ.

  • Formal analysis: Hyun H, Yoon JG.

  • Funding acquisition: Cheong HJ.

  • Investigation: Hyun H, Yoon JG, Choi YJ, Nham E, Choi MJ, Seo YB, Lee J, Choi WS, Song JY, Cheong HJ.

  • Methodology: Hyun H, Yoon JG, Choi MJ, Seo YB, Lee J, Choi WS, Song JY, Cheong HJ.

  • Validation: Hyun H, Yoon JG.

  • Writing - original draft: Hyun H.

  • Writing - review & editing: Hyun H, Yoon JG, Choi YJ, Nham E, Choi MJ, Seo YB, Lee J, Heo JY, Choi WS, Noh JY, Song JY, Kim WJ, Cheong HJ.

References

1. Huang J, Du J, Duan R, Zhang X, Tao C, Chen Y. Characterization of the differential adverse event rates by race/ethnicity groups for HPV vaccine by integrating data from different sources. Front Pharmacol. 2018; 9:539. PMID: 29896103.
2. Abu Jabal K, Ben-Amram H, Beiruti K, Batheesh Y, Sussan C, Zarka S, et al. Impact of age, ethnicity, sex and prior infection status on immunogenicity following a single dose of the BNT162b2 mRNA COVID-19 vaccine: real-world evidence from healthcare workers, Israel, December 2020 to January 2021. Euro Surveill. 2021; 26(6):2100096. PMID: 33573712.
3. Lee JK, Choi WS. Immunization policy in Korea. Infect Chemother. 2008; 40(1):14–23.
4. Rosenthal S, Chen R. The reporting sensitivities of two passive surveillance systems for vaccine adverse events. Am J Public Health. 1995; 85(12):1706–1709. PMID: 7503351.
5. Korea Disease Control and Prevention Agency. Integrated disease and health management system. Updated 2024. Accessed December 2, 2024. https://is.kdca.go.kr/ .
6. Kim J, Song M, Ahn S, Kwon SL. Twenty years of progress and the way forward: immunization registry information system in Korea. J Korean Med Sci. 2024; 39(12):e119. PMID: 38565176.
7. Korea Legislation Research Institute. Infectious Disease Control and Prevention Act. Updated 2015. Accessed December 2, 2024. https://elaw.klri.re.kr/eng_mobile/ganadaDetail.do?hseq=37239&type=abc&key=INFECTIOUS-20DISEASE-20CONTROL-20AND-20PREVENTION-20ACT&param=I .
8. Nsubuga P, White ME, Thacker SB, Anderson MA, Blount SB, Broome CV, et al. Chapter 53: Public health surveillance: a tool for targeting and monitoring interventions. Jamison DT, Breman JG, Measham AR, Alleyne G, Claeson M, Evans DB, editors. Disease Control Priorities in Developing Countries. Washington, D.C., USA: The International Bank for Reconstruction and Development;2006.
9. Baggs J, Gee J, Lewis E, Fowler G, Benson P, Lieu T, et al. The Vaccine Safety Datalink: a model for monitoring immunization safety. Pediatrics. 2011; 127(Suppl 1):S45–S53. PMID: 21502240.
10. Centers for Disease Control and Prevention (US). Vaccine Safety Systems. Updated 2024. Accessed December 2, 2024. https://www.cdc.gov/vaccine-safety-systems/vsd .
11. Bettinger JA, Halperin SA, Vaudry W, Law BJ, Scheifele DW. Canadian IMPACT members. The Canadian Immunization Monitoring Program, ACTive (IMPACT): active surveillance for vaccine adverse events and vaccine-preventable diseases. Can Commun Dis Rep. 2014; 40(Suppl 3):41–44. PMID: 29769912.
12. Shimabukuro TT, Nguyen M, Martin D, DeStefano F. Safety monitoring in the Vaccine Adverse Event Reporting System (VAERS). Vaccine. 2015; 33(36):4398–4405. PMID: 26209838.
13. Nham E, Yoon JG, Choi MJ, Seo YB, Lee J, Choi WS, et al. Establishment of safety monitoring system for vaccines not included in the National Immunization Program in Korea. J Korean Med Sci. 2024; 39(5):e45. PMID: 38317446.
14. Kim SN, Choi SY, Yoon BM, Kim JY. Analysis of the status and characteristics of COVID-19 vaccination damage compensation cases: results of deliberation by the Vaccination Damage Compensation Expert Committee. Public Health Wkly Rep. 2021; 14(35):2482–2490.
15. Korea Disease Control and Prevention Agency. Development of active monitoring system on adverse events after vaccination. Updated 2007. Accessed December 2, 2024. https://nih.go.kr/ko/cmmn/file/fileDown.do?menuNo=300023&atchFileId=febbe68626e14f1eb1956f220accda3a&fileSn=118 .
16. World Health Organization. Global vaccine safety blueprint 2.0 (GVSB2.0) 2021–2023. Updated 2022. Accessed December 2, 2024. https://www.who.int/publications/i/item/9789240036963 .
Table 1

The criteria for assessing causality between vaccination and adverse events following immunization

jkms-40-e152-i001
Criteria Definition
1 Definite Clear evidence of vaccination was obtained, the timing of adverse events following vaccination is temporally plausible, causality is recognized more due to vaccination than other reasons, and the event is a known adverse event of the vaccine
2 Probable Clear evidence of vaccination was obtained, the timing of adverse events following vaccination is temporally plausible, and causality is recognized more due to vaccination than other reasons
3 Possible Clear evidence of vaccination was obtained, the timing of adverse events following vaccination is temporally plausible, and the likelihood of the adverse event occurring is equal to or greater due to vaccination than other reasons
4 Unlikely The timing of adverse events following vaccination is temporally plausible. But,
1. Insufficient data on the vaccination and adverse event
2. More likely due to other reasons than vaccination
5 Definitely not related 1. No clear evidence of vaccination
2. No temporal relationship between the timing of the adverse event and vaccination
3. Other clear causes have been identified
Table 2

Characteristics of hospitalized patients diagnosed with AESIs

jkms-40-e152-i002
Variables Total patients (N = 860) Patients without non-NIP vaccinationa (n = 844) Patients with non-NIP vaccination (n = 16)
Demographics
Male 436 (50.7) 427 (50.6) 9 (56.3)
Age, median (IQR) 55 (39–67) 55 (39–67) 49 (31–63)
Pre-existing medical conditions
Diabetes mellitus 146 (17.0) 145 (17.2) 1 (6.3)
Cerebrovascular disease 81 (9.4) 81 (9.6) 0 (0)
Neuromuscular disease 31 (3.6) 31 (3.7) 0 (0)
Chronic heart disease 53 (6.2) 52 (6.2) 1 (6.3)
Chronic respiratory diseases 27 (3.1) 27 (3.2) 0 (0)
Chronic renal disease 24 (2.8) 24 (2.8) 0 (0)
Chronic liver disease 8 (0.9) 8 (0.9) 0 (0)
Solid cancer 45 (5.2) 44 (5.2) 1 (6.3)
Hematologic malignancy 4 (0.5) 4 (0.5) 0 (0)
Autoimmune disease 14 (1.6) 14 (1.7) 0 (0)
HIV infection 1 (0.1) 1 (0.1) 0 (0)
Allergy 45 (5.2) 43 (5.1) 2 (12.5)
Pregnancy 19 (2.2) 16 (1.9) 3 (18.8)
AESIs
Neurologic disorders
Seizure 312 (36.3) 309 (36.6) 3 (18.8)
Radiculopathy 155 (18.0) 150 (17.8) 5 (31.3)
Aseptic meningitis 118 (13.7) 116 (13.7) 2 (12.5)
Guillain-Barré syndrome 45 (5.2) 45 (5.3) 0 (0)
Transverse myelitis 38 (4.4) 38 (4.5) 0 (0)
Encephalitis 38 (4.4) 38 (4.5) 0 (0)
Bell's palsy 34 (4.0) 33 (3.9) 1 (6.3)
ADEM 9 (1.0) 9 (1.1) 0 (0)
Ataxia/Cerebritis 8 (0.9) 7 (0.8) 1 (6.3)
Autoimmune disorders
Rheumatoid arthritis 16 (1.9) 16 (1.9) 0 (0)
Systemic lupus erythematous 10 (1.2) 10 (1.2) 0 (0)
Aseptic arthritis 5 (0.6) 4 (0.5) 1 (6.3)
Type 1 diabetes mellitus 1 (0.1) 1 (0.1) 0 (0)
Cardiologic disorders
Myocarditis 12 (1.4) 12 (1.4) 0 (0)
Pericarditis 12 (1.4) 12 (1.4) 0 (0)
Obstetric disorders
Spontaneous abortion 19 (2.2) 19 (2.3) 0 (0)
Stillbirth 4 (0.5) 3 (0.4) 1 (6.3)
Preeclampsia 1 (0.1) 0 (0) 1 (6.3)
Hematologic disorders
Immune thrombocytopenia 14 (1.6) 13 (1.5) 1 (6.3)
Henoch-Schönlein purpura 1 (0.1) 1 (0.1) 0 (0)
Allergic disorders
Anaphylaxis 8 (0.9) 8 (0.9) 0 (0)
Outcomes
Days of hospitalization, median (IQR) 5.0 (3.0–9.0) 5.0 (3.0–9.0) 4.5 (3.0–7.8)
Admission to intensive care unit 101 (11.7) 100 (11.8) 1 (6.3)
In-hospital mortality 3 (0.3) 3 (0.4) 0 (0)
Values are presented as number (%).
AESIs = adverse events of special interest, NIP = National Immunization Program, IQR = interquartile range, HIV = human immunodeficiency virus, ADEM = acute disseminated encephalomyelitis.
aNon-NIP vaccines include pneumococcal conjugated vaccines, tetanus-diphtheria-pertussis vaccine, live attenuated zoster vaccines, and a recombinant zoster vaccine.
Table 3

Characteristics of hospitalized patient diagnosed with AESIs after vaccination of non-NIP vaccines and causality assessment

jkms-40-e152-i003
No. Age, yr Sex Pre-existing medical conditions Non-NIP vaccines AESIs Days between vaccination and diagnosis of AESI Causalitya
1 42 Female Pregnancy Tdap Preeclampsia 4 3
2 37 Female Pregnancy Tdap Stillbirth 42 5-2
3 69 Male Chronic heart disease Live attenuated zoster vaccine Seizure 61 5
4 30 Female Tdap Aseptic meningitis 10 4-2
5 56 Male Recombinant zoster vaccine ITP 39 4-1
6 33 Female Tdap Seizure 70 5-3
7 20 Male Tdap Ataxia/Cerebritis 7 4-1
8 34 Female Pregnancy Tdap Aseptic meningitis 1 5-3
9 27 Female Tdap Bell’s palsy 53 4-2
10 29 Male Tdap Seizure 47 5
11 65 Male PCV13 Radiculopathy 91 5
12 61 Male Diabetes Live attenuated zoster vaccine Radiculopathy 16 5
13 55 Female Live attenuated zoster vaccine Radiculopathy 4 5
14 64 Male PCV13 Radiculopathy 67 5
15 67 Male Recombinant zoster vaccine Radiculopathy 14 4-2
16 55 Male Solid cancer PCV13 Aseptic arthritis 11 4-1
AESIs = adverse events of special interest, NIP = National Immunization Program, Tdap = tetanus-diphtheria-pertussis, ITP = immune thrombocytopenic purpura, PCV13 = 13-valent pneumococcal conjugate vaccine.
aCausality was classified as follows: 1, definitely related; 2, probably related; 3, possibly related; 4, probably not related (specifically, 4-1, insufficient data on the vaccination and adverse event; 4-2, more likely due to other reasons than vaccination); 5, definitely not related (specifically, 5-1, no clear evidence of vaccination; 5-2, no temporal relationship between the timing of the adverse event and vaccination; 5-3, Other clear causes have been identified).
TOOLS
Similar articles