Abstract
Background
The lack of well-established operational definitions is a major limitation of Helicobacter pylori eradication studies that use secondary databases. We aimed to develop and validate operational definitions related to H. pylori eradication therapy.
Methods
Operational definitions were developed by analyzing a nationwide H. pylori eradication registry and validated using real-world data from hospital medical records. The primary endpoint was the sensitivity of the operational definitions in identifying individuals who received H. pylori eradication therapy. The secondary endpoint was the sensitivity and specificity of the operational definition in identifying successful H. pylori eradication therapy.
Results
H. pylori eradication therapy was defined as a prescription for one of the following combinations: 1) proton pump inhibitor (PPI) + amoxicillin + clarithromycin, 2) PPI + amoxicillin + metronidazole, 3) PPI + metronidazole + tetracycline, 4) PPI + amoxicillin + levofloxacin, 5) PPI + amoxicillin + moxifloxacin, or 6) PPI + amoxicillin + rifabutin. In the validation set, the sensitivity of the operational definition for identifying individuals who received H. pylori eradication therapy was 99.7% and 99.8% for the first- and second-line therapies, respectively. Operational definition to determine success or failure of the H. pylori eradication therapy was developed based on a confirmatory test and the prescription of rescue therapy. The sensitivity and specificity of the operational definition for predicting successful eradication were 97.6% and 91.4%, respectively, in first-line therapy and 98.6% and 54.8%, respectively, in second-line therapy.
Graphical Abstract
Approximately 50% of the global population is infected with Helicobacter pylori,1 which causes various gastrointestinal diseases including peptic ulcer disease and gastric cancer.23 Recently, H. pylori infection has been associated with several diseases, including hematologic, cardiovascular, and neurological diseases, in addition to gastrointestinal diseases.45 To determine the impact of H. pylori eradication therapy on these diseases, population-based studies utilizing large-scale, nationwide, secondary databases have been performed.678 The National Health Information Database of the Korean National Health Insurance Service (NHIS), which is a mandatory health insurance system that covers the entire Korean population, is one such database.9 It has an extensive dataset of 1.3 trillion records, which includes sociodemographic status, diagnoses, operations, and prescriptions.6910 It also includes follow-up data, spanning approximately 20 years.611 Studies utilizing secondary databases may help clinicians better understand the clinical characteristics and treatment outcomes of rare diseases (e.g., metachronous lesions after gastric cancer treatment). Furthermore, they may help analyze diseases requiring long-term follow-up (e.g., the risk of gastric cancer in the general population). However, these studies may be limited by the lack of well-established operational definitions. In most studies, H. pylori eradication was defined arbitrarily without validation.678 Moreover, the success or failure of H. pylori eradication therapy could not be determined because such results were unavailable in the secondary databases.678 Because post-eradication persistence of H. pylori infection is an important confounding variable in H. pylori-related diseases, it is difficult to draw conclusions without knowing the outcome of the eradication therapy. Therefore, a definitive conclusion could not be reached by exploring the secondary databases alone.
To facilitate the use of secondary databases in studies and help reach a more definitive conclusion, we developed an operational definition of H. pylori eradication therapy. We also developed and validated operational definitions for predicting successful or failed treatment based on the prescriptions of eradication confirmatory tests and rescue therapy. These operational definitions will help researchers better analyze and interpret data from secondary databases.
Two databases of patients who underwent H. pylori eradication therapy were used in this study. One was a nationwide registry (development set), which prospectively enrolled patients who received H. pylori eradication therapy between 2010 and 2015 at 34 hospitals in South Korea.12 The other database was a real-world dataset (validation set) of patients who received H. pylori eradication therapy between 2018 and 2019 from four university-affiliated hospitals in South Korea (Chung-Ang University Hospital, Incheon St. Mary’s Hospital, Kangbuk Samsung Hospital, and Hanyang University Guri Hospital). The H. pylori eradication regimen (i.e., active ingredients of medications) and type and results of the confirmatory test for H. pylori eradication were reviewed.
The operational definition of H. pylori eradication therapy was developed based on the major regimens used in the nationwide registry and the current guidelines in Korea.13 The intervals between the first- and second-line therapies and the second- and third-line therapies were evaluated to identify duplicate prescriptions or early changes in medications for any reason (loss of medications or adverse events). The interval between the prescription of eradication therapy and confirmatory test was also analyzed to ensure the validity of the confirmatory tests. The operational definition of success (or failure) of the eradication therapy was developed based on the presence of a confirmatory test or rescue therapy, the interval between eradication therapy and the confirmatory test, and that between the confirmatory test and rescue therapy initiation.
The primary endpoint was the sensitivity of the operational definition in identifying individuals who received H. pylori eradication therapy. The secondary endpoint was the sensitivity and specificity of the operational definition of a successful eradication therapy.
Descriptive statistics, including the number of participants and their proportions, were used to present the results. All statistical analyses were conducted using R (version 4.0.4; R Foundation for Statistical Computing, Vienna, Austria).
This study was approved by the Institutional Review Board of study institutes and the requirement for informed consent was waived (Chung-Ang University Hospital, IRB No. 2110-014-19388; Incheon St. Mary's Hospital, IRB No. OC21RIDI0106; Kangbuk Samsung Hospital, IRB No. KBSMC 2021-09-026; Hanyang University Guri Hospital, IRB No. GURI 2021-09-009).
We obtained and reviewed data of 6,740 and 1,572 patients, who received H. pylori eradication therapy, from the nationwide registry (development set) and real-world hospital medical records (validation set), respectively. The major H. pylori eradication regimens utilized included conventional, metronidazole-based, levofloxacin-based, or rifabutin-based triple therapy and bismuth-based or non-bismuth (sequential or concomitant) quadruple therapy (Table 1). Based on this, H. pylori eradication therapy was defined as a prescription for one of the following combinations: 1) proton pump inhibitor (PPI) + amoxicillin + clarithromycin; 2) PPI + amoxicillin + metronidazole; 3) PPI + metronidazole + tetracycline; 4) PPI + amoxicillin + levofloxacin; 5) PPI + amoxicillin + moxifloxacin; and 6) PPI + amoxicillin + rifabutin (Table 2). All the major regimens were screened for these combinations. Using the operational definition of H. pylori eradication therapy, 98.6% and 99.7% of the patients who received first-line H. pylori eradication therapy were identified in the development and validation sets, respectively (Table 3). Additionally, 92.4% and 99.8% of the patients who received second-line H. pylori eradication therapy were identified in the development and validation sets, respectively.
PPI = proton pump inhibitor.
aMedication combinations for H. pylori eradication therapy: 1) PPI + amoxicillin + clarithromycin, 2) PPI + amoxicillin + metronidazole, 3) PPI + metronidazole + tetracycline, 4) PPI + amoxicillin + levofloxacin, 5) PPI + amoxicillin + moxifloxacin, 6) PPI + amoxicillin + rifabutin.
bType of confirmatory test: 1) Urea breath test, 2) Rapid urease test, 3) Giemsa stain, 4) Polymerase chain reaction for H. pylori, 5) Upper gastrointestinal endoscopy + pathological examination.
The durations of the first-, second-, and third-line eradication therapies are shown in Supplementary Fig. 1. H. pylori eradication therapies were typically administered for 7–14 days. Fig. 1 shows the treatment intervals between the H. pylori eradication therapies, which was ≥ 28 days in > 99% of patients. Only a few patients had a treatment interval of < 28 days, where the initial treatment was stopped early owing to adverse events; thereafter, rescue therapy was administered. The confirmatory test was employed in 98.6% and 87.0% of the patients in the development and validation sets, respectively (Supplementary Table 1). In most patients, a confirmatory test was performed 21 days to six months after the initiation of H. pylori eradication therapy (Fig. 2). Based on these findings, we defined confirmatory tests as the prescription of the confirmatory tests during the following periods: 1) between 21 days from the initiation of the eradication therapy and the date of rescue therapy, and 2) between 21 days to six months from the initiation of eradication therapy (both criteria should be met) (Table 2).
Subsequently, we tested and validated the diagnostic performance of the operational definition in determining the success or failure of H. pylori eradication therapy (Table 4). In the development set, the sensitivity and specificity of the operational definition for predicting successful eradication were 95.3% and 72.1%, respectively, for first-line therapy and 95.4% and 33.6%, respectively, for second-line therapy. In the validation set, the sensitivity and specificity were 97.6% and 91.4%, respectively, for first-line therapy and 98.6% and 54.8%, respectively, for second-line therapy.
Additionally, the criteria for H. pylori reinfection was set as the success of the initial eradication therapy followed by the administration of additional therapy one year after the initial confirmatory test (Table 2). However, the operational definition of reinfection could not be validated in this study because no participant with reinfection of H. pylori was identified in the validation set.
We evaluated the H. pylori eradication regimen, sensitivity of the operational definition for identifying individuals who received eradication therapy, and performance of the operational definition in determining the success or failure of eradication therapy according to the hospital in the validation set (Supplementary Tables 2, 3, 4). Although the sample size of each hospital was small, the major results were similar to the overall results in the validation set.
This is the first study to assess the operational definition of H. pylori eradication therapy. We developed an operational definition based on the major regimens utilized in the prospective nationwide registry established in 2010–2015. Minor regimens, including dual therapy (e.g., PPI + amoxicillin, PPI + clarithromycin, or PPI + metronidazole) and quinolone-containing clarithromycin-based therapy (e.g., PPI + levofloxacin + clarithromycin or PPI + moxifloxacin + clarithromycin), were excluded from the operational definition. Dual therapy is not popular in Korea because of its low eradication rate.1415 Quinolone-based therapies are not favored, except for third-line treatment (e.g., PPI + amoxicillin + quinolone), because it is also used to treat tuberculosis in Korea, which is highly prevalent. Although some regimens were not included in the operational definition, its sensitivity to detect H. pylori eradication therapy was high, even in the validation set. This finding suggests that most regimens used in real-world settings can be predicted. The high sensitivity may be attributed to the dissemination of common guidelines and the fact that antibiotics not covered by the NHIS were infrequently prescribed in the real world. All regimens recommended in the Korean guidelines, including triple, sequential, concomitant, and bismuth-based quadruple therapies, were included in the operational definition.13
In the present study, second- or third-line therapies was defined as the prescription of one of the H. pylori eradication regimens 28 days after the previous eradication therapy. The time interval of 28 days was selected to exclude duplicate prescriptions for lost medications or early changes in the eradication regimen. In our analysis, approximately 99% of the participants received rescue therapy 28 days after their initial therapy. Given that the performance of confirmatory tests for H. pylori eradication and issuance of rescue therapy prescriptions typically occur at least 3–4 weeks after treatment, the operational definition was clinically relevant and reliable.
We also set the time interval between eradication therapy and the confirmatory test as 21 days to six months, because most participants obtained a confirmatory test during this time period. Although very few participants were subjected to confirmatory tests six months after the treatment, an interval of more than six months was not considered valid as the minimum follow-up duration was six months. The time interval was limited to six months because it may be difficult to distinguish between treatment failure and reinfection if tests are conducted after a long time.
Finally, we developed an operational definition to determine success or failure of the H. pylori eradication therapy based on a confirmatory test and the prescription of rescue therapy. In the validation set, the sensitivity and specificity for determining successful H. pylori eradication with first-line treatment were sufficiently high. Thus, the results of the first-line H. pylori eradication therapy could be determined without knowing the exact results of the confirmatory test in the secondary databases. However, the specificity for determining successful H. pylori eradication therapy after second-line treatment was relatively low. This is because administration of third-line therapy is uncommon in the real-world setting. The operational definition may mistakenly classify individuals in whom second-line therapy failed and who were not administered third-line therapy as having received successful second-line therapy. Therefore, caution should be exercised when interpreting the results of the second-line therapy.
Although our study is the first to develop and validate an operational definition of H. pylori eradication therapy, it has several limitations. First, the operational definition was developed in Korea considering the local clinical settings and preferences, including the major eradication regimens. If the operational definition is applied to other countries or regions, the preferred H. pylori eradication regimens of that country/region should be considered. Second, the institutions included in the development and validation sets overlapped, indicating that the development and validation sets may depend on each other. However, the institutions included in the validation set accounted for only a small proportion of the nationwide registry, and the study periods for the development and validation sets were distinctly separated. Moreover, the impact of the bias caused by interdependency between the development and validation sets may have been minimal. Third, the operational definition of H. pylori reinfection was not validated because of the lack of participants with reinfection in the validation set. Fourth, we did not include potassium-competitive acid blockers (P-CABs) in our operational definitions. Although tegoprazan, a P-CAB, has been approved for H. pylori eradication therapy in Korea in 2021, our study included only patients who received H. pylori eradication therapy in 2019 or before. We plan to extend our operational definitions to include patients who received P-CAB-based H. pylori eradication therapy. Although the operational definition for reinfection seems to be clinically relevant, long-term follow-up data are required to validate them. Fifth, unknown treatment results could not be ignored in the validation set, as some patients could have been lost to follow-up or may not have undergone confirmatory tests in real-world practice. Operational definitions do not provide information on the success of eradication therapy in such patients. Finally, the practical use of operational definitions in secondary databases, such as the NHIS claim database, was not tested. We plan to apply the operational definition to perform various subsequent clinical studies. A modified version of the operational definition may be derived for subsequent studies.
Despite these limitations, our study provides valid and applicable operational definitions that can be used for H. pylori-related studies utilizing a secondary database. Using prescriptions of major H. pylori eradication regimens, we developed an operational definition for identifying individuals who received H. pylori eradication therapy. Additionally, the operational definition of a successful or failed eradication therapy was based on the presence of a confirmatory test and rescue therapy prescription. Our operational definitions may be useful for various studies that utilize secondary databases.
Notes
Author Contributions:
Conceptualization: Lee J, Kim JG.
Data curation: Park CH, Yang HJ, Kim JS, Kim BJ, Choi SI, Seo SI.
Formal analysis: Park CH, Jung SY, Lee JW, Lee J.
Investigation: Park CH, Jung SY.
Methodology: Park CH, Jung SY, Lee JW, Lee J.
Project administration: Kim JG.
Supervision: Kim JG.
Validation: Park CH, Jung SY, Lee JW.
Visualization: Park CH.
Writing - original draft: Park CH, Jung SY.
Writing - review & editing: Park CH, Jung SY, Lee JW, Yang HJ, Kim JS, Kim BJ, Choi SI, Seo SI, Lee J, Kim JG.
References
1. Hunt RH, Xiao SD, Megraud F, Leon-Barua R, Bazzoli F, van der Merwe S, et al.
Helicobacter pylori in developing countries. World Gastroenterology Organisation Global Guideline. J Gastrointestin Liver Dis. 2011; 20(3):299–304. PMID: 21961099.
2. McColl KEL. Clinical practice. Helicobacter pylori infection. N Engl J Med. 2010; 362(17):1597–1604. PMID: 20427808.
3. de Martel C, Ferlay J, Franceschi S, Vignat J, Bray F, Forman D, et al. Global burden of cancers attributable to infections in 2008: a review and synthetic analysis. Lancet Oncol. 2012; 13(6):607–615. PMID: 22575588.
4. He J, Liu Y, Ouyang Q, Li R, Li J, Chen W, et al.
Helicobacter pylori and unignorable extragastric diseases: mechanism and implications. Front Microbiol. 2022; 13:972777. PMID: 35992650.
5. Gravina AG, Priadko K, Ciamarra P, Granata L, Facchiano A, Miranda A, et al. Extra-gastric manifestations of Helicobacter pylori infection. J Clin Med. 2020; 9(12):3887. PMID: 33265933.
6. Kim HJ, Kim YJ, Seo SI, Shin WG, Park CH. Impact of the timing of Helicobacter pylori eradication on the risk of development of metachronous lesions after treatment of early gastric cancer: a population-based cohort study. Gastrointest Endosc. 2020; 92(3):613–622.e1. PMID: 32473251.
7. Kim YI, Kim YA, Kim HJ, Kim SH, Hwangbo Y, Kim JG, et al. Effect of Helicobacter pylori treatment on the long-term mortality in patients with type 2 diabetes. Korean J Intern Med. 2021; 36(3):584–595. PMID: 33232592.
8. Leung WK, Wong IOL, Cheung KS, Yeung KF, Chan EW, Wong AY, et al. Effects of Helicobacter pylori treatment on incidence of gastric cancer in older individuals. Gastroenterology. 2018; 155(1):67–75. PMID: 29550592.
9. Song SO, Jung CH, Song YD, Park CY, Kwon HS, Cha BS, et al. Background and data configuration process of a nationwide population-based study using the Korean national health insurance system. Diabetes Metab J. 2014; 38(5):395–403. PMID: 25349827.
10. Lee YH, Han K, Ko SH, Ko KS, Lee KU. Taskforce Team of Diabetes Fact Sheet of the Korean Diabetes Association. Data analytic process of a nationwide population-based study using national health information database established by National Health Insurance Service. Diabetes Metab J. 2016; 40(1):79–82. PMID: 26912157.
11. Jang S, Ah YM, Jang S, Kim Y, Lee JY, Kim JH. Potentially inappropriate medication use and associated factors in residents of long-term care facilities: a nationwide cohort study. Front Pharmacol. 2023; 13:1092533. PMID: 36703731.
12. Kim BJ, Yang CH, Song HJ, Jeon SW, Kim GH, Kim HS, et al. Online registry for nationwide database of Helicobacter pylori eradication in Korea: correlation of antibiotic use density with eradication success. Helicobacter. 2019; 24(5):e12646. PMID: 31368629.
13. Jung HK, Kang SJ, Lee YC, Yang HJ, Park SY, Shin CM, et al. Evidence-based guidelines for the treatment of Helicobacter pylori infection in Korea 2020. Gut Liver. 2021; 15(2):168–195. PMID: 33468712.
14. Hahm KB, Lee KJ, Kim YS, Kim JH, Cho SW, Yim H, et al. Augmented eradication rates of Helicobacter pylori by new combination therapy with lansoprazole, amoxicillin, and rebamipide. Dig Dis Sci. 1998; 43(2):235–240. PMID: 9512112.