Abstract
Since the establishment of the academic society in 1972, Korean allergists have made continuous efforts to elucidate pathogenic mechanisms and therapeutic advances for allergic diseases. The present study aimed to summarize recent progress and explore future prospects of research performance by Korean allergists. We performed a comprehensive bibliometric analysis for research papers published in the Science Citation Index (SCI) or SCI-expanded journals by Korean allergists between 2009 and 2013. Research performance was quantitatively analyzed for the numbers of papers by publication year, research type, and main topic. In addition, the performance was also examined for qualitative indices, such as impact factor and citation number. A total of 1,091 papers were identified. The number of publication increased continuously, with an annual increase rate of 12.3%. Clinical and basic studies were the most frequent types of research, and recently the number of epidemiological studies has increased. By research topic, asthma was the most commonly studied, accounting for 20.9% of the total number of publications. Notably, the amount of rhinitis/rhinosinusitis research has risen steeply in 2013. Qualitative analyses also indicated continuous progress; the median impact factor of published journals increased from 1.918 in 2009 to 2.746 in 2013, yielding an annual increase rate of 7.4%. In conclusion, the present analyses identified a continuous increase in the research performance of Korean allergists over a recent 5 year period (2009-2013), both quantitatively and qualitatively. A more significant contribution is expected in the forthcoming era.
Allergic diseases are of significant concern and responsible for considerable morbidity and mortality. The rapid increase in the prevalence of allergies in modern times has yielded many insightful hypotheses123456 and recent clinical advances.7810 However, allergy epidemics persist,11 and the burden extends into older adult populations.1213 Nevertheless, the pathophysiology of allergies still needs elucidation.141516
Korean allergists have made efforts to elucidate the pathophysiology of allergic diseases since 1972. The establishment of the academic society, the Korean Academy of Asthma, Allergy, and Clinical Immunology (KAAACI), was the start of allergological research in Korea. In 1981, the official journal of the KAAACI was launched to promote academic communication between domestic researchers. Since then, Korean allergists have also yielded international scientific products, with the start of the first allergological research papers published in the Science Citation Index (SCI) journal in 1985 by Kim and his colleagues.17
The growth of previous research performance by Korean allergists was briefly reviewed in 200918; the review showed a dramatic increase in publications during the recent decades (1990-2008). However, the review employed Pubmed with simple search terms (keywords, such as 'allergy OR asthma OR hypersensitivity' AND affiliation 'Korea'), and thus had limited information.
The bibliometric analysis is a useful tool to look back on recent progress and also to look forward to future directions. We present here a comprehensive bibliometric analysis for research papers by the KAAACI members over a recent 5 year period (2009-2013).
We performed a semi-systematic literature search in the Pubmed database to identify research papers written by the members of the KAAACI. The initial search terms were '(allergy OR hypersensitivity OR atopy OR asthma OR rhinitis [All Fields]) AND Korea [Affiliation]' for articles published in peer-reviewed journals between January 2009 and December 2013. Additional articles were manually retrieved by e-mail feedback with all the members. Inclusion criteria were as follows: (1) research papers published in the SCI or SCI-Expanded (SCI-E) journals, and (2) having main authors (the first or corresponding authors) who are the members of the KAAACI.
Individual studies were classified by at least 2 authors, according to their research type or main topic. The qualified literature was classified as clinical, basic, epidemiological, and secondary research according to the classification of medical research.19 By the primary intention of each study, clinical research included both interventional studies (performed on humans with the aim of investigating the efficacy or safety of intervention) and patient-related observational studies in which patients were given a specific therapy. Basic research included animal experiments, in vitro cell experiments, and investigations in biochemical or physiological aspects. Epidemiological research was defined so as to investigate the distribution and historical changes in the frequency of diseases and the causes in the general or specific population. Genetic research included any human investigation of genetic associations in clinical or epidemiological aspects. This classification generally followed previously suggested systems,19 except for genetic studies; we separately classified genetic studies from clinical or epidemiological studies as we wanted to examine this specific type. Clinical research was further classified as a randomized controlled trial (RCT), a case-control study, or a patient group study. Reviews were classified as a systematic review/meta-analysis or a narrative review.
The classification by the primary topic included asthma, rhinitis/rhinosinusitis, allergen/atopy, aspirin hypersensitivity, atopic dermatitis, anaphylaxis, cough, drug allergy, food allergy, immunotherapy, insect allergy, occupational allergy, urticaria/angioedema, basic immunology, and other respiratory diseases. We expected that it could be difficult to classify individual studies into a single category and resolved any disagreement through discussion between co-authors.
The 1 and 5-year impact factors (IF) of journals were retrieved from the Journal Citation Report (JCR) 2013 database (http://isiknowledge.com). The top 5 influential journals within the subject category were determined by the 5-year IF in the JCR 2013 database but only selected in this analysis if they published the relevant, original articles. The number of citations for each article was manually gathered from Google Scholar (access date 2014/Nov/7).
The primary quantitative outcome was the number of publications. The outcome was further analyzed by publication year and also classified by research type, topic, or published journal. Qualitative analyses were performed to examine the proportion of publications in top journals, annual trends in IF outcomes, or the number of citations. For descriptive statistics, categorical variables were presented as numbers and percentages. Variables, such as IF or citation number, which did not show a normal distribution, were presented as medians and at 90% confidence intervals (90% CI; the 5th to the 95th percentile). All statistical tests were performed using the Stata software package (release 12.0; Stata Corp., TX, USA). All statistical tests were 2-sided, and P values of <0.05 were considered statistically significant.
A total of 1,908 papers were initially retrieved from the search strategy, and 1,091 papers were finally determined to meet the inclusion criteria. The total number of published journals was 210. The number of published papers increased year by year from 2009 to 2013, with an annual increase rate of 12.3% (Fig. 1).
Clinical research was the most frequent type of research over the 5 year period (33.1%, Table 1). Annual publication trend analyses also showed a consistent preponderance of clinical research during the period (Fig. 2). Basic research was the second most frequent type (27.2%), yielding a marked increase between 2011 and 2013. Epidemiological research has also increased continuously and has become more selected than genetic research in 2013. However, the proportions of RCTs and systematic reviews were low (4.7% in clinical research and 1.6% in reviews, respectively).
When classified by research topic, the most common topics were asthma, basic immunology, rhinitis/rhinosinusitis, and drug allergies (Table 2). Asthma was the leading topic for recent 5 years (Fig. 3). The 2 major research types regarding asthma were clinical (75/228) and basic research (66/228). However, the number of rhinitis/rhinosinusitis publications has shown a marked increase since 2012; basic research was the most selected type on this topic (47/109), and clinical research was the second most selected type (42/109). Regarding drug allergies, case studies were the most frequent type (34/80), but other research types were also frequent (clinical research [17/80], genetic research [15/80], and epidemiological research [13/80]). Aspirin hypersensitivity, atopic dermatitis, allergen/atopy, and food allergies were also frequent topics (Table 2), and experienced quantitative increases during the 5 year period (data not shown).
The 5 most popular journals were 'Allergy Asthma and Immunology Research,' 'Annals of Allergy Asthma and Immunology,' 'Journal of Korean Medical Science,' 'American Journal of Rhinology and Allergy,' and 'Allergy' (Table 3). 'Allergy Asthma and Immunology Research' was the most commonly popular journal across all the research types (15.8%).
Qualitative aspects of the publications were examined with regard to IF and citation number. IFs were identified in 1,087 papers, as 2 journals were just recently indexed as SCI-E journals and did not officially announce their IFs. Overall, annual IFs continued to increase from 1.918 (90% CI 0.632-6.380) in 2009 to 2.746 (90% CI 0.954-5.995) in 2013 (Table 4). An annual increase rate in IF was 7.4%.
Among the original articles, 114 (10.4%) were published in the 5 most influential journals in the specialty field of allergies (Table 5). However, in the field of respiratory medicine, 23 papers (2.1%) were published in the 5 most influential journals.
The total number of citations was 10,431. The median number of citations was 6 (90% CI 0-33), and the mean value was 10. A distributional dot plot for the numbers of publications and corresponding citations is presented in Fig. 4. The highest number of citations was 95, in the review article titled 'Impact of oxidative stress on lung diseases' by Park et al.20 published in the 'Respirology' journal in 2009.
This is the first bibliometric analysis for research trends and performance of Korean allergists. In recent 5 years, research performance continuously increased both in quantitative and qualitative aspects.
Quantitatively, the annual increase in publication number was 12.3% between 2009 and 2013. Increasing trends were clearly observed in various research types, including clinical, basic, and epidemiological studies, which indicated a recent expansion of the research base for allergists in Korea.
A quantitative increase was observed under various topics. In particular, asthma remained the most frequently studied topic over the 5 year period. These findings may be related to the historical background for the society foundation in 1972 and indicate the inborn interest of the KAAACI for asthma.18 Another notable finding was the marked increase in upper airway disease research performed very recently; this finding may indicate the traditional significance of upper and lower airway relationships, named as the 'united airway disease' concept21 but also suggests increasing global interest in rhinosinusitis.22 Drug allergies have been another topic of particular interest for allergists, posing significant clinical and public health problems.2324 The present analyses also found that multiple approaches are being made for drug allergy, including clinical, genetic, and epidemiological studies.
Progress was also consistently observed in the quality of research. The median IF of the publications increased from 1.918 in 2009 to 2.746 in 2013, showing an annual increase rate of 7.4%. It needs to be mentioned that the IF is just an index for evaluating journals but not individual articles or researchers.25 Also, our increasing trends in IF could have been due to the increase in IF of published journals. However, this continual increase in IF indicates that the research performance of the KAAACI members has matured in order to better compete in influential journals. Citation analyses showed that the papers were being cited frequently, with a median of 6 ditations and a mean of 10 citations. The upper 5% of the papers had a citation frequency exceeding 30 times.
In this progress, the roles of the 'Allergy Asthma and Immunology Research' journal may have been essential. Since its launch in 2009,26 it has been rapidly listed in the SCI-E 2011,27 and expanded to a bimonthly publication from a quarterly one in January 2012.28 Moreover, IF continuously increased from 1.91 in 2011 to 3.084 in 2013.29 The present analyses identified the journal as the most cited one (15.8%). Thus, one may question if the recent progress shown in this analysis was largely dependent on the specific journal. However, here we found that the annual increase rate in publication number and median IF were 7.9% and 2.3% respectively, even excluding the journal (specific data not shown), suggesting that the recent progress was not solely dependent on this.
Despite the recent progress, several shortcomings were identified. First, RCT and systematic review/meta-analysis were not frequent (4.7% and 1.6%, respectively), which are traditionally regarded as a high index of publication quality30 and could potentially contribute to evidence-based medicine. Second, the proportion of papers published in the most influential journals was still low. Further efforts need to be made to promote opportunities of education and scientific discussion.
The present analyses have several limitations. First, we only analyzed the papers published in SCE or SCI-E journals, and thus could not fully assess the entire research performance of the KAAACI members. Depending on the study purpose, high quality studies may be published in domestic journals. Moreover, papers published in the journals with a high IF do not always have a higher impact on clinical practice or further research. Second, we utilized a single database source (Google Scholar) to identify the citation index of individual papers. Google Scholar usually retrieves more citations in cases of recent articles than the Web of Science does,31 because it is not restricted to journal articles but widely embraces other types of publications like technical reports, theses, dissertations, or conference proceedings. Conversely, the search strategy of Google Scholar might overestimate citation indices over that of Web of Science or Scopus. Indeed, these 3 sources usually have complementary roles for each other in citation analyses.32 However, citation analysis was not the primary intention of our study, and thus was performed rather in a simplified way. In addition, our citation analyses may have limited values because the citation indices for recent papers are underestimated.
In conclusion, the present analyses identified the progress in the research performance of the KAAACI members during the recent 5 year period, both quantitatively and qualitatively. We hope that the present findings will be a motivation to look back and forward to research directions. We also expect more significant contributions of Korean allergists to clinical practice and basic research in the forthcoming era.
Figures and Tables
Table 1
Research type (total n=1,091) | n (%) |
---|---|
Clinical research | 361 (33.1) |
Basic research | 297 (27.2) |
Genetic research | 138 (12.6) |
Epidemiological research | 97 (8.9) |
Review | 62 (5.7) |
Case study | 136 (12.5) |
Table 2
Table 3
Table 4
Table 5
ACKNOWLEDGMENTS
This work was supported by the Korean Academy of Asthma, Allergy and Clinical Immunology (KAAACI).
References
1. Strachan DP. Hay fever, hygiene, and household size. BMJ. 1989; 299:1259–1260.
2. Haahtela T, Holgate S, Pawankar R, Akdis CA, Benjaponpitak S, Caraballo L, et al. The biodiversity hypothesis and allergic disease: world allergy organization position statement. World Allergy Organ J. 2013; 6:3.
3. Kim YM, Kim YS, Jeon SG, Kim YK. Immunopathogenesis of allergic asthma: more than the th2 hypothesis. Allergy Asthma Immunol Res. 2013; 5:189–196.
4. Park SM, Park JS, Park HS, Park CS. Unraveling the genetic basis of aspirin hypersensitivity in asthma beyond arachidonate pathways. Allergy Asthma Immunol Res. 2013; 5:258–276.
5. Holgate ST. Mechanisms of asthma and implications for its prevention and treatment: a personal journey. Allergy Asthma Immunol Res. 2013; 5:343–347.
6. Kim BJ, Lee SY, Kim HB, Lee E, Hong SJ. Environmental changes, microbiota, and allergic diseases. Allergy Asthma Immunol Res. 2014; 6:389–400.
7. Khoriaty E, Umetsu DT. Oral immunotherapy for food allergy: towards a new horizon. Allergy Asthma Immunol Res. 2013; 5:3–15.
8. Ahn K. The usefulness of component-resolved diagnostics in food allergy. Allergy Asthma Immunol Res. 2014; 6:103–104.
9. Olin JT, Wechsler ME. Asthma: pathogenesis and novel drugs for treatment. BMJ. 2014; 349:g5517.
10. Hsu Blatman KS, Castells MC. Desensitizations for chemotherapy and monoclonal antibodies: indications and outcomes. Curr Allergy Asthma Rep. 2014; 14:453.
11. Wong GW, Leung TF, Ko FW. Changing prevalence of allergic diseases in the Asia-pacific region. Allergy Asthma Immunol Res. 2013; 5:251–257.
12. Yáñez A, Cho SH, Soriano JB, Rosenwasser LJ, Rodrigo GJ, Rabe KF, et al. Asthma in the elderly: what we know and what we have yet to know. World Allergy Organ J. 2014; 7:8.
13. Song WJ, Kang MG, Chang YS, Cho SH. Epidemiology of adult asthma in Asia: toward a better understanding. Asia Pac Allergy. 2014; 4:75–85.
14. Leung DY, Guttman-Yassky E. Deciphering the complexities of atopic dermatitis: shifting paradigms in treatment approaches. J Allergy Clin Immunol. 2014; 134:769–779.
15. Wenzel SE. Asthma phenotypes: the evolution from clinical to molecular approaches. Nat Med. 2012; 18:716–725.
16. Akdis CA, Bachert C, Cingi C, Dykewicz MS, Hellings PW, Naclerio RM, et al. Endotypes and phenotypes of chronic rhinosinusitis: a PRACTALL document of the European Academy of Allergy and Clinical Immunology and the American Academy of Allergy, Asthma & Immunology. J Allergy Clin Immunol. 2013; 131:1479–1490.
17. Kim YY, Holgate ST, Church MK. Inhibition of histamine release from dispersed human lung and tonsillar mast cells by nicardipine and nifedipine. Br J Clin Pharmacol. 1985; 19:631–638.
18. Kim YY. Past, present, and future of allergy in Korea. Allergy Asthma Immunol Res. 2010; 2:155–164.
19. Röhrig B, du Prel JB, Wachtlin D, Blettner M. Types of study in medical research: part 3 of a series on evaluation of scientific publications. Dtsch Arztebl Int. 2009; 106:262–268.
20. Park HS, Kim SR, Lee YC. Impact of oxidative stress on lung diseases. Respirology. 2009; 14:27–38.
21. Ciprandi G, Caimmi D, Miraglia Del Giudice M, La Rosa M, Salpietro C, Marseglia GL. Recent developments in united airways disease. Allergy Asthma Immunol Res. 2012; 4:171–177.
22. Bachert C, Pawankar R, Zhang L, Bunnag C, Fokkens WJ, Hamilos DL, et al. ICON: chronic rhinosinusitis. World Allergy Organ J. 2014; 7:25.
23. Demoly P, Adkinson NF, Brockow K, Castells M, Chiriac AM, Greenberger PA, et al. International Consensus on drug allergy. Allergy. 2014; 69:420–437.
24. Kim MH, Lee JM. Diagnosis and management of immediate hypersensitivity reactions to cephalosporins. Allergy Asthma Immunol Res. 2014; 6:485–495.
25. Hong ST. Over the journal impact factor. J Korean Med Sci. 2013; 28:969.
26. Park CS. AAIR, a leading open access journal in allergy, asthma and immunology research. Allergy Asthma Immunol Res. 2009; 1:1–2.
27. Park CS. Congratulations are due to Allergy, Asthma, & Immunology Research (AAIR) on being listed in Web of Science (SCIE). Allergy Asthma Immunol Res. 2011; 3:145.
28. Park CS. Congratulations to all are in order, as Allergy, Asthma & Immunology Research (AAIR) is going to change to a bimonthly publication from a quarterly one. Allergy Asthma Immunol Res. 2012; 4:1.
29. Park HS. Embarking on a new journey with the Allergy, Asthma & Immunology Research. Allergy Asthma Immunol Res. 2014; 6:1–2.
30. Harbour R, Miller J. A new system for grading recommendations in evidence based guidelines. BMJ. 2001; 323:334–336.
31. Noruzi A. Google Scholar: the new generation of citation indexes. Libri. 2005; 55:170–180.
32. Bakkalbasi N, Bauer K, Glover J, Wang L. Three options for citation tracking: Google Scholar, Scopus and Web of Science. Biomed Digit Libr. 2006; 3:7.