Abstract
Objective
To analyze publication rate, time to publication and the characteristics of the abstracts presented at the annual Korean Academy of Rehabilitation Medicine (KARM) meetings.
Methods
A total of 1,027 abstracts presented at the 2008 and 2009 annual KARM meetings were enrolled in the database and searched for their subsequent citation in PubMed, KoreaMed, and Google Scholar.
Results
The data analysis revealed that 317 (30.87%) abstracts, were published as full-length journal articles and publication rates by subject were not significantly different. The mean time to publication was 17.17±10.48 months, and the journals written in English (20.39±10.20) required a longer duration than those written in Korean (11.94±8.44) with statistical significance (p<0.001). There was no statistical difference (p=0.284) in the duration between domestic (17.61±10.37) and foreign (16.48±10.51) of the 220 domestic journal articles, 190 (86.76%) were published in the Annals of Rehabilitation Medicine and the 97 articles published in foreign journals were scattered over 60 different journals.
The annual Korean Academy of Rehabilitation Medicine (KARM) meeting, held every spring and fall, is a major forum for rehabilitation physicians and related health care professionals in Korea. KARM is aimed to improve the knowledge of medical science through the exchange of the latest medical experiences and scientific information. Numerous abstracts presented at the meeting contain condensed current research findings and clinical experiences and play an important role as a medium for sharing information prior to the publication of full articles. After being presented at the annual meeting, some of them are published as journal articles in the Annals of Rehabilitation Medicine (Ann Rehabil Med) as well as in medical journals throughout the world. The process of getting the abstracts published as journal articles is an exhaustive work due to the collection and analysis of clinical information, meticulously preparing manuscripts, statistical analysis of data, and subsequent critical peer review process.
In particular, the peer review is an essential process for researchers to recognize the theoretical basis of the study and apply it to clinical practice and for reviewers to exchange information in medical science. Due to this intensive work, not all the abstracts are published as full-length articles for reasons such as insufficient data, statistical limitation, insignificant outcome of study, among others. According to a recent Cochrane Library review of 46 studies, the publication rates ranged from 11% to 78% depending on medical specialty, with an average of 45% [1]. In many fields, the publication rate of abstracts are regarded as an indicator of the quality of the scientific research presented at the meeting [2,3]. Furthermore, the publication rate can also be used to assess the level of such scientific meetings [4]. To the best of our knowledge, there has been no evaluations of the publication rate in the field of physical medicine and rehabilitation in Korean journals. The present study attempted to analyze the publication rate of abstracts presented at previous annual KARM meetings, the time to subsequent publication, and the abstract characteristics.
A total of 1,027 abstracts presented between 2008 and 2009 at the annual KARM meetings were enrolled in the database. Abstracts were categorized into the following 16 subjects as listed in the program book, amputation, rehabilitation in brain disorder, cancer rehabilitation, cardiopulmonary rehabilitation, electrodiagnosis, geriatric rehabilitation, medical policy, rehabilitation in musculoskeletal and soft tissue disorders, rehabilitation in neuromuscular disorders, orthosis and prosthesis, pediatric rehabilitation, physical therapy, rehabilitation in spinal cord injury disorder, sports rehabilitation, swallowing and miscellaneous. The data base also included the title, authors, and affiliations.
Two physicians from physical medicine and rehabilitation independently investigated whether subsequent articles were published by searching the PubMed (http://www.ncbi.nlm.nih.gov/PubMed/) database, KoreaMed database (http://www.koreamed.org/), and Google Scholar (http://scholar.google.com/) between the periods of January 2008 and June 2012. Both physicians searched for the articles by using broad keywords of abstract titles, authors' names and institutes from March 2012 to June 2012. Therefore, the follow-up periods ranged from 32 months (for the 2009 fall annual KARM meeting) to 49 months (for the 2008 spring annual KARM meeting).
When any discrepancy in search results between the two researchers occurred, the final confirmation was made after sufficient discussion. If one or more authors were identical and there was consistency in the study design and result between the abstract and the article, we assumed that as being published as well as when overall study design similar to that of the abstract, the abstract was considered as published even if there was a slight discrepancy in study scale or result. The title of the finally published article, the name of the journal, and the month and year of publication were recorded. The country and language of the published article were also recorded. The term "domestic journals" referred to journals published in Korea, and the term "foreign journals" referred to journals published in all the other countries. All foreign journals were written in English and domestic journals were written in Korean or English according to the manuscript guidelines. The term time to publication refers the duration required for the subsequent publication of the abstract as a journal article was the length of the time elapsed from the month of presentation at the annual meeting to the earlier month of publication of electronic or paper journal.
The quality of the published journals was evaluated based on Science Citation Index (SCI) and Science Citation Index Extended (SCIE) as well as the impact factors (IF) of the journals [5]. SCI published in February 2012 was used for the search and the journal IF was retrieved from Journal Citation Report (JCR) on the Thomson Scientific ISI Web of Knowledge server (http://admin-apps.webofknowledge.com/JCR/). Based on the 2011 JCR, five-year IF was recorded to exclude abrupt change of IF. The term publication rate referred to the percentage of the abstracts subsequently published as journal articles.
The ratio of publication by subject was analyzed using logistic regression. To evaluate correlation between the duration and the published country or language, Gehan's generalized Wilcoxon analysis was used. For statistical data analysis, SPSS ver. 12.0 (SPSS Inc., Chicago, IL, USA) was used. A p-value <0.05 was considered statistically significant.
We analyzed 1,027 abstracts presented at the 2008 and 2009 annual KARM meetings, in which 317 abstracts (30.87%) were published as full journal articles (Table 1). Cancer rehabilitation (13/22, 59.09%), cardiopulmonary rehabilitation (13/28, 46.43%), medical policy (6/13, 46.15%), and geriatric rehabilitation (7/17, 41.18%) showed high publication rates and sports rehabilitation (0/11, 0%) scored the lowest publication rate. Publication rates by subject group showed a range from 0% to 59.09% with no significant differences (Table 2).
The mean time to publication was 17.17±10.48 months for the 317 published journal articles, in which 239 articles (75.39%) were published within two years from presentation at the annual KARM meetings, and the longest time to publication found to be was 46 months. In addition, 220 articles (69.40%) were published in domestic journals and 190 (86.76%) of them were published in the Ann Rehabil Med (Fig. 1). A total of 97 articles (30.60%) were published in foreign journals and scattered over 60 different journals. The mean time to publication in domestic journals (17.61±10.37 months) was modestly longer than that of foreign journals (16.48±10.51 months) with no significant difference (p=0.28) (Fig. 2). However, the time to publication of articles written in English (20.39±10.20 months) was significantly (p<0.001) longer than the articles written in Korean (11.94±8.44 months) with statistical (Fig. 3).
In the 73 journals, 39 (53.42%) foreign journals and one (1.37%) domestic journal were listed in SCI, and 13 (15.79%) foreign journals and one (1.37%) domestic journal were listed in SCIE index. The five-year IF of the foreign journals ranged from 0.517 to 10.722 (2.92±1.20) and was far higher than that of domestic journals (1.13±0.10) (Table 3).
A total of 30.87% of abstracts presented at the 2008 and 2009 annual meetings were searched in PubMed or KoreaMed and Google Scholar as full-length articles. Publication rate of other scientific meetings ranged from 23.6% to 58%, mean value 39.15% [2,6-10]. Although direct comparison was not available since only few other similar studies to compare in the physical medicine and rehabilitation exist in the literature, the publication rate and the publication duration in the present study showed a favorable result compared to findings from similar studies of other medical departments [2,6-10].
Ideally, all the abstracts presented should be followed by publication in journals, however, as discussed above, researchers confront many obstacles frustrating the publication of abstracts in journals. Thus, there is possibility of failure in publication, which may be caused by a variety of reasons such as lack of peer review, insufficient data, statistical limitation, and insignificant outcome of study. In practice, abstracts are presented prior to the completion of the study and usually lack the necessary details for reviewers to criticize, thus abstracts with inadequate data were also be presented at the conferences. Based on the analysis from the present study, some abstracts were with overlapping subjects and some others were similar to previously conducted studies in domestic or foreign journals. Thus, not all these abstracts presented in the meetings were ultimately published in journals, the possible reasons are individual academic interests or involvement of non-academic factors such as external requests [11]. Researchers might conduct studies requested by public institutions, corporations, other medical departments, or non-medical scientists among others. In some cases, abstracts were transformed into further new studies or merged with the existing studies which might influence the publication rate.
Differences in the time to publication between domestic and foreign journals were not significant. The fact that a longer duration was required for publication in domestic journals was surprise for us, although it was not statistically significant. This could be due the development of the online submission system, e-mail and faster post submission services than in the past [12], which means that physical distance is no longer an obstacle in submitting journal articles. Moreover, the Ann Rehabil Med, the most targeted domestic journal, does not have an electronic submission and article processing options. Occasionally, articles accepted, but not able to be published in paper journals due to the lack of space, were released via electronic journals prior to being published in their paper journals. When comparing the time to publication in domestic journals in Korean and English, the latter was longer than the former indicating the language barrier as a critical obstacle in the publication of a journal article. Since 2011 Ann Rehabil Med also recommends the submissions in English, in an effort to be an international journal.
The present analyses indicated that, most articles were published in domestic journals and majority of them in the Ann Rehabil Med, however, the articles published in foreign journals were scattered over various journals this could be due to the fact that physical medicine and rehabilitation are the subjects of diverse nature. Nevertheless, since there were not many high impact domestic journals, apparently most articles were targeted to the Ann Rehabil Med.
Other reports suggest that, the longest publication duration was about 40 months [13,14], and our data also similar to the above mentioned studies. Considering the above, follow-up periods of the present study (32 to 49 months) might be too short for abstracts presented at the 2009 annual KARM meetings to be published as journal articles.
Since PubMed and KoreaMed were used as searching tools, we only could search the Medline database and the Korean Association of Medical Journal Edition database, Google Scholar was used to find articles that were not registered in the above database. However, there might be more journals not registered in the above databases and the possibility that we could have missed some published article cannot be excluded. As a result, the actual publication rate might be higher than that of the present study.
Most journals recommend having keywords on the line after the end of the abstracts, using appropriate Medical Subject Headings as listed by the National Library of Medicine. The absence of keywords in the abstracts of the 2008 and 2009 annual meetings of KARM rendered the search process difficult and might influence the accuracy of the search process.
The other limitations of the present study are the fact that except directly asking the authors of the abstracts, there is no way to identify whether the presented abstracts were submitted and how long it took for the submitted articles to be finally accepted. According to questionnaires for residents, 57% of projects had been abandoned or remained incomplete due to their lack of time, lack of interest, and faculty's lack of interest [15].
In conclusion, the publication rate of abstracts presented from 2008 to 2009 annual KARM meetings was 30.87% and the mean duration for subsequent publication was 17.17±10.48 months.
References
1. Scherer RW, Langenberg P, von Elm E. Full publication of results initially presented in abstracts. Cochrane Database Syst Rev. 2007; (2):MR000005. PMID: 17443628.
2. Scherer RW, Dickersin K, Langenberg P. Full publication of results initially presented in abstracts: a meta-analysis. JAMA. 1994; 272:158–162. PMID: 8015133.
3. Gorman RL, Oderda GM. Publication of presented abstracts at annual scientific meetings: a measure of quality? Vet Hum Toxicol. 1990; 32:470–472. PMID: 2238450.
4. Castillo J, Garcia-Guasch R, Cifuentes I. Fate of abstracts from the Paris 1995 European Society of Anaesthesiologists meeting. Eur J Anaesthesiol. 2002; 19:888–893. PMID: 12510908.
5. Saha S, Saint S, Christakis DA. Impact factor: a valid measure of journal quality? J Med Libr Assoc. 2003; 91:42–46. PMID: 12572533.
6. Chung JH, Autorino R, Kang DH, Lee JY, Moon HS, Choi HY, et al. Fate of abstracts presented at the annual meeting of the Korean urological association. Korean J Urol. 2012; 53:280–284. PMID: 22536473.
7. Yun EH, Chun KA, Kim YJ, Park SH. Fate of Abstracts presented at the scientific meetings of the Korean radiological society. J Korean Radiol Soc. 1999; 41:1029–1034.
8. Chung KJ, Lee JH, Kim YH, Kim TG, Ha JH. How many presentations are published as full papers? Arch Plast Surg. 2012; 39:238–243. PMID: 22783533.
9. Kim JO, Choi BW, Kim JH, Song KJ, Lee KB. Observational analysis of Korean society of spine surgery annual congress: (2001-05) free paper: from presentation to publication. J Korean Soc Spine Surg. 2011; 18:19–23.
10. Ha TH, Yoon DY, Goo DH, Chang SK, Seo YL, Yun EJ, et al. Publication rates for abstracts presented by Korean investigators at major radiology meetings. Korean J Radiol. 2008; 9:303–311. PMID: 18682667.
11. Dickersin K, Min YI, Meinert CL. Factors influencing publication of research results. Follow-up of applications submitted to two institutional review boards. JAMA. 1992; 267:374–378. PMID: 1727960.
12. Govender P, Buckley O, McAuley G, O'Brien J, Torreggiani WC. Does online submission of manuscripts improve efficiency? JBR-BTR. 2008; 91:231–234. PMID: 19202995.
13. Autorino R, Quarto G, Sio MD, Lima E, Quarto E, Damiano R, et al. Fate of abstracts presented at the World Congress of Endourology: are they followed by publication in peer-reviewed journals? J Endourol. 2006; 20:996–1001. PMID: 17206890.
14. Smith WA, Cancel QV, Tseng TY, Sultan S, Vieweg J, Dahm P. Factors associated with the full publication of studies presented in abstract form at the annual meeting of the American Urological Association. J Urol. 2007; 177:1084–1088. PMID: 17296415.
15. Gill S, Levin A, Djurdjev O, Yoshida EM. Obstacles to residents' conducting research and predictors of publication. Acad Med. 2001; 76:477. PMID: 11346527.