Abstract
Background
This study aimed to evaluate the relationship between clinical experience and death certificate (DC) errors by analyzing DCs written by experienced emergency physicians (EPs).
Methods
DCs issued by four experienced EPs over a 10-year period were retrospectively reviewed. DC errors were divided into major and minor errors based on whether they affected the cause of death (COD) determination. The errors were judged through first and second evaluations. Basic information regarding DCs and 10-year changes in DC errors were analyzed.
Results
A total of 505 DCs were analyzed, with an average of 34 to 70 for each study year. The number of CODs written in the DCs tended to decrease over time. The presentation of major DC errors did not show a tendency to change over time. However, the sum of the major and minor errors tended to increase over time. Secondary conditions as the underlying COD tended to increase, and the incompatible causal relationships between CODs tended to decrease over time in the detailed analysis of major errors. The increasing tendency for incorrect other significant conditions, incorrect type of accident, incorrect intention of the external cause, no record of the trauma mechanism, and record of the trauma mechanism without another COD were found in the detailed analysis of minor errors.
Graphical Abstract
The incidence of death certificate (DC) errors has been widely reported in previous studies.12345678910111213141516171819 It is not difficult to estimate the cause of death (COD) if a patient dies from a cause related to their previous medical history. However, in the case of death in an emergency department (ED), it is often difficult to estimate the COD if the patient’s medical history is not sufficiently known or if the COD is unrelated to their medical history. Therefore, the likelihood of DC errors may be higher.5615161720
Although it is generally known that more DC errors are made by less-experienced medical doctors than experienced ones,21 no studies exist on whether the clinical experience of clinicians is related to reductions in DC errors over time. Therefore, this study aimed to evaluate whether more clinical experience leads to fewer DC errors by analyzing DC errors made by experienced emergency physicians (EPs) with over 10 years of experience working in an ED.
This was a pilot study in one training hospital to discover changes in DC errors over time according to the clinical experience of a select number of clinicians. DCs issued in the ED of a university hospital located in the southeast coastal area of the Republic of Korea for 10 years from 2007 to 2016 were retrospectively analyzed. DCs written by EPs who worked in the ED of the same hospital for 10 years were included to identify changes in DC errors by individual clinicians. Four EPs were included in the analysis (EP-A, EP-B, EP-C, and EP-D). DC and postmortem examination certificates can be issued at the ED in the Republic of Korea. However, postmortem examination certificates have a high possibility of unknown CODs. Therefore, only DCs were included in this study. Any DCs issued by EPs who worked for only some of the study period and by departments other than emergency medicine were excluded from the analysis. DCs for any cases where the COD was unknown were excluded from the analysis (Fig. 1).
An experienced EP was defined as a medical doctor qualified as a board-certified EP after completing a six-year medical school course, a one-year internship, and a four-year residency, which is the standard for emergency medicine training in the Republic of Korea. In 2017, the study hospital introduced a method that applied the Korean Standard Classification of Diseases (KCD), corresponding to the International Classification of Diseases, 10th edition (ICD-10) codes, to CODs for DCs, and quality control for DC errors began with one EP completing DC writing training. Therefore, the study period was limited to 2016. An EP’s clinical experience in the ED was defined as the number of years of work experience in the ED after obtaining a board-certified EP qualification, which ranged from two to 10 years in 2007. The time elapsed for the study subjects after obtaining a medical doctor’s license was seven to 20 years in 2007.
The primary outcome was a change in errors in DCs that were written over the decade from 2007 to 2016.
DC errors were divided into major and minor errors based on previous literature.123456891011121314151617182223 Major errors were defined as errors that could affect COD determination, and other errors were defined as minor errors. The detailed classification and examples of errors are shown in Tables 1 and 2.
The evaluation of DC errors was conducted by four EPs working at the ED of the study hospital by referring to electronic medical records and DCs. The primary evaluators (the four EPs) included three fourth-year and one third-year emergency medicine resident. Three of the EPs with previous experience in research related to DC errors conducted the first evaluation by dividing the study periods between them, and one EP conducted the first evaluation of all DCs during the entire study period. A second evaluation was conducted for cases where there was a difference in the judgment of errors between the evaluators in each first evaluation. In the second evaluation, which included the participation of an additional EP with previous experience in conducting studies related to DC errors, the final errors were judged after discussion among the five EPs.610161722 All evaluators who participated in the judgment of errors received guidelines for DC writing training and made judgments with sufficient knowledge.24252627
The patient’s gender, age, number of CODs listed on the DC, the manner of death, and detailed COD classification on the DC were also collected. The manner of death was divided into natural causes and external causes. The detailed COD classification included certain infectious and parasitic diseases, malignant neoplasms, endocrine-nutritive and metabolic diseases, circulatory diseases, neurological diseases, digestive diseases, respiratory diseases, genitourinary diseases, external causes, and others according to COD statistics classified by the Korea National Statistical Office.28 The existence of one or more major or minor errors in the DC was identified, and each major and minor error item was investigated. The three most common major errors in the DCs were investigated by dividing the study period into two halves: the first five years and the second five years.
A total of 505 DCs were analyzed, with an average of 34 to 70 per study year. The number of DCs analyzed by the issuer was 95 for EP-A, 133 for EP-B, 121 for EP-C, and 156 for EP-D (Fig. 1). No significant difference was observed over time for the age and gender of the deceased on the DC, and the number of CODs written in the DC was 2.4 in 2007, 2.8 in 2008, 1.6 in 2015, and 1.5 in 2016, showing a tendency to write fewer CODs over the years (P = 0.006). There was no tendency to change the manner of death over time (Table 3).
The total number of DC errors was averaged, including all major errors and minor errors in each DC. The total number of DC errors tended to increase from 2.9 in 2007 and 2.8 in 2008 to 3.9 in 2015 to 3.2 in 2016 (P = 0.005). The sum of the major errors tended to increase from 0.6 in 2007 and 0.5 in 2008 to 0.9 in 2015 and 0.7 in 2016 (P = 0.003). The sum of the minor errors increased from 2.3 in both 2007 and 2008 to 3.1 in 2015 and 2.5 in 2016 (P = 0.002) (Fig. 2).
The presentation of major DC errors did not show a tendency to change over time, but in the major errors detailed analysis, secondary conditions as the underlying COD (UCOD) tended to increase, and incompatible causal relationships between CODs tended to decrease. The mode of death as the UCOD and more than one COD on a single line were common major DC errors. However, those major errors did not show a tendency to change overtime (Table 4).
The presentation of minor DC errors did not show a tendency to change over time. In the detailed analysis of minor DC errors, the number of incorrect other significant conditions, incorrect type of accident, incorrect intention of the external cause, no record of the trauma mechanism, and record of the trauma mechanism without another COD tended to increase. However, among the minor errors, the mode of death as the COD with an appropriate UCOD, blank/duplication, and no record for the date of onset tended to decrease. An incorrect time interval was the most common minor DC error, but this minor error did not show a tendency to change over time (Table 5).
The three most common major errors on DCs during the first half of the study period were in the order of the mode of death as the UCOD, ill-defined condition as the UCOD, and more than one cause of death on a single line. For the second half of the study period, the order was the mode of death as the UCOD, more than one cause of death on a single line, and a secondary condition as the UCOD. The mode of death as the UCOD was the most common major error by EP-C in both the first and second half of the study period. The most common major error in the first half of the study by EP-A was an ill-defined condition as the UCOD, incompatible causal relationship by EP-B, and mode of death as the UCOD by EP-D. For the second half of the study, the major errors were the mode of death as the UCOD by EP-A, improper sequence by EP-B, and more than one COD on a single line by EP-D (Table 6).
National COD statistics are generated based on the COD on DCs, and major policies related to healthcare are determined based on the results.81118 Therefore, an accurate COD is an important piece of medical information that is related to major health issues on a domestic and global basis. The COD on the DC is also important for deaths requiring investigation or insurance claims, civil and criminal disputes. Any errors in the main information, which can greatly affect the COD decision in a DC, can lead to incorrect COD statistics. In this study, which examined DCs written by EPs over a 10-year period, major errors that could affect COD decisions did not decrease. Numerous studies have shown that many errors occur in DCs.123456789101112131415161718 Therefore, various efforts are required to reduce these errors, such as the application of ICD-10 codes for COD on DCs,17 and the most necessary is education for DC writers.12121418222930 Regarding cardiopulmonary resuscitation training, knowledge or skills are improved through education, and repeated education is required in addition to the initial training to acquire a high level of ability. In a similar manner, DC errors can be reduced through DC writing education. The study results indirectly showed that even the DCs of experienced clinicians contain many errors if the clinicians do not receive continuous education.
All four EPs included in the study were educated at three different medical colleges and trained in their residency at three different training hospitals. They did not receive any formal training in writing DCs when they were medical students. They all learned orally about DC writing from a senior doctor during their residency and relied on simple guidelines. In addition, regular feedback was not provided regarding errors in their DC writing. However, their total number of DC errors was similar, although the characteristics of the frequent DC errors varied. This situation may be similar for most clinicians who do not have sufficient training experience in writing DCs.
Many errors may occur when writing DCs, and the characteristics of the errors vary according to the experience of the issuer.56 In this study, the characteristics of the major errors of four DC issuers were examined. The mode of death as the UCOD was the most common among the major errors made by EP-A, EP-C, and EP-D, and more than one COD on a single line was the most common error made by EP-B. Among the major errors, the second most frequent occurrence was ill-defined conditions as the UCOD by EP-A and EP-C, mode of death as the UCOD by EP-B, and more than one COD on a single line by EP-D. The most frequent major errors were the mode of death as the UCOD, secondary conditions as the UCOD, and an unacceptable COD in a previous study.17 Another study reported that secondary conditions as the UCOD, mode of death as the UCOD, and incompatible causal relationships, in that order, were the most frequent major errors.6 Thus, neither the overall nor individual error characteristics exactly matched, and the types of errors that occurred frequently differed according to individual characteristics. Therefore, feedback or education regarding errors is required to limit the differences and improve errors according to individual characteristics.
Since this study evaluated DCs issued by EPs who worked continuously for 10 years at one study hospital, there were a limited number of EPs and DCs for analysis. In addition, during the study period, some EPs were dispatched to other institutions or worked as a dedicated EPs specializing in ED pediatrics or severe trauma. Therefore, the number of DC issuances did not remain constant from year to year. Furthermore, due to the nature of the training university hospital, there is a possibility that a resident who worked with a study subject EP may have written a DC under the guidance of the EP but differed from their opinion, so it was not included in the study. Another limitation is that the results of this study cannot be generalized because there is no previous study related to this, so an appropriate sample size could not be presented. Although the medical school and training hospital of the four EPs in this study were not all the same, and the characteristics of the frequent DC errors were different, it is meaningful that the total number of DC errors was similar between them. However, the results must be verified through further studies. It is also possible that errors existed in the DC error evaluation itself. When multiple CODs are involved, it is sometimes difficult to accurately determine only one COD. In this case, if several experts reach an agreement, the value of the decision must be respected. Therefore, in this study, three evaluators and one overall evaluator performed the first evaluation of the errors, and evaluation errors were minimized by conducting a second evaluation for cases where there was a difference in the first evaluation.
In conclusion, as a result of analyzing DCs issued by experienced EPs over a 10-year period, the study found that DC errors did not decrease as clinical experience increased. Education to reduce DC errors and a feedback process for DC writing is necessary, regardless of the writer’s amount of clinical experience. DC writing education should be included in the regular curriculum at medical schools, and regular education for DC writing is necessary after graduation. It is also worth considering a system in which the agency with the authority to issue DCs independently verifies DC errors and provides feedback to the DC issuer. Additionally, if the COD changes based on autopsy results conducted after the issuance of the DC, a system in which the DC issuer is notified may be considered. In the future, a multicenter study, in addition to a study to verify whether actual errors are reduced through education, is required.
ACKNOWLEDGMENTS
This work was supported by the BigData Center of Ulsan University Hospital in statistical analyses.
Notes
Author Contributions:
Conceptualization: Kim JJ, Kim SH.
Data curation: Kim JJ, Kim SH, Chung S, Park BJ, Park S.
Formal analysis: Kim JJ, Kim SH.
Investigation: Kim JJ, Kim SH, Chung S, Park BJ, Park S.
Methodology: Kim JJ, Kim SH, Chung S, Park BJ, Park S, Park SY.
Project administration: Kim JJ, Kim SH.
Resources: Kim JJ, Kim SH, Chung S, Park BJ, Park S.
Software: Kim JJ, Kim SH.
Supervision: Kim SH, Park SY.
Validation: Kim JJ, Kim SH.
Visualization: Kim JJ, Kim SH.
Writing - original draft: Kim JJ, Kim SH.
References
1. Akakpo PK, Awuku YA, Derkyi-Kwarteng L, Gyamera KA, Eliason S. Review of errors in the issue of medical certificates of cause of death in a tertiary hospital in Ghana. Ghana Med J. 2017; 51(1):30–35. PMID: 28959070.
2. Alipour J, Payandeh A. Common errors in reporting cause-of-death statement on death certificates: a systematic review and meta-analysis. J Forensic Leg Med. 2021; 82:102220. PMID: 34325081.
3. Ben Khelil M, Kamel M, Lahmar S, Mrabet A, Borsali Falfoul N, Hamdoun M. Death certificate accuracy in a Tunisian emergency department. Tunis Med. 2017; 95(6):422–428. PMID: 29512798.
4. Burger EH, van der Merwe L, Volmink J. Errors in the completion of the death notification form. S Afr Med J. 2007; 97(11):1077–1081. PMID: 18250917.
5. Chang JH, Kim SH, Lee H, Choi B. Analysis of errors on death certificate for trauma related death. J Trauma Inj. 2019; 32(3):127–135.
6. Chung S, Kim SH, Park BJ, Park S. Factors associated with major errors on death certificates. Healthcare (Basel). 2022; 10(4):726. PMID: 35455903.
7. Fernando D, Oxley JD, Nottingham J. Death certification: do consultant pathologists do it better? J Clin Pathol. 2012; 65(10):949–951. PMID: 22774219.
8. Filippatos G, Andriopoulos P, Panoutsopoulos G, Zyga S, Souliotis K, Gennimata V, et al. The quality of death certification practice in Greece. Hippokratia. 2016; 20(1):19–25. PMID: 27895438.
9. Katsakiori PF, Panagiotopoulou EC, Sakellaropoulos GC, Papazafiropoulou A, Kardara M. Errors in death certificates in a rural area of Greece. Rural Remote Health. 2007; 7(4):822. PMID: 18067402.
10. Lee H, Kim SH, Choi B, Ock M, Park EJ. Concordance between the underlying causes of death on death certificates written by three emergency physicians. Clin Exp Emerg Med. 2019; 6(3):218–225. PMID: 31571438.
11. Lu TH, Shau WY, Shih TP, Lee MC, Chou MC, Lin CK. Factors associated with errors in death certificate completion. A national study in Taiwan. J Clin Epidemiol. 2001; 54(3):232–238. PMID: 11223320.
12. Maharjan L, Shah A, Shrestha KB, Shrestha G. Errors in cause-of-death statement on death certificates in intensive care unit of Kathmandu, Nepal. BMC Health Serv Res. 2015; 15(1):507. PMID: 26563325.
13. McGivern L, Shulman L, Carney JK, Shapiro S, Bundock E. Death certification errors and the effect on mortality statistics. Public Health Rep. 2017; 132(6):669–675. PMID: 29091542.
14. Myers KA, Farquhar DR. Improving the accuracy of death certification. CMAJ. 1998; 158(10):1317–1323. PMID: 9614825.
15. Park BJ, Kim SH. Errors in pediatric death certificates issued in an emergency department. Pediatr Emerg Med J. 2022; 9(1):17–22.
16. Park CH, Kim SH. Errors of death certificate for poisoning related death. J Korean Soc Clin Toxicol. 2020; 18(1):11–17.
17. Park S, Kim SH. Does the application of international classification of disease codes for the cause of death on death certificates reduce garbage codes? Inquiry. 2022; 59:469580221081433. PMID: 35384751.
18. Schuppener LM, Olson K, Brooks EG. Death certification: errors and interventions. Clin Med Res. 2020; 18(1):21–26. PMID: 31597655.
19. Kim HG, Park JW, Cho WY, Seo JH, Choi CH, Na JY. The discrepancy of the cause and manner of death between death certificates and autopsy reports. Korean J Leg Med. 2014; 38(4):139–144.
20. Yoon SH, Kim R, Lee CS. Analysis of death certificate errors of a university hospital emergency room. Korean J Leg Med. 2017; 41(3):61–66.
21. Lakkireddy DR, Gowda MS, Murray CW, Basarakodu KR, Vacek JL. Death certificate completion: how well are physicians trained and are cardiovascular causes overstated? Am J Med. 2004; 117(7):492–498. PMID: 15464706.
22. Kang E, Lee H, Kim SH. The effect of education on ‘how to write the death certificate’ for resident trainees of the emergency department. J Korean Soc Emerg Med. 2018; 29(5):529–550.
23. Mikkelsen L, Richards N, Lopez A. Redefining ‘Garbage Codes’ for Public Health Policy: Report on the Expert Group Meeting, 27-28 February 2017. Melbourne, Australia: University of Melbourne;2018.
24. Yoo S. Determination of cause and manner of death. J Korean Med Assoc. 2018; 1975(8456):2093–5951.
25. Korean Medical Association. How to Write and Issue Medical Certificates. Seoul, Korea: Korean Medical Association;2015. p. 34–53.
26. Brämer GR. International statistical classification of diseases and related health problems. Tenth revision. World Health Stat Q. 1988; 41(1):32–36. PMID: 3376487.
27. Hanzlick R. Cause of Death and the Death Certificate: Important Information for Physicians, Coroners, Medical Examiners, and The Public. Northfield, IL, USA: College of American Pathologists;2006.
28. KOrean Statistical Information Service. Cause of death statistics. Accessed November 27, 2023.
https://kosis.kr/index/index.do
.
29. Pandya H, Bose N, Shah R, Chaudhury N, Phatak A. Educational intervention to improve death certification at a teaching hospital. Natl Med J India. 2009; 22(6):317–319. PMID: 20384023.
30. Rogena EA, Waruru A, Young PW, Abade P, Nyagah LM, Walong EO. A review of completeness, correctness, and order of cause of death statements among decedents with documented causes of death and HIV status at two major mortuaries in Kenya, 2015. J Forensic Leg Med. 2020; 73:101993. PMID: 32658751.