Abstract
Background
Healthcare 4.0. refers to the integration of advanced technologies, such as artificial intelligence (AI) and big data analysis, into the healthcare sector. Recognizing the impact of Healthcare 4.0 technologies in laboratory medicine (LM), we seek to assess the overall awareness and implementation of Healthcare 4.0 among members of the Korean Society for Laboratory Medicine (KSLM).
Methods
A web-based survey was conducted using an anonymous questionnaire. The survey comprised 36 questions covering demographic information (seven questions), big data (10 questions), and AI (19 questions).
Results
In total, 182 (17.9%) of 1,017 KSLM members participated in the survey. Thirty-two percent of respondents considered AI to be the most important technology in LM in the era of Healthcare 4.0, closely followed by 31% who favored big data. Approximately 80% of respondents were familiar with big data but had not conducted research using it, and 71% were willing to participate in future big data research conducted by the KSLM. Respondents viewed AI as the most valuable tool in molecular genetics within various divisions. More than half of the respondents were open to the notion of using AI as assistance rather than a complete replacement for their roles.
Conclusions
This survey highlighted KSLM members’ awareness of the potential applications and implications of big data and AI. We emphasize the complexity of AI integration in healthcare, citing technical and ethical challenges leading to diverse opinions on its impact on employment and training. This highlights the need for a holistic approach to adopting new technologies.
Healthcare 1.0 refers to the traditional model of healthcare delivery that has existed for much of the 20th century and continues to be prevalent in many regions. In the late 1990s, Healthcare 1.0 focused on improving service efficiency and reducing bureaucracy. Healthcare 2.0 was aimed at enhancing efficiency and data exchange among healthcare organizations. Healthcare 3.0 introduced proactive care using electronic medical records (EMRs), big data analytics, and Internet of Things (IoT) wearables, emphasizing preventive treatment [1]. Finally, Healthcare 4.0 marks a shift toward predictive care and patient-centric approaches, using advanced technologies such as the IoT, blockchain, artificial intelligence (AI), and big data analytics to deliver high-quality, cost-effective healthcare [1]. In the era of Healthcare 4.0, the integration of AI, big data analysis, and the IoT is revolutionizing medical diagnostics and laboratory medicine (LM). The use of AI in diagnostic procedures enhances precision and efficiency, reduces human error, and improves patient outcomes [2-4].Similarly, machine learning (ML) offers a means to analyze complex biochemical data rapidly and accurately, and big data analysis allows for more personalized and predictive medicine [5]. The relationship among big data, ML, and AI is foundational to these advancements. Big data provides the extensive datasets necessary for analysis, ML processes the data to identify patterns and provide insights, and AI applies the findings to improve diagnostic and treatment decisions, collectively driving the evolution toward more informed and tailored healthcare solutions [2-5].
The influx of extensive data poses significant challenges in data management, emphasizing the need for robust systems to maintain data integrity and security. The management of sensitive patient information under these circumstances becomes a matter of stringent compliance with data privacy and ethical standards, introducing novel challenges in LM [2]. Consequently, there is a growing need for laboratory professionals skilled in digital literacy, data analysis, and AI-based tools [3, 4]. Educational programs and professional training are being adapted to include these skills to equip professionals for Healthcare 4.0 [2, 6, 7].
The Evidence-Based Laboratory Medicine (EBLM) Committee of the Korean Society for Laboratory Medicine (KSLM), recognizing the importance of understanding the impact of Healthcare 4.0 technologies in LM, aimed to evaluate the awareness and implementation of these technologies among KSLM members to identify knowledge gaps and prepare for future challenges. The objectives were to assess perceptions and readiness regarding big data, AI, and terminology standards among laboratory professionals in the Healthcare 4.0 era.
A web-based survey was conducted between June 12 and 30, 2023, using an anonymous questionnaire distributed via the Moaform online survey platform (www.moaform.co.kr). To ensure the validity and reliability of the survey results, 12 EBLM Committee members rigorously evaluated the questionnaire for comprehensibility and consistency before it was distributed. Then, KSLM members were invited to partake in the survey through a hyperlink embedded in an e-mail, facilitating direct access to the questionnaire. The study protocol and design were approved by the Institutional Review Board of the Hallym University Dongtan Sacred Heart Hospital, Gyeonggi, Korea (approval No.: 2023-03-005).
The survey comprised 36 questions covering demographic information (seven questions), big data (10 questions), and AI (19 questions).
The seven demographic questions included sex, age, employment type, years of practice in LM, workplace type and location, and the most important technologies introduced in LM with the advent of Healthcare 4.0.
Ten questions were addressed to clinical pathologists to assess their understanding of, interest in, and research experience with big data analysis and the statistical tools and programming languages used in big data analysis. The questionnaire included questions pertaining to the awareness of the common data model (CDM) and clinical data warehouse (CDW) and the availability thereof in the institution, and questions regarding the recognition of the Federated E-Health Big Data for Evidence Renovation Network (FeederNet), which is an environment for federated learning constructed based on the Observational Medical Outcomes Partnership (OMOP) CDM used in the Observational Health Data Sciences and Informatics [8].
Nineteen questions focused on the participants’ knowledge of, attitude regarding, and experience with AI, as well as their interest in using AI tools in their work, aiming to assess current AI usage and views on the use of AI in the next five years. The questions on AI usage assessed whether the participant’s laboratory workplace is currently integrating AI technologies, how the adoption of advanced technologies affects the workplace, and in which divisions AI is considered particularly useful. We asked for opinions on whether AI would improve the quality of the laboratory and on the legal liability for AI test results and decision-making.
In total, 182 participants (17.9%) of 1,017 KSLM members completed the survey over a three-week period. Demographic data are provided in Supplemental Data Table S1.
According to the responses to single-selection questions, AI (31.9%) and big data (31.3%) were regarded as the most important technologies in the era of Healthcare 4.0 in LM, followed by personalized medicine (24%). Three-dimensional (3D) printing, augmented reality (AR), virtual reality (VR), IoT, and surgical robots were less emphasized (Fig. 1).
Among the 182 respondents, 134 (73.6%) acknowledged being somewhat familiar with the concept of big data, and 11 (6.0%) professed a comprehensive understanding. Thirty-six respondents (19.8%) reported having a limited grasp of the concept, and one (0.5%) reported a complete lack of knowledge on the topic.
A survey on big data research experience among laboratory professionals revealed that the majority (80.8%, N=147) were interested in but had not yet conducted big data analysis research. Only 10.4% (N=19) had conducted research in this field, 36.8% of whom had published their work. Additionally, 7.7% were involved in ongoing big data analysis research, whereas a small portion (3.3%, N=6) showed no interest in the subject. Regarding the use of statistical methods for big data analytics, 22.0% of respondents reported being able to use data analytics tools. According to the responses to the multiple-choice question regarding preferences for statistical software, the majority of participants (75.0%) preferred using R programming (Fig. 2A). Among programming languages, R was the most commonly used by 77.5% of respondents, followed by Python (67.5%), Visual Basic (25.0%), structured query language (SQL) (17.5%), and C (17.5%) (Fig. 2B).
In 2020, the Korean Ministry of Health and Welfare launched a project to enhance medical data collection, processing, and interoperability [9]. Forty-eight respondents (26.4%) reported that their institution had participated in the project, whereas 73 (40.1%) reported non-participation. Sixty-one respondents (33.5%) were uncertain whether their institution had participated.
To facilitate the reuse of health data and ensure interoperability, medical information systems, such as CDWs and CDMs, have been developed [9, 10]. Approximately 60% of respondents were unaware of CDMs, whereas 40% reported varying degrees of awareness. When asked about the establishment of a CDW or CDM at their institution, 14.8% reported the presence of a CDW, and 7.7% reported CDM implementation. Notably, 11.5% indicated that their institution has both a CDW and a CDM. Conversely, 27.5% stated the absence of both systems in their institution, and 38.5% were unsure of their availability.
The Health Insurance Review and Assessment Service (HIRA) releases data via the Healthcare Bigdata Hub platform, which provides public datasets, medical big data analysis tools, and statistics tools for the analysis of diseases and medicines [11]. Only nine respondents (4.9%) reported having used Healthcare Bigdata Hub data for research. Forty-one (22.5%) had only visited the portal, 79 (43.4%) were aware of it but had not visited it, and 53 (29.1%) were unfamiliar with it. Regarding the 2021 memorandum of understanding between the KSLM and the big data research department of the National Health Insurance Service, 36.8% of respondents were informed about its existence, whereas 63.2% were not. FeederNet, a clinical data analysis platform in Korea established in 2019 [8], was familiar to 43 (23.6%) respondents. Among them, 9.3% had engaged in analysis using real-world big datasets from the OMOP CDM, whereas 90.7% had not actively participated in such research. A significant portion of respondents (139, 76%) lacked awareness of this nationwide network. One hundred thirty respondents (71.4%) expressed willingness to participate in future big data research by KSLM.
Most described their knowledge of AI as somewhat (73.6%) or very well-informed (4.9%), whereas 39 (21.4%) respondents reported not being well-informed.
One hundred forty-eight of 182 respondents (81.3%) were interested in but had not yet published AI research. Twenty-three respondents (12.6%) had published AI research papers, and 16 (8.8%) were currently engaged in AI research. Eleven respondents (6.0%) reported no interest in AI research.
Table 1 outlines the impact of AI on current and future LM work. Fig. 3 illustrates the respondents’ perceptions of the potential utility of AI within various LM divisions. AI was considered most useful in molecular genetics (28.7%) and diagnostic hematology (27.5%), followed by laboratory management (24.2%). AI was perceived to be less applicable in clinical chemistry and other areas. Two respondents highlighted the role of AI in test result verification and point-of-care testing. Concerning AI adoption, the vast majority (95.6%) were open to using AI applications in their work, whereas a small fraction (4.4%) expressed no such intention. Regarding AI training, 79.7% recognized the need for and were willing to pursue specialized AI training, 17.6% preferred learning from AI experts, and 2.7% expected only basic training.
Table 2 summarizes the views on the impact of AI on clinical pathologists and LM residents. More than half of the respondents (56.0%) anticipated an expansion of their roles because of AI, 27.5% expected no change, and 16.5% expected their roles to become redundant. Regarding the impact of AI on the current numbers of clinical pathologists and LM residents, 52.2% predicted no change, whereas 26.4% expected an increase and 21.4% a decrease. Opinions on the impact of AI on residency training duration also varied: 81.9% expected no effect, 12.1% anticipated a need for extended training, and 6.0% suggested a potential reduction of the conventional 4-yr training duration. Regarding medical education, 46.8% of clinical pathologists believed AI would increase their teaching responsibilities, 45.6% predicted no significant change, and 7.1% expected a decrease in educational duties.
Table 3 presents the views on the impact of AI on laboratory test reporting and liability. Most respondents (80.2%) were optimistic about AI’s potential to improve laboratory test quality and accuracy, whereas 20% remained neutral or cautious. With AI poised to contribute to laboratory reporting and EMR integration, 45.6% of professionals expressed concerns about potential unforeseen issues with AI-generated reports, whereas 40.7% would not be concerned if AI would achieve expert-level interpretation. Regarding liability for AI diagnostic errors, 54.4% advocated shared legal responsibility between AI developers and physicians, 33.5% found that physicians should be fully accountable for final decisions, and 12.1% believed that manufacturers should compensate for any patient harm resulting from defective AI products or designs.
This survey was the first of its kind, targeting KSLM members in Korea, specifically addressing Healthcare 4.0. The respondents considered AI the most vital in LM, followed by big data and personalized medicine. In contrast, a previous report highlighted IoT as the most promising healthcare technology because of 5G and data-sharing capabilities, followed closely by AI in the second position and robotics and digital manufacturing, including 3D printing, in the third and fourth positions, respectively [12]. ML, a subset of AI, is already implemented or is likely to be used to enhance laboratory workflows, provide decision support, facilitate diagnostic and predictive applications, and integrate laboratory data [13]. Our findings revealed some differences in the ranking of the importance of Healthcare 4.0 technologies.
Most survey respondents were somewhat familiar with big data, with varying levels of understanding of and interest in big data analysis. Only a small percentage were proficient in using statistical software tools, indicating a gap in skills related to statistical analysis and programming language fluency. R programming was the most preferred language for statistical analysis, which is attributed to its open-source nature and diverse packages. In 2020, the most popular programming language for big data projects was Python, followed by C++ and JavaScript [14]. In a 2021 survey regarding tools for data scientists and analytics professionals, the order of preference was Python>SAS>R [15]. This suggests that preferences differ based on the industry, study area, and intended use, as well as according to the advantages and disadvantages of each tool.
In the era of big data, the integration of laboratory data into healthcare research presents both unprecedented opportunities and significant challenges. With the rapid expansion of AI applications and the utilization of big data in healthcare, laboratory results have become a crucial component of the data landscape. However, the assurance of data quality of laboratory results is far from straightforward [16], particularly given that identical samples can yield significantly biased results when tested across different laboratories despite ongoing standardization and harmonization efforts [17-19]. Correcting biased results is essential to minimize laboratory errors, enhance patient safety, and reduce costs. Significant biases, both statistical and medical, must be identified and rectified [20]. Therefore, clinical pathologists bear the responsibility to guarantee the accuracy and reliability of the data that form the basis of research and clinical decisions [21]. Research efforts focusing on the development of models for evaluating real-world laboratory results for big data research are ongoing [22].
With the increasing availability of digital health records and data analytics techniques, data-driven approaches to healthcare have offered the potential to improve clinical decision support and the healthcare industry as a whole [23]. In line with current trends, in 2020, the Medical Data-Driven Hospital Support Project was initiated in Korea [9]. A significant portion of respondents appeared to have limited knowledge of their hospital’s involvement in the project or the availability of a CDW or CDM within their institution. Familiarity with platforms such as the Healthcare Bigdata Hub and FeederNet was also limited.
The role of AI in healthcare and medical education, data interpretation, and reporting in LM is growing. The use of AI, particularly deep learning in radiology, has significantly increased, with studies growing from 14 in 2015 to 237 in 2019 [24, 25]. However, its application in routine LM practice remains limited [6, 26]. Clinical pathologists are essential in the development, training, and evaluation of AI algorithms.
Most respondents had a general understanding of AI, which was more advanced than that of medical students [27, 28], and anticipated its adoption in LM, particularly for image analysis and data interpretation. AI has shown effectiveness in diagnostic imaging [29, 30] and is used in data analysis. AI is expected to significantly transform healthcare in the future [29, 31-33]. The respondents were keen on AI adoption, emphasizing the need for education and skill development. Data analysis was viewed as the most beneficial AI application in LM, with molecular genetics and diagnostic hematology regarded as the most suitable areas for AI adoption. While AI is rapidly being adopted in various sectors, its integration in medicine poses technical and ethical challenges.
More than half of the respondents were open to AI supporting rather than replacing clinical pathologists, whereas 16.5% expressed concerns about potential job loss. Studies by Syed and Al-Rawi [34] and Ansari, et al. [35] revealed varying beliefs about AI replacing human roles in healthcare, with 17.8% of healthcare students and 85% of radiologists anticipating an impact of AI on jobs. Opinions on AI replacing humans differ according to education, training, and medical specialties. While some specialists view AI as influencing medical education, others do not foresee major changes in educational responsibilities. Adequate education is needed to address the healthcare risks associated with AI [36].
A significant portion of the respondents had a positive view of AI’s potential to improve quality in LM, expecting it to enhance interpretation accuracy and reduce diagnostic errors. However, concerns remained about technical challenges and unpredictability. Most respondents agreed that AI could improve quality across different phases of laboratory testing but were divided on its impact on patient diagnosis and treatment. Legal liability associated with AI-based test results is a significant issue debated by programmers, manufacturers, hospitals, governments, and users. Most respondents perceived that as users, they bear legal responsibility for AI-related medical errors, with two-thirds believing that manufacturers and users share responsibility. A minority of respondents argued for manufacturer liability in cases of defective AI products. The responsibility for AI-related errors remains a complex topic without a definitive answer. Opinions vary among physicians, manufacturers, and patients. Khullar, et al. [37] reported that physicians tend to believe that manufacturers and healthcare organizations are responsible, whereas recent studies suggested manufacturer liability if AI tools are appropriately validated and meet labeling requirements [38, 39].
The adoption of new technologies in the medical field is a complex process that involves not only technical aspects but also acceptance by healthcare professionals and patients [40]. Similarly, the integration of AI and ML into LM is a multifaceted and complex process. There is a critical need to understand human factors that influence technology adoption in LM, such as perceived utility, usability, and the readiness of the LM community to adapt to changes. The successful incorporation of advanced technologies in LM necessitates a balanced approach that considers both the technical prowess of these technologies and the human aspects crucial in this transformational phase. Paranjape, et al. [7] identified a significant AI knowledge gap in the medical community, underscoring the importance of continuous information updates and structured educational programs in LM, enabling laboratory professionals to stay informed and skilled in using AI and ML effectively in their work.
One limitation of our study was the low level of survey participation (17.9%), which may have led to a bias toward those with at least some awareness of AI and LM, potentially presenting an overly optimistic view. Second, the majority of survey respondents were under the age of 50 yrs and had less than 15 yrs of professional experience (Supplemental Data Table S1) and, therefore, may not fully represent the opinions within KSLM, suggesting that the findings may not include the perspectives of the entire membership.
In conclusion, this study was the first to examine how KSLM members view big data, AI, and terminology standards in LM. Our observations revealed that AI is considered a crucial tool in LM, particularly in areas such as molecular genetics and diagnostic hematology. Further, our findings showed that integrating AI into healthcare is complex because of technical and ethical issues, which led to varied opinions on its effect on jobs and training. This emphasizes the need for a well-rounded approach to adopting new technologies, balancing technical aspects with human factors. Finally, our findings highlight the importance of ongoing education and information updates to ensure that laboratory professionals can effectively use AI and ML in their work.
ACKNOWLEDGEMENTS
We sincerely thank the members of the Korean Society for Laboratory Medicine (KSLM) who participated in our survey.
Notes
AUTHOR CONTRIBUTIONS
Yu S and Cho EJ contributed to study conceptualization; Yu S, Jeon BR, Liu C, Kim D, Park HI, Park HD, Shin JH, Lee JH, Choi Q, Kim S, Yun YM, and Cho EJ contributed to the methodology and investigation; Shin JH and Kim S acquired the funding; Yu S, Park HD, Kim S, Yun YM, and Cho EJ contributed to project administration; Shin JH, Kim S, Yun YM, and Cho EJ supervised the study; Yu S and Cho EJ contributed to writing – original draft and writing – review & editing.
Appendix
SUPPLEMENTARY MATERIALS
Supplementary materials can be found via https://doi.org/10.3343/alm.2024.0111
References
1. Gupta A, Singh A. 2023; Healthcare 4.0: recent advancements and futuristic research directions. Wirel Pers Commun. 129:933–52. DOI: 10.1007/s11277-022-10164-8. PMID: 36594000. PMCID: PMC9795952.
2. Pillay TS. 2021; Artificial intelligence in pathology and laboratory medicine. J Clin Pathol. 74:407–8. DOI: 10.1136/jclinpath-2021-207682. PMID: 34031137.
3. Rashidi HH, Albahra S, Robertson S, Tran NK, Hu B. 2023; Common statistical concepts in the supervised Machine Learning arena. Front Oncol. 13:1130229. DOI: 10.3389/fonc.2023.1130229. PMID: 36845729. PMCID: PMC9949554. PMID: 0c25151e79284e0aa525b3bb67851423.
4. Albahra S, Gorbett T, Robertson S, D'Aleo G, Kumar SVS, Ockunzzi S, et al. 2023; Artificial intelligence and machine learning overview in pathology & laboratory medicine: a general review of data preprocessing and basic supervised concepts. Semin Diagn Pathol. 40:71–87. DOI: 10.1053/j.semdp.2023.02.002. PMID: 36870825.
5. Punchoo R, Bhoora S, Pillay N. 2021; Applications of machine learning in the chemical pathology laboratory. J Clin Pathol. 74:435–42. DOI: 10.1136/jclinpath-2021-207393. PMID: 34117102.
6. Rakha EA, Toss M, Shiino S, Gamble P, Jaroensri R, Mermel CH, et al. 2021; Current and future applications of artificial intelligence in pathology: a clinical perspective. J Clin Pathol. 74:409–14. DOI: 10.1136/jclinpath-2020-206908. PMID: 32763920.
7. Paranjape K, Schinkel M, Hammer RD, Schouten B, Nannan Panday RS, Elbers PWG, et al. 2021; The value of artificial intelligence in laboratory medicine. Am J Clin Pathol. 155:823–31. DOI: 10.1093/ajcp/aqaa170. PMID: 33313667. PMCID: PMC8130876.
8. Lee GH, Park J, Kim J, Kim Y, Choi B, Park RW, et al. 2023; Feasibility study of federated learning on the distributed research network of OMOP common data model. Healthc Inform Res. 29:168–73. DOI: 10.4258/hir.2023.29.2.168. PMID: 37190741. PMCID: PMC10209729. PMID: 54c93e5036cd4cd2a8df722038ebd115.
9. Choi IY. 2023; Present and future of utilizing healthcare data. Healthc Inform Res. 29:1–3. DOI: 10.4258/hir.2023.29.1.1. PMID: 36792095. PMCID: PMC9932309. PMID: 9009cbc00ad04cff94a324d32f775219.
10. Bocquet F, Campone M, Cuggia M. 2022; The challenges of implementing comprehensive clinical data warehouses in hospitals. Int J Environ Res Public Health. 19:7379. DOI: 10.3390/ijerph19127379. PMID: 35742627. PMCID: PMC9223495.
11. Health Insurance Review and Assessment Service (HIRA) Bigdata Open Portal. https://opendata.hira.or.kr/home.do. Updated on Dec 2023.
12. Popov VV, Kudryavtseva EV, Kumar Katiyar N, Shishkin A, Stepanov SI, Goel S. 2022; Industry 4.0 and digitalisation in healthcare. Materials (Basel). 15:2140. DOI: 10.3390/ma15062140. PMID: 35329592. PMCID: PMC8953130. PMID: ffc32244274e4995a86ac6abab6dcd79.
13. Undru TR, Uday U, Lakshmi JT, Kaliappan A, Mallamgunta S, Nikhat SS, et al. 2022; Integrating artificial intelligence for clinical and laboratory diagnosis - a review. Maedica (Bucur). 17:420–6. DOI: 10.26574/maedica.2022.17.2.420. PMID: 36032592. PMCID: PMC9375890.
14. Mahmudova S. 2021; Study and comparative analysis of programming languages used for big data. Rev Inf Eng Appl. 8:1–9. DOI: 10.18488/journal.79.2021.81.1.9.
15. Works B. 2021. https://burtchworks.com/industry-insights/2021-survey-python-the-tool-of-choice-for-data-scientists-analytics-pros. Updated on Aug 2021.
16. Cho EJ, Jeong TD, Kim S, Park HD, Yun YM, Chun S, et al. 2023; A new strategy for evaluating the quality of laboratory results for big data research: using external quality assessment survey data (2010-2020). Ann Lab Med. 43:425–33. DOI: 10.3343/alm.2023.43.5.425. PMID: 37080743. PMCID: PMC10151270.
17. Yoon YA, Lee YW, Kim S, Lee K, Park HD, Chun S, et al. 2021; Standardization status of total cholesterol concentration measurement: analysis of Korean external quality assessment data. Ann Lab Med. 41:366–71. DOI: 10.3343/alm.2021.41.4.366. PMID: 33536354. PMCID: PMC7884189.
18. Jeong TD, Cho EJ, Lee K, Lee W, Yun YM, Chun S, et al. 2021; Recent trends in creatinine assays in Korea: long-term accuracy-based proficiency testing survey data by the Korean association of external quality assessment service (2011-2019). Ann Lab Med. 41:372–9. DOI: 10.3343/alm.2021.41.4.372. PMID: 33536355. PMCID: PMC7884186.
19. Nam Y, Lee JH, Kim SM, Jun SH, Song SH, Lee K, et al. 2022; Periodic comparability verification and within-laboratory harmonization of clinical chemistry laboratory results at a large healthcare center with multiple instruments. Ann Lab Med. 42:150–9. DOI: 10.3343/alm.2022.42.2.150. PMID: 34635608. PMCID: PMC8548239.
20. Coskun A. 2024; Bias in laboratory medicine: the dark side of the moon. Ann Lab Med. 44:6–20. DOI: 10.3343/alm.2024.44.1.6. PMID: 37665281. PMCID: PMC10485854.
21. Kim S. 2023; Laboratory data quality evaluation in the big data era. Ann Lab Med. 43:399–400. DOI: 10.3343/alm.2023.43.5.399. PMID: 37080739. PMCID: PMC10151286.
22. Kim S, Cho EJ, Jeong TD, Park HD, Yun YM, Lee K, et al. 2023; Proposed model for evaluating real-world laboratory results for big data research. Ann Lab Med. 43:104–7. DOI: 10.3343/alm.2023.43.1.104. PMID: 36045065. PMCID: PMC9467825.
23. Cascini F, Santaroni F, Lanzetti R, Failla G, Gentili A, Ricciardi W. 2021; Developing a data-driven approach in order to improve the safety and quality of patient care. Front Public Health. 9:667819. DOI: 10.3389/fpubh.2021.667819. PMID: 34095071. PMCID: PMC8175645. PMID: 9449fe29b8b84e7c806950b4e3f6345e.
24. Kelly BS, Judge C, Bollard SM, Clifford SM, Healy GM, Aziz A, et al. 2022; Radiology artificial intelligence: a systematic review and evaluation of methods (RAISE). Eur Radiol. 32:7998–8007. DOI: 10.1007/s00330-022-08784-6. PMID: 35420305. PMCID: PMC9668941.
25. Hosny A, Parmar C, Quackenbush J, Schwartz LH, Aerts HJWL. 2018; Artificial intelligence in radiology. Nat Rev Cancer. 18:500–10. DOI: 10.1038/s41568-018-0016-5. PMID: 29777175. PMCID: PMC6268174.
26. Ma C, Wang X, Wu J, Cheng X, Xia L, Xue F, et al. 2020; Real-world big-data studies in laboratory medicine: current status, application, and future considerations. Clin Biochem. 84:21–30. DOI: 10.1016/j.clinbiochem.2020.06.014. PMID: 32652094.
27. Pinto Dos Santos D, Giese D, Brodehl S, Chon SH, Staab W, Kleinert R, et al. 2019; Medical students' attitude towards artificial intelligence: a multicentre survey. Eur Radiol. 29:1640–6. DOI: 10.1007/s00330-018-5601-1. PMID: 29980928.
28. Sit C, Srinivasan R, Amlani A, Muthuswamy K, Azam A, Monzon L, et al. 2020; Attitudes and perceptions of UK medical students towards artificial intelligence and radiology: a multicentre survey. Insights Imaging. 11:14. DOI: 10.1186/s13244-019-0830-7. PMID: 32025951. PMCID: PMC7002761. PMID: c802385de9c64867b602d2cd6a7e0259.
29. Rajpurkar P, Chen E, Banerjee O, Topol EJ. 2022; AI in health and medicine. Nat Med. 28:31–8. DOI: 10.1038/s41591-021-01614-0. PMID: 35058619.
30. Burns BL, Rhoads DD, Misra A. 2023; The use of machine learning for image analysis artificial intelligence in clinical microbiology. J Clin Microbiol. 61:e0233621. DOI: 10.1128/jcm.02336-21. PMID: 37395657. PMCID: PMC10575257.
31. Koski E, Murphy J. 2021; AI in healthcare. Stud Health Technol Inform. 284:295–9. DOI: 10.3233/SHTI210726. PMID: 34920529.
32. Jiang F, Jiang Y, Zhi H, Dong Y, Li H, Ma S, et al. 2017; Artificial intelligence in healthcare: past, present and future. Stroke Vasc Neurol. 2:230–43. DOI: 10.1136/svn-2017-000101. PMID: 29507784. PMCID: PMC5829945.
33. Khan AI, Khan M, Khan R. 2023; Artificial intelligence in point-of-care testing. Ann Lab Med. 43:401–7. DOI: 10.3343/alm.2023.43.5.401. PMID: 37080740. PMCID: PMC10151281.
34. Syed W, Basil A Al-Rawi M. 2023; Assessment of awareness, perceptions, and opinions towards artificial intelligence among healthcare students in Riyadh, Saudi Arabia. Medicina (Kaunas). 59:828. DOI: 10.3390/medicina59050828. PMID: 37241062. PMCID: PMC10221309. PMID: 85e48e67064549f08f08b722bc823bc2.
35. Ansari I, Arfat M, Malik M, Bansal R. 2023; A cross-sectional survey on an insight into the current perceptions of Indian radiologists, radiographers, radiology trainee & medical imaging students on the future impact of artificial intelligence (AI) on the profession. J Pharm Neg Results. 14:1686–99.
36. Sun L, Yin C, Xu Q, Zhao W. 2023; Artificial intelligence for healthcare and medical education: a systematic review. Am J Transl Res. 15:4820–8. PMID: 37560249. PMCID: PMC10408516.
37. Khullar D, Casalino LP, Qian Y, Lu Y, Chang E, Aneja S. 2021; Public vs physician views of liability for artificial intelligence in health care. J Am Med Inform Assoc. 28:1574–7. DOI: 10.1093/jamia/ocab055. PMID: 33871009. PMCID: PMC8279784.
38. Abràmoff MD, Tobey D, Char DS. 2020; Lessons learned about autonomous AI: finding a safe, efficacious, and ethical path through the development process. Am J Ophthalmol. 214:134–42. DOI: 10.1016/j.ajo.2020.02.022. PMID: 32171769.
39. Bazoukis G, Hall J, Loscalzo J, Antman EM, Fuster V, Armoundas AA. 2022; The inclusion of augmented intelligence in medicine: a framework for successful implementation. Cell Rep Med. 3:100485. DOI: 10.1016/j.xcrm.2021.100485. PMID: 35106506. PMCID: PMC8784713.
40. Safi S, Thiessen T, Schmailzl KJ. 2018; Acceptance and resistance of new digital technologies in medicine: qualitative study. JMIR Res Protoc. 7:e11072. DOI: 10.2196/11072. PMID: 30514693. PMCID: PMC6299231.