INTRODUCTION
The information society in the 21st century provides an opportunity for people to easily access information anytime and anywhere with the explosion of information and the development of communication technologies. In modern society where information resources are rapidly increasing, selecting accurate information is taking on greater importance than ever [
1]. The Association of College and Research Libraries (ACRL) in the U.S. has developed information literacy competency standards for higher education by systematically categorizing the five types of competencies that college students could effectively utilize information [
1]. The Society of College, National and University Libraries in the U.K. have also developed seven pillars of information literacy competencies to foster intellectuals with information literacy as part of learning and teaching strategies of college and university education [
2]. In addition, the Council of Australian University Librarians has provided the information literacy standards for Australia focused on fostering people with information literacy competency by expanding the application scope from elementary, middle, high schools, and university education to lifelong education on the basis of the ACRL standards [
3]. Furthermore, the Australian and New Zealand Institute for Information Literacy has developed the information literacy framework of six standards to nurture people with information literacy competency in consideration of the Australian educational environments.
The information and communication technology is rapidly changing healthcare environments. In response to the changing healthcare environments, the Institute of Medicine in the U.S. has presented five core competencies needed for healthcare professionals: provision of patient-centered care, working in interdisciplinary teams, utilization of evidence-based practice, application of quality improvement, and utilization of informatics [
5]. According to the report 'RCN competences: Finding, using and managing information' published by the Royal College of Nursing (RCN) in the U.K. in 2011, nursing information literacy competency is defined as the comprehensive concept which includes identifying why information is needed, identifying what information is needed & carrying out a search to find information, evaluating how the information meets the identified need), managing information, using information and knowledge inclusively, legally and ethically, creating new information or knowledge. Nurses' information literacy competency is a key influencing factor for evidence-based practice [
67], and a lack of information literacy competency makes it difficult to find the best evidence in nursing practice and becomes an obstacle to evidence-based practice activities [
89]. In addition, capacity for clinical practice performance cannot be achieved without information literacy competency [
10]. Thus, it is necessary to develop curriculums and strategies for improving nursing information literacy competency in order to enhance the qualitative level of nursing in clinical practice and evidence-based practice. For this purpose, it is necessary to first understand nursing information literacy competency which includes nurses' ability to understand a nursing problem, search for necessary information, evaluate selected information, and utilize accurate information to solve a nursing problem.
Previous studies on nursing information literacy competency in Korea have shown that nursing information literacy competency could improve person's problem solving ability, self-directed learning ability and critical thinking disposition [
71415] and enhance capacity for evidence-based practice [
716]. Although there have been many studies on the information literacy competency in nursing students, most of them have been conducted using a measurement by modifying the information literacy competency instrument for college students [
7151617] and there is no a proper instrument to measure nursing information literacy competency. In view of the nature of nursing, an instrument to measure nursing information literacy competency should be prepared. The nursing information literacy competency instrument developed by Son et al.[
18] and the Nursing Informatics Competency Questionnaire (NICQ) developed by Staggers, Gassert and Curran [
19] includes subdomains of computer literacy related to hardware and software technology, knowledge and use of hospital informatization, and knowledge and skills of informatics. These two instruments can measure only the competency limited to the ability to search for information, which corresponds to only some part of nursing information literacy competency, which is the ability to recognize the need for information, determine the extent of information needed, efficiently access and evaluate information, and incorporate selected information into existing information to solve a problem. As a result, they cannot provide a valid assessment of nursing information literacy competencies presented by RCN (Royal College of Nursing) information literacy competency framework [
11], ACRL (Association of College and Research Libraries) nursing information literacy competency standards [
12], and TIGER (Technology Informatics Guiding Education Reform) nursing informatics competencies model, such as competencies to determine the information needed, access needed information, evaluate information, and use information.
The information literacy competency frameworks of RCN [
11], ACRL-Nurse [
12], and TIGER [
13] are presented as theoretical conceptual frameworks of nursing education programs that guide and support learning and teaching activities for development of information literacy competencies of nurses and nursing students. Since an instrument to assess nursing information literacy competency has not yet been developed based on the conceptual frameworks, it is necessary to develop a proper instrument. Especially, in the era of the 4th industrial revolution, information management and the legal and ethical use of information have become very important where various health information of individuals are continuously accumulated in healthcare institutions. However, it is difficult to find an instrument to comprehensively assess the nursing information literacy competency. Therefore, this study aimed to develop an instrument to comprehensively assess competency for identifying problems, competency for potential sources for information, competency for searching for information, competency for evaluating information, competency for acquiring and managing information, competency for using information ethically, and competency for integrating new information. Then, we would confirm the validity and reliability of the instrument to assess nursing information literacy competency among nurses working in various healthcare institutions.
DISCUSSION
The Nursing Information Literacy Competency for Nurses (NILC-N) in this study was developed to measure nurses' information literacy competency to use information based on evidence by searching information from various resources and evaluating information quality to solve the nursing problems encountered in clinical practice. The NILC-N is composed of 7 components and 27 items based on the RCN information literacy competency framework [
11], ACRL nursing information literacy competency standards [
12], and TIGER nursing informatics competencies model [
13]. Specifically, it consists of 4 items about competency for identifying problems, 5 items about competency for potential sources for information, 4 items about competency for searching for information, 5 items about competency for evaluating information, 4 items about competency for acquiring and managing information, 3 items about competency for using information ethically, and 2 items about competency for integrating new information. The validity and reliability of this instrument was verified using various methods to evaluate validity, such as construct validity, convergent validity, and criterion validity.
As a result of confirmatory factor analysis to verify the construct validity of the NILC-N, the nursing information literacy competency model consisting of 7 factors was found to be suitable. The instrument developed by Son et al.[
18] to measure nursing information literacy competency was composed of two subdomains of knowledge and utilization about computers and competency for searching for data. As for the competency of searching for data, specifically, it was composed of the items about competency for e-library utilization, competency for reference data utilization, understanding and utilization of the database, and utilization of the Internet and e-mail. The recognition of how to use documents and various websites in the competency for identifying potential sources of information of this study is related to the ability to use an e-library and the ability to utilize reference data, and competency for searching for information which enables individuals to actually search for information using various search strategies is directly or indirectly related to the understanding and utilization of database and the utilization of the internet. In the instrument of Son et al.[
18], computer literacy related to the knowledge and use of computers was separately classified as a sub-domain. However, the competency for potential sources for information and competency for searching for information of NILC-N could measure nursing information literacy competencies in a more concrete manner. In addition, it is expected to have high applicability because it includes essential competencies on information source identification and information search competency with fewer items.
The NICQ proposed by Staggers, Gassert and Curran [
19] was developed to measure extensive nursing information literacy competencies regarding three areas of computer skills, informatics knowledge, and informatics skills. However, competency for searching for information of NICQ which corresponds to part of the areas of nursing information literacy competency is partially included in the communication and data access areas of computer skills. Because the NICQ mainly deals with the concepts of informatization and computer knowledge and skills, it is difficult to measure the attributes of nurses' recognization of information needs, finding and evaluating necessary information, and applying it to problem solving using the NICQ. In this regard, the NILC-N instrument has the advantage that it can comprehensively measure a nursing information literacy competency. Especially, ‘the competency for using information ethically’ of the NILC-N has significant implications because it is an essential competency for nurses who are responsible for legally acquiring and protecting the personal information and health information of nursing care recipients. In the 21st century, healthcare institutions are constantly accumulating a large number of health-related information and personal information. The results of this study are significant in that since nurses as professionals legally acquire the information of healthcare consumers, protect personal information, and ensure personal information security, it is essential to cultivate sound ethical awareness among nurses.
With respect to convergent validity, the standardized factor loadings of 27 items ranged from .51 to .82, all being higher than .50, and composite reliability ranged from .83 to .92, all being higher than .70, The AVE value ranged from .52 to .71, so it was also higher than .50 in all seven components. Therefore, convergence validity of the NILC-N was verified.
In terms of discriminant validity of the NILC-N, the squared value of the correlation coefficient between competency for identifying potential sources of information and competency for searching for information, between competency for evaluating information and competency for acquiring and managing information, and between competency for using information ethically and competency for integrating new information was higher than the AVE value, so discriminant validity was not completely secured. In some standards and models, information source identification and information search and information acquisition and evaluation are not handled as separate sub-domains, but selection of information sources, construction of search strategies, and performance of information search are included in information access and information evaluation and information extraction and integration are all included in the same component [
1213]. In the RCN information literacy competency framework, the legal and ethical aspects of information are dealt with together with information utilization [
11]. It is thought that since some subdomains did not maintain their independence for this reason, it may have affected discriminant validity.
The criterion validity of the NILC-N was verified by examining correlations with the EBPQ. The correlations between the EBPQ and competency for identifying potential sources of information and competency for using information ethically were rather lower than the correlation with other subdomains, but overall, there was a positive correlation between all subdomains of NILC-N and EBPQ. Finally, criterion validity was also verified. In the reliability test, Cronbach's α of the subdomains of NILC-N ranged from .70 to .84, and the overall instrument reliability was as high as .93. In general, it is said that internal consistency reliability is established if Cronbach's α is .70 or higher in the case of a newly developed instrument, and if it is .80 or more in the case of the developed and mature instrument [
30]. Therefore, the NILC-N was shown to be a reliable instrument with internal consistency.
The components of the NILC-N were derived as seven subdomains of problem identification, information source identification, information search, information evaluation. information acquisition and management, information ethics, and information utilization. All attributes of the NILC-N includes seven competencies of the RCN information literacy competency framework, five elements of the TIGER nursing informatics competencies model, and five standards of ACRL nursing information literacy competency standards. In the NILC-N instrument, nursing information literacy competency was defined as the competency for nurses to identify nursing problems, identify information needed and information sources to solve problems, identify and evaluate appropriate information, use information ethically, and utilize information in practice to perform the best nursing practice.
The first factor ‘competency for identifying problems’ includes 4 items about recognition of nursing problems, recognition of information needs, and clarification of nursing problems. It is the competency for recognizing that information is needed in a nursing situation and identifying a nursing problem by clarifying what information is needed to solve the nursing problem. Considering that it is the first step in the process of nursing problem solving to recognize the needs of the nursing care recipient in a nursing situation and clarify what the nursing problem is, it can be seen that it is an important factor in nursing information literacy competency. The second factor ‘competency for identifying potential sources of information’ includes 5 items about identification of information sources, selection of information sources, and understanding how to use information sources. It is the capacity to identify what information is needed to solve a nursing problem, identify various information sources, and select the best information source. After identifying a nursing problem accurately, identifying the sources of information available to resolve the identified nursing problem and selecting the best source of information is an important process that must be undertaken before performing information search and provides a method to deal with the needs or problems of nursing care recipients [
11]. The third factor ‘competency for searching for information’ includes 4 items about construction of search strategies, information search, and modification of search strategies. It is the competency to find reliable and useful information by building search strategies to access the selected information source and find useful information to solve nursing problems. The derivation of competency for searching for information is thought to be meaningful in that nurses should be able to search for information based on available information sources including colleagues, policies, and various types of literature to find useful information to solve the problems of nursing care recipients [
13]. The fourth factor ‘competency for evaluating information’ include 5 items about the identification of the reliable and accurate information, appropriateness and applicability of selected information, and determination of the necessity for additional information. It is the capacity to determine whether the information acquired from information sources is appropriate for information needs and the solution of nursing problems. The evaluation of the reliability, validity, accuracy, authority and timeliness of information to determine whether collected information can be used as an effective intervention to meet the needs of a nursing care recipient is an essential element in solving the nursing problem using accurate information. The fifth factor ‘competency for acquire and manage information’ includes 4 items of knowledge, information extraction, information use, and management of useful information sources. It is the capacity for a nurse to access information to determine what information is valuable in a particular situation and extract knowledge and information data suitable for solving nursing problems. The ability to summarize and acquire useful information that can be applied to actual problem solving is an important competence in that it is the ability for a nurse to understand the individual needs of a nursing care recipient and effectively solve a nursing problem. The sixth factor ‘competency for using information ethically’ consists of 3 items about the legal use of information and protection of the information of the nursing care recipient. It is the competency related to legal, ethical and social problems encountered when nurses access information sources, obtain necessary information and actually use the information. The seventh factor ‘competency for integrating new information’ consists of 2 items about information synthesis and application, and it is the competency to integrate and synthesize new information acquired with existing knowledge, select appropriate delivery methods to meet the needs of nursing care recipients and actually apply them to the solution of nursing problems.
Nurses are responsible for maintaining up-to-date knowledge and skills for continuous professional development. Nursing staff should improve clinical practice through assessment and supervision [
11] and develop the ability to use the information system and information literacy competency to improve the safety of care and quality of nursing in a new healthcare environment [
13]. Nursing information literacy competency is an essential capacity needed to identify nursing problems to solve the nursing problems encountered in clinical practice, find necessary information, and apply the information that meets the needs of nursing care recipients in order to provide high quality nursing care to them [
11]. As described above, since the NILC-N developed to measure the level of information literacy competency of nurses can accurately measure the current nursing information literacy competency of nursing workforce, it can be utilized in the field of nursing practice such as the development of a curriculum to improve nursing information literacy competency by identifying strengths or weaknesses of nursing staff regarding the factors of nursing information literacy competency.
The significance of this study can be considered in terms of nursing theory, nursing research, and nursing practice as follows. First, since theories and models for nursing information literacy competency have not been developed to date, the NILC-N instrument was developed based on the RCN information literacy competency framework [
11], ACRL nursing information literacy competency standards [
12], and TIGER nursing informatics competencies model [
13]. Second, in terms of nursing research, it is necessary to accurately assess the information literacy competencies of nursing staff by using the NILC-N instrument to identify strong or weak points among the seven kinds of competencies. Additionally, there is a need for a follow-up study to develop a customized nursing information literacy competency enhancement program based on the strengths and weaknesses regarding nursing information literacy competency of nursing workforce identified by the NILC-N instrument and to verify the effects. Finally, in terms of nursing practice, previously, it was not possible to accurately measure nursing information literacy competency among nurses because the information literacy competency measurement instrument developed for college students was used to measure nursing information literacy competency before this study. For improving the quality of nursing, it is necessary to evaluate the nursing information literacy competency by using the NILC-N.
Despite several significances, this study has some limitations. First, since the participants of this study were nurses working in one tertiary hospital and four medium-sized hospitals, it may be difficult to generalize our findings to the entire nursing workforce. Second, since the item of ‘competency for integrating new information’ were extracted as two items about the synthesis and application of information in the validity verification process of the NILC-N instrument through confirmatory factor analysis, it remains a question whether it can explain the attribute of information synthesis sufficiently. Therefore, we recommend that these aspects should be carefully reviewed in using the instrument.