Abstract
Methods
Through the "developing a curriculum (DACUM)" workshop, the definition of CRCs' role was described and CRCs' duties and tasks were identified. Finally, the developed duties and tasks were validated for importance, difficulty, and frequency.
Results
A CRC is defined as the one who coordinates and performs tasks related to clinical research/trials among investigators, participants, and sponsors according to the Good Clinical Practice at institutions conducting clinical trials. Twelve duties and 78 tasks were identified on the DACUM chart which represented the importance, difficulty, and frequency of tasks represented as A, B, and C respectively. Based on determinant coefficient (DC) of the task, the highest ranked task was confirming the eligibility of participants for research (DC=8.03) and the lowest was inventory management for clinical study materials (3.95).
A clinical research coordinator (CRC) is a clinical research professional with various specialty backgrounds and is responsible for conducting and supporting clinical trials. Nurses occupying the majority of CRC are the rightful workforce as they have extensive understanding and accessibility of subjects and clinical research data along with basic knowledge of medicine, pharmacy, and clinical trials (Kang, Kim, Jeong, & Baik, 2004; Pelke & Easa, 1997). Thus, the term 'CRC' is often used interchangeably as 'research nurse'.
With the rapidly increasing trend of clinical trial cases performed in Korea lately, the number of CRC has also increased. It is rather difficult to obtain accurate statistical data of Clinical Research Coordinator in Korea as most of CRCs are contract-based employees; however, it was estimated that there were about 100 CRCs in 2003 which increased to about 2,000 CRCs at present (Kang, 2010). Despite such a sharply increasing number of CRCs, there is no established guideline for the educational background or performing roles of CRCs. This indicates the lack of systematic efforts to develop infrastructure, such as defining and clarifying responsibilities of CRCs (Kang, Kim, Jeong, Choung, & Shin, 2004). In foreign countries, CRCs play important roles such as taking care of subjects in clinical trials, enhancing their cooperation for research, maintaining the quality of research, and strengthening the connection between research and clinical practice (Poston & Buescher, 2010; Rico-Villademoros et al., 2004; Spilsbury et al., 2008). In fact, CRCs perform many different roles as educators, speakers, direct nursing practitioners, and clinical trial operators (Dawson, & Benson, 1997). Among them, patient care and research-related administrative works have been reported to blur the boundary of their research roles and increase their workload. For example, a study reported that CRCs perceived Good Clinical Practice (GCP) and ethics as important tasks but considered tasks like research fund management and data management as not so important (Hill & MacArthur, 2006). Like this, the boundary of CRCs' jobs and their responsibilities is somewhat ambiguous depending on the type and characteristic of research; for this, clearly defining job description of CRC is needed (Pelke & Easa, 1997; Rico-Villademoros et al.).
On the other hand, many of CRCs in Korea are sent out to the field without adequate and systematic training that has been an obstacle to the development of new drug as well as to active participation in multinational clinical trials (Park, 2010). Thus, in order to ensure the reliability of clinical trials and to protect subjects, it is very important to improve abilities of clinical research staffs through systematic education programs and certification systems for clinical research specialists. Accurate and specific information on definition and roles of CRCs is essential in the development of human resource programs, and job analysis should be conducted first to collect such information.
Therefore, in order to enhance people's understanding of research related jobs and reducing ambiguity of job boundaries, job analysis of CRC becomes very critical. Through job analysis of CRCs, establishment of systematic guideline that clarifies work scope and direct how to solve problems faced by CRCs are possible. However, just handful studies have been made on CRCs and studies on research nurses also lacks. The only previous study on job analysis is the analysis of research nurses in oncologic clinical trials (Hwang, 2008), and there are no studies on job analysis for CRCs. For those reasons, this study is to analyze CRCs' jobs to be used as ground materials for developing curriculums and certification systems and furthermore to contribute to efficient and veconvenient guidance that prevents confusion or conflicts in CRCs' roles.
To analyze the CRC's role or job, we used "Developing a curriculum (DACUM)." DACUM has been used to analyze tasks conducted by specific jobs in order to develop competency-based curriculums. The DACUM methods are effective due to group interaction, group synergy, and group consensus via brain storming process; future orientation; cost-effectiveness because the DACUM workshop is completed in two days (Norton, 1997, 2008). Because of those strengths, DACUM method has been used in nursing and health care professions when a new job was developed and/or a new educational program is needed (Byun, Kim, Kim, Ha, & Jeon, 2003; Cooper, Aherne, & Pereira, 2010; DeOnna, 2002; Kim, Park, & Lim, 2008; Oh et al., 2006; Sherrill & Keels-Williams, 2005; Shin et al., 2012; Stevenson, Hornsby, Phillippe, Kelley, & Mc-Donough, 2011). DACUM Process starts from conducting DACUM workshop to produce DACUM chart by identifying duties and tasks. Task verification by rating importance, difficulty, and frequency is followed.
This is a descriptive study for CRC job analysis that adopted a multidimensional research design using workshops and questionnaire surveys of experts for defining CRCs' jobs using the job analysis technique of DACUM classifying their duties and tasks, and confirming the validity (Kim, 2006). This study was approved by the institutional Review Board at the College of Nursing, Seoul National University (No. 2010-66).
DACUM is a systematic method for developing practical competency-oriented education programs (DeOnna, 2002; Norton, 2008), analyzes jobs on the assumption that those with rich field experiences can explain their job most accurately, that a job can be defined most effectively by those highly experienced in the job, and knowledge, behavior, and that skills are required in addition to tools or instruments in order for a task to be carried out adequately (Norton, 1997). DACUM is a process of developing curriculums by analyzing requirements through need assessment of a given job area. There are many other methods used for job analysis like the Vocational-Technical Education Consortium of States (V-TECS) (Oliver & Hill, 1974) and the Functional Job Analysis (FJA). FJA is a costly and time-intensive methodology performed using interviews and observations (Levine, Ash, Hall, & Sistrunk, 1983). V-TECS is not intensive as FJA, but very similar to DACUM in terms of producing task-based output and processes, but not used commonly these days. DACUM requires less time and cost while it is easily understandable to participants (DeOnna, 2002; Norton, 1997, 2008; Sherrill & Keels-Williams, 2005). Therefore, the DACUM technique was chosen for CRC job analysis in this study. Unlike the job analysis by expert opinion or filed survey only, DACUM process use both group interaction and consensus by committee and agreement via survey. That is the reason the results induced by DACUM process are more reliable and valid.
We asked 14 government-accredited clinical trial centers to recommend their most experienced CRCs who were good at communication and self-expression which are required characteristics for DACUM committee. To select committee members, gender, geographic representation, and years of experience are also considered. We considered geographic representation. At the time of selection, there was no male CRC. Therefore all of the committee members were female. The location where the CRCs were affiliated was Seoul, Gyeonggi, Chungcheong, and Kyungsang areas. The most experienced CRC was selected on the assumption that "the skilled workers are best able to describe the competencies needed to perform their work (Norton, 1997)." Finally eight CRCs coming from 8 out of 14 centers participated as DACUM committee.
DACUM job analysis was performed through a workshop for deriving CRCs' duties and tasks. For the workshop, we notified the 8 CRCs of the schedule, location, and programs of the workshop in advance so that none of them would be late on the day of workshop.
Two DACUM facilitators and two DACUM coordinators who would assist analysis conducted the DACUM job analysis workshop for 7 hours excluding orientation, icebreaking, and break time. Total time of workshop was 10 hours. Two day-workshop is desirable, but the workshop was done in a day because of special circumstances of this study. Due to the characteristics of tasks, employment type, and geographic location, the CRCs selected in the committee could not have two days off in a row at the job. The facilitators have the certificates of DACUM analysis and had experience on job analysis using DACUM. They analyzed seven special areas of nursing previously and published several articles based on the results. It is not mandatory for a DACUM coordinator, but the coordinators in this study have the Systematic Curriculum and Instructional Development (SCID) certificates. According to the procedure of DACUM, a DACUM facilitator provided the CRCs with an orientation on DACUM job analysis and obtained written consents from the participants. Led by the DACUM facilitator, the participants were made clear of the job definition of CRCs, analyzed and named their duties and tasks, revised and supplemented the analyzed tasks through crosschecking with duties, and determining the ranking the duties and tasks. The role of coordinators were assisting facilitators by recording duties and tasks or making the DACUM chart. In this process, we complied following principles. First, the participants should be treated equally despite position and age in order to feel free to participate. Second, the workshop was held in a comfort atmosphere. Third, the DACUM committee members should not use references. Fourth, the duties and tasks should be recorded and organized only after the members agreed through discussions. Through the DACUM job analysis workshop, 12 duties and 74 tasks were obtained.
Job definitions, duties and tasks of CRCs derived through the DACUM job analysis workshop were reviewed in another workshop of advisory committee members for adequacy, redundancy and mutual exclusiveness of each item, and a questionnaire was prepared based on the results. We asked 14 government-accredited clinical trial centers again to recommend experienced CRCs other than those who participated as DACUM workshop committee. The selection criteria for the second committee members were same as those for the first committee except years of experience. Their years of experience were from 3 to 10 years because we need to have opinions from CRCs with various points of views. Ten CRCs agreed to participate in this validation process. We sent the questionnaire, and they assessed each item on a 4-point Likert scale (highly valid, valid, not valid, or not valid at all). Based on the results of the survey, we revised and supplemented items of which the descriptions are ambiguous, and then revised into 12 duties and 83 tasks as CRCs' jobs.
The 12 duties and 83 tasks obtained in the 1st validation were validated again with 21 CRCs, 5 researchers, and 2 clinical research associates (CRAs). Then we finally referred the duties and tasks to an officer of the Korea Food and Drug Administration (KFDA) to check whether there is any legal issue on duties and tasks of CRC. As a result, 12 duties and 78 tasks were deducted.
We prepared a self-reporting questionnaire to check the importance, difficulty and frequency of the 12 duties and 78 tasks obtained through the 2nd validation on a 3-point scale (A-3 point, B-2 point, and C-1 point).
The target population was all CRCs in Korea, and 300 of them were selected through convenient sampling in consideration of representativeness. Calculated sample size was 239 based on the population size of 2,000; the confidence level was 95%; and the margin of error was 5% (Bartlett, Kotrlik, & Higgins, 2001). To consider missing rate, the final sample size was decided to be 300. The questionnaire was sent to the subjects by mail. Of the subject CRCs, 98.6% were female, 45.7% were in their 20s, and 57.0% were college graduates. In addition, 55% of the CRCs were working at clinical trial centers, 25.4% at clinical departments, and 16.7% at research centers. As for their experience as a CRCs, 62.9% of them had 1-5 year experience. As to employment status, 11.7% were permanent staff and 88.3% were contract-based staff.
Collected data were analyzed with SPSS-Win 18. Excluding those answered inadequately, we analyzed a total of 282 questionnaires. Means and standard deviations were calculated for the importance, difficulty and frequency of duties and tasks. In addition, a DACUM chart that shows CRCs' job definition, duties and tasks was prepared. The DACUM chart presented tasks for each duty, and for each task, the mean values of importance, difficulty and frequency were marked as A (high), B (average) or C (low). Lastly, in order to identify important tasks, we obtained the determinant coefficient by multiplying the means of importance and difficulty. A possible range of determinant coefficient is 1 to 9. The higher the number, the more important and difficult the task is.
The job definition of a CRC derived from DACUM job analysis was 'one who coordinates and performs tasks related to clinical research/trials among investigator, participants and sponsors according to the Good Clinical Practice at institutions conducting clinical trials,' and 12 duties and 78 tasks were deduced. Three tasks including direct nursing care in the duty of pariticipants management, complying standard operational procedures (SOP) and GCP in the duty of management of SOP, and mentoring new CRC member in the duty of self-improvement were removed by second validation from 21 CRCs, 5 researchers, and 2 CRAs. Two tasks such as identifying adverse reactions via history taking and physical assessment in the duty of subject management and constituting the persons in charge according to task assignment in the duty of plans for clinical trial were eliminated based on the view of legal perspectives from the officer in the KFDA.
CRCs' task sheet (DACUM chart) is a table showing the job definition, duties and tasks decided from DACUM job analysis (Figure 1). Each task is marked as A, B or C according to the mean values of importance, difficulty and frequency.
Among the tasks, 13 were A's in importance, difficulty, and frequency. These were 'Explaining informed consent,' 'Confirming the participant's eligibility for the research,' 'Performing the planned study procedures according to participant's visiting schedule,' 'Administrating the investigational product to the participants,' 'Educating guidance on complying with protocol,' 'Educating on adverse events,' 'Reviewing the study protocol,' 'Discussing with the investigator,' 'Cooperating with the sponsor,' 'Completing the case report forms,' 'Ensuring accuracy of the clinical study data,' 'Resolving data queries,' and 'Cooperating to report adverse events.'
On the other hand, 13 tasks were C's in importance, difficulty and frequency. These were 'Educating involved personnel in other departments for the study,' 'Distributing and discarding SOPs to the involved departments,' 'Keeping all of the original SOPs,' 'Identifying any deviation from SOPs,' 'Discussing/confirming the period of study document preservation,' 'requesting archive of clinical study documents,' 'Making document registers,' 'Requesting the copy of radiological imaging,' 'Requesting the transfer of radiological imaging,' 'Confirming the adequacy of research facilities,' 'Confirming whether to control the preciseness of data collection equipment and instruments,' 'Inventory management of study materials,' and 'Purchasing and managing emergency instruments/kits.'
Among the duties, the determinant coefficient was the highest in 'Administrative work for research review/supervision organization,' which was followed by 'Participnats management,' 'Data management,' and 'Self-improvement.' In addition, the determinant coefficient was the lowest in 'Management of research facilities and materials,' which was followed by 'Document management,' and 'Management of research-related specimens and tests' (Table 1). As to difference between the highest and lowest determinant coefficients of tasks within each duty, the difference was largest in 'participant management' and smallest in 'research budget management' (Table 1).
Most of the 10 tasks highest in terms of determinant coefficient were related to duties 'Participant management' and 'Administrative work for study review/supervision organization.' The task with the highest determinant coefficient was 'Confirming the Participant's eligibility for the research' in duty 'Participant management,' which was followed by 'Explaining the informed consent: clinical study process only' in duty 'Participant management' (Table 2).
On the contrary, the 10 tasks lowest in terms of determinant coefficient belonged to duties 'Management of research facilities and materials,' 'Participant management,' 'Management of research-related specimens and tests,' 'Document management,' and 'Management of Standard operational procedure.' Among them, 'Inventory management for clinical study materials' had the lowest determinant coefficient, which was followed by 'Paying clinical study-related compensation to participants,' 'Requesting the transfer of radiological imaging,' 'Requesting clinical study materials,' and 'Requesting the copy of radiological imaging' (Table 3).
In general, a CRC is defined as one who supports and operates clinical trials and works with responsibilities for the coordination and performance of clinical research/trials according to the principles of GCP under the supervision of senior researchers (Spilsbury et al., 2008). In the results of this study, a CRC was defined as 'one who coordinates and performs tasks related to clinical research/trials among investigator, participnats and sponsors according to the principles of GCP at institutions conducting clinical trials.' Through this study, we defined the basic roles of CRCs clearly, which are supporting the adequate performance of clinical trials and the acquisition of high-quality data by observing the principles of GCP (Rico-Villademoros et al., 2004). Moreover, our definition reflected those related to CRCs' roles such as researchers, participants and sponsors, so it is considered to include the specificity of relations. In addition, suggested CRCs' roles are largely divided into educator, mediator/resource, researcher, and clinical specialist (Dawson, & Benson, 1997), but this study clarified and described CRCs' roles as a coordinator.
This study concluded 12 duties as well as 78 tasks under the duties through systematic classification. In contrast, Kang, Kim, Jeong and Baik (2004) suggested 19 jobs of research nurses, which were filling case report forms (CRFs), contacting researchers/sponsors, screening participants, preparing research-related supplies, observing and reporting adverse events, holding and attending preliminary research meetings, educating participants and obtaining informed consents, collecting research data, managing contact information and schedules for participants, reviewing research plans and CRFs, scheduling research, etc. Moreover, Hwang (2008) suggested a total of 61 detailed tasks in 6 areas of jobs (administrative job, practical job, monitoring job, research-related job, education and counseling job, and advocating and coordination job) performed by research nurses working for oncologic clinical trials. These results of previous studies are different from the job classification criteria and structure suggested in this study. The reasons for the difference may be found in several factors including the purpose of job analysis, analysis method, and the researcher's idea. While previous studies surveyed research nurses using questionnaires prepared by the researchers based on literature on CRC jobs (Hwang, 2008; Kang, Kim, Jeong, & Baik, 2004), this study developed the questionnaire from experienced field CRCs with representativeness using the DACUM job analysis method on the assumption that those with rich practical experiences would be most familiar with their job. Accordingly, the results of this study are believed to suggest more comprehensive and specific CRC roles than the previous studies mentioned above. The consequent duties and tasks were validated twice as an effort to suggest the most valid CRC jobs in Korea.
In the results of this study, the duty with the highest determinant coefficient was 'administrative work for research review/supervision organization,' and the task with the highest determinant coefficient was 'Confirming the participant's eligibility for research.' Tasks included in 'administrative work for study review/supervision organization' were about review/supervision related to the adequate performance of research by higher administrative authorizes. These results confirm that the job that CRC regards as most important and difficult is being reviewed and supervised by supervisory authorizes.
In case of research nurses in foreign countries, the importance of GCP and ethics was highest, which was followed by connection to and support from other research nurses, informed consent, research method, and practical skills, and on the contrary, the importance of research and development was lowest, which was followed by research fund management, data management, patient advocating, side effects, data protection, etc. (Hill & MacArthur, 2006). In contrast, jobs considered important by Korean research nurses were filling CRFs (87.0%), contacting researchers/sponsors (84.4%), screening participants (81.8%), preparing research-related supplies (79.2%), and observing and reporting adverse events (79.2%) in order of importance (Kang, Kim, Jeong, & Baik, 2004). In our study, the most important and difficult tasks were confirming the participnat's eligibility and explaining the informed consent, and this result was consistent with the report of Kang, Kim, Jeong, and Baik (2004) that subject screening was the most important and difficult. The research of Hwang (2008) on research nurses working for oncologic clinical trials reported similar results, confirming the importance of participant management. In this study, on the other hand, inventory management for clinical study materials was the tasks showing the lowest determinant coefficient. This is probably because this task is supportive to clinical research and can be done by other personnel authorized by CRCs. In the research of Hwang as well, administrative work was least important among 6 areas, supporting our results.
As presented above, the determinant coefficient of a duty did not match exactly with the determinant coefficients of tasks under the duty but was correlated to the sum of the determinant coefficients of tasks. Therefore, it is meaningful to examine tasks for which importance, difficulty and frequency were rated grade A, B or C. Among the tasks, 13 were A in importance, difficulty and frequency, 8 were B, and 13 were C. Many of the A-grade tasks belonged to the category of participant management, including tasks explaining the informed consent, confirming the participant's eligibility, performing the planned clinical study procedures according to participant's visiting schedule, and administrating investigational product. This suggests that participant management is the core of clinical research. Because nurses have the most desirable background to be a CRC, many nurses are working as CRCs, and in this situation, it has been reported that there is a high redundancy between nurses' jobs and CRCs' roles (Raja-Jones, 2002). However, it is more valid to think that only nurses can properly carry out CRCs' job, which demands a lot of time to be spent with participants. In addition, duties such as standard operational procedure management, document management, and the management of research-related specimens and tests were considered relatively less important, less difficult and frequent. This may reflect the current situation that although standard operational procedure management and document management are high-level CRCs' jobs, most of CRCs are too busy to cover such jobs.
The duties and roles of CRC are not solidly established yet in Korea and the contents and time of CRC education program are various depending on the institutions which provide the program. To improve the quality of CRCs, it is necessary to introduce systematic curriculum and certification system. To do this, it is essential to perform job analysis. The significance of this job analysis study is to identify duties of CRC and prepare the evidence to develop a standardized curriculum. In addition, the importance, difficulty, and frequency identified through this study can be utilized to separate the contents for the advanced course. For example, the contents for the basic course can include the tasks with low degree of difficulty and high degree of frequency such as scheduling as date of hospital visits, educating for the targeted research disease, collecting the source data, organizing an investigator's file, collecting specimen, etc. The tasks with high degree of difficulty and low degree of frequency such as budgeting for clinical study, developing SOPs, reviewing and revising the SOPs, and organizing data for the clinical study report should be included in the advanced course. These phased education programs can help CRCs prepare their duties and assign duties to CRCs according to their preparation. This can be also decrease new CRCs' frustration and increase experienced CRCs' self-esteem. To get recognition of CRC's role and ladder system externally as well as internally, national certification system, especially graded certification system, is necessary. The job analysis from our study can be evidential basis to help to develop evaluation standards.
In this study, we found very trivial tasks that CRCs perform which can reduce CRC's self-esteem. As CRCs perceived management of research-related specimens and tests to be a miscellaneous job, it can be adjust by delegating the job such as using assistants for those works and assigning CRCs only for duties purely related to research. That is, we need to clarify the boundary of CRCs' roles and ease their burden through finding methods to transfer tasks rated C in all of importance, difficulty and frequency to other personnel or departments.
To prevent CRCs from feeling conflicted and burdened in carrying out their roles, we need to develop and operate systematic education programs and establish systematic CRC employment conditions through the introduction of a certification system. To do this, the government, universities and industries should make joint efforts to reflect and apply the contents of KGCP in the field. Furthermore, future research needs to derive CRC roles through agreement between CRCs and clinical research associates and senior researchers whose jobs are closely connected to CRCs' roles.
In this study, the roles of CRCs were defined using the DCUM job analysis method. After CRCs' job was defined and their duties and tasks were derived through DACUM job analysis, the duties and tasks were validated twice and finally, 12 duties and 78 tasks were obtained. For CRCs, the most important, difficult and frequent duties were participant management and research review/supervision organization administrative work, and the least important, difficult and frequent one was the management of research facilities and materials.
This study suggests that it be required the phased education programs considering frequency, difficulty, and importance. In addition, graded certification system through national examination may be needed. The results of this study also suggest that CRCs are experiencing strains from various duties and tasks. Thus, it is necessary to adjust their roles, focusing on those that CRCs consider most important. In addition, research assistants may be utilized or inessential jobs should be transferred to other departments so that CRCs are able to concentrate on essential jobs for clinical research. Based on the results of this study, furthermore, we need to inform researchers and sponsors on CRCs' roles so that they share the same understanding of CRCs' roles.
Figures and Tables
Table 1
DC=Determinant coefficient; KFDA=Korea Food & Drug Administration; PFT=Pulmonary function test; IVRS=Interative voice response system;
e-CRF=Electronic case report form; CRF=Case report form; SOPs=Standard operating procedures.
EKG=Elctrocardiogram; IRB=Institutional review board; KFDA=Korea Food & Drug Administration; SAE=Serious adverse event.
References
1. Bartlett JE, Kotrlik JW, Higgins CC. Organizational research: Determining appropriate sample size in survey research appropriate sample size in survey research. Inf Technol Learn Perform J. 2001. 19(1):43–50.
2. Byun SJ, Kim HK, Kim AR, Ha HS, Joen KO. Task analysis of Korean transplantation nurse practitioner. J Korean Acad Nurs. 2003. 33:179–188.
3. Cooper D, Aherne M, Pereira J. The competencies required by professional hospice palliative care spiritual care providers. J Palliat Med. 2010. 13:869–875. http://dx.doi.org/10.1089/jpm.2009.0429.
4. Dawson JA, Benson S. Clinical nurse consultants: Defining the role. Clin Nurse Spec. 1997. 11:250–254. http://dx.doi.org/10.1097/00002800-199711000-00009.
5. DeOnna J. DACUM: A versatile competency-based framework for staff development. J Nurses Staff Dev. 2002. 18:5–11.
6. Hill G, MacArthur J. Professional issues associated with the role of the research nurse. Nurs Stand. 2006. 20(39):41–47.
7. Hwang YS. Job analysis of clinical research nurse in oncology department. 2008. Seoul: Yonsei University;Unpublished Master's thesis.
8. Kang HS. Strategies of competitiveness strength for clinical research coordinator thorough their better position and treatment. Paper presented at meeting of the Korea National Enterprise Clinical Trials. 2010. 07. Seoul.
9. Kang HS, Kim WO, Jeong IS, Baik JM. The working conditions and clinical trial practice of research nurses. Clin Nurs Res. 2004. 9:42–55.
10. Kang HS, Kim WO, Jeong IS, Choung SY, Shin SG. Developing the infrastructure for clinical trial in Korea. J Korean Soc Clin Pharmacol Ther. 2004. 12:147–162.
11. Kim PO. DACUM Handbook. Institute of research in technology education. 2006. Daejeon: Chungnam University Publisher.
12. Kim KS, Park YH, Lim NY. Task analysis of the job description of gerontological nurse practitioners based on DACUM. J Korean Acad Nurs. 2008. 38:853–865. http://dx.doi.org/10.4040/jkan.2008.38.6.853.
13. Levine EL, Ash RA, Hall H, Sistrunk F. Evaluation of job analysis methods by experienced job analysts. Acad Manage J. 1983. 26:339–348. http://dx.doi.org/10.2307/255981.
14. Norton RE. DACUM handbook. 1997. 2nd ed. Columbus, OH: Ohio State University.
15. Norton RE. Competency-based education via the DACUM and SCID process: An overview. 2008. Retrieved Jun 20, 2011. from http://www.unevoc.unesco.org/e-forum/CBE_DACUM_SCID%20article(2).pdf.
16. Oh PJ, Kim IO, Kim YH, Shin SR, Lee KS, Han SJ. Task analysis of Korean geriatric care managers. J Korean Acad Nurs. 2006. 36:770–781.
17. Oliver JD, Hill RK. The vocational-technical education consortium of states. J Am Assoc Teach Educ Agric. 1974. 15(2):4–8.
18. Park MS. Current performance and plan of clinical trials training academy. Paper presented at meeting of the Korea National Enterprise Clinical Trials. 2010. 07. Seoul.
19. Pelke S, Easa D. The role of the clinical research coordinator in multicenter clinical trials. J Obstet Gynecol Neonatal Nurs. 1997. 26:279–285. http://dx.doi.org/10.1111/j.1552-6909.1997.tb02143.x.
20. Poston RD, Buescher CR. The essential role of the clinical research nurse (CRN). Urol Nurs. 2010. 30:55–63. 77
21. Raja-Jones H. Role boundaries-research nurse or clinical nurse specialist? A literature review. J Clin Nurs. 2002. 11:415–420. http://dx.doi.org/10.1046/j.1365-2702.2002.00597.x.
22. Rico-Villademoros F, Hernando T, Sanz J, Lopez-Alonso A, Salamanca O, Camps C, et al. The role of the clinical research coordinator- data manager-in oncology clinical trials. BMC Med Res Methodol. 2004. 4:6. http://dx.doi.org/10.1186/1471-2288-4-6.
23. Sherrill WW, Keels-Williams F. Mapping competencies for the multiskilled health care professional: An allied health curriculum reform project. J Allied Health. 2005. 34:185–191.
24. Shin SJ, Choi KS, Jeong SG, Kim SG, Park HK, Seok JE. A job analysis of care helpers. J Educ Eval Health Prof. 2012. 9:2. http://dx.doi.org/10.3352/jeehp.2012.9.2.
25. Spilsbury K, Petherick E, Cullum N, Nelson A, Nixon J, Mason S. The role and potential contribution of clinical research nurses to clinical trials. J Clin Nurs. 2008. 17:549–557. http://dx.doi.org/10.1111/j.1365-2702.2006.01872.x.
26. Stevenson TL, Hornsby LB, Phillippe HM, Kelley K, McDonough S. A quality improvement course review of advanced pharmacy practice experiences. Am J Pharm Educ. 2011. 75:116. http://dx.doi.org/10.5688/ajpe756116.