Journal List > Korean J Lab Med > v.29(5) > 1011577

An, Chung, Lee, Lee, Chun, and Min: Analytical Performance Evaluation of Glucose Monitoring System Following ISO15197

Abstract

Background:

We have evaluated the analytical performance of SureStep Flexx (Johnson and Johnson, USA) which can report the plasma equivalent glucose test results and be connected to the hospital information networks, following ISO15197 analytic procedure for glucometer for the first time.

Methods:

Adopting the guidelines of ISO15197, we measured the precision of ten glucometers from their repeatability and intermediate precision, and determined the accuracies of the glucometer, comparing to those of GEM Premier 4000 (Instrumentation Laboratory, USA). In addition, the guidelines of CLSI EP9-A2 and EP6-A were applied to correlate between data of glucometer and those of laboratory reference method by TBA-200FR (Toshiba Medical Systems, Japan) and to examine its linearity of glucose concentrations measured by SureStep Flexx. We used the clinical specimens and commercial control materials.

Results:

Repeatabilities and intermediate precisions of those glucometers were 4.0-7.3%, and 4.3-6.2%, respectively. When glucose levels are under 75 mg/dL, the difference between results of those meters and the reference values were within ±6 mg/dL. However when glucose levels are over 75 mg/dL, those differences were within ±12.7%. These results were acceptable for the ISO15197 criteria in all glucose concentrations. The glucose concentrations showed the clinically relevant linearity in the range from 36 mg/dL to 491 mg/dL. Moreover, Error Grid Analysis showed that all glucose results were in “zone A”, which means that these values were clinically accurate.

Conclusions:

This study showed that SureStep Flexx can provide reliable results for patients and clinicians to manage the diabetes mellitus, satisfying the ISO15197 criteria.

REFERENCES

1.Welschen LM., Bloemendal E., Nijpels G., Dekker JM., Heine RJ., Stalman WA, et al. Self-monitoring of blood glucose in patients with type 2 diabetes who are not using insulin: a systematic review. Diabetes Care. 2005. 28:1510–7.
2.The International Organization for Standardization. In vitro diagnostic test systems-requirements for blood glucose monitoring systems for self-testing in managing diabetes mellitus. ISO/TC 212/SC. International Standard ISO 15197. Geneva, Switzerland: ISO. 2003.
3.Burnett RW., D'Orazio P., Fogh-Andersen N., Kuwa K., Kulpmann WR., Larsson L, et al. IFCC recommendation on reporting results for blood glucose. Clin Chim Acta. 2001. 307:205–9.
4.Beneteau-Burnat B., Pernet P., Pilon A., Latour D., Goujon S., Feuillu A, et al. Evaluation of the GEM Premier 4000: a compact blood gas CO-Oximeter and electrolyte analyzer for point-of-care and laboratory testing. Clin Chem Lab Med. 2008. 46:271–9.
crossref
5.Parkes JL., Slatin SL., Pardo S., Ginsberg BH. A new consensus error grid to evaluate the clinical significance of inaccuracies in the measurement of blood glucose. Diabetes Care. 2000. 23:1143–8.
crossref
6.Clinical and Laboratory Standards Institute. Method comparison and bias estimation using patient samples; Approved guideline-2nd ed. Document EP9-A2. Wayne, PA: Clinical and Laboratory Standards Institute;2002.
7.Clinical and Laboratory Standards Institute. Evaluation of the linearity of quantitative measurement procedures; A statistical approach; Approved guideline. Document EP6-A.Wayne, PA: Clinical and Laboratory Standards Institute;2003.
8.Medicare, Medicaid and CLIA programs; regulations implementing the Clinical Laboratory Improvement Amendments of 1988 (CLIA)-HCFA. Final rule with comment period. Fed Regist. 1992. 57:7002–186.
9.U.S. Department of Health and Human Services Food and Drug Administration Center for Devices and Radiological Health. Draft guidance for industry and FDA staff - Total product life cycle for portable invasive blood glucose monitoring systems. http://www.fda.gov/downloads/MedicalDevices/DeviceRegulationandGuidance/GuidanceDocuments/ucm071439.pdf. (updated on Oct 2006).
10.Kost GJ., Tran NK., Abad VJ., Louie RF. Evaluation of point-of-care glucose testing accuracy using locally-smoothed median absolute difference curves. Clin Chim Acta. 2008. 389:31–9.
crossref
11.Kilo C Sr., Dickey WT Jr., Joynes JO., Pinson MB., Baum JM., Parkes JL, et al. Evaluation of a new blood glucose monitoring system with auto-calibration for home and hospital bedside use. Diabetes Res Clin Pract. 2006. 74:66–74.
crossref
12.Kristensen GB., Monsen G., Skeie S., Sandberg S. Standardized evaluation of nine instruments for self-monitoring of blood glucose. Diabetes Technol Ther. 2008. 10:467–77.
crossref
13.Clinical and Laboratory Standards Institute. Evaluation of precision performance of quantitative measurement methods; Approved guide-line-2nd ed. Document EP5-A2. Wayne, PA: Clinical and Laboratory Standards Institute;2004.
14.Lee SY., Lee NY., Kim JW. Evaluation of 6 glucose testing systems. Korean J Lab Med. 2003. 23:170–9. (이수연, 이남용, 김종원. 혈당측정기6종의평가. 대한진단검사의학회지 2003;23:170-9.).
15.Yoo EH., Cho HJ., Ki CS., Lee SY. Evaluation of COSMOsensor glucose monitoring system. Korean J Lab Med. 2006. 26:1–8. (유은형, 조현정, 기창석, 이수연. 자가혈당측정기 COSMOsensor 의평가. 대한진단검사의학회지 2006;26:1-8.).
crossref
16.Kwon MJ., Lee SY. Evaluation of GLUCOCARD X-METER glucose monitoring system. Korean J Lab Med. 2008. 28:8–15. (권민정및이수연. 혈당측정기 GLUCOCARD X-METER평가. 대한진단검사의학회지. 2008;28:8-15.).
crossref
17.Singh Dhatt G., Agarwal M., Bishawi B. Evaluation of a glucose meter against analytical quality specifications for hospital use. Clin Chim Acta. 2004. 343:217–21.
crossref
18.Clinical and Laboratory Standards Institute. Point-of-care blood glucose testing in acute and chronic care facilities; Approved guideline-2nd ed. Document C30-A2. Wayne, PA: Clinical and Laboratory Standards Institute;2002.
19.Ghys T., Goedhuys W., Spincemaille K., Gorus F., Gerlo E. Plasma-equivalent glucose at the point-of-care: evaluation of Roche Accu-Chek Inform and Abbott Precision PCx glucose meters. Clin Chim Acta. 2007. 386:63–8.
crossref
20.Hoedemaekers CW., Klein Gunnewiek JM., Prinsen MA., Willems JL., Van der Hoeven JG. Accuracy of bedside glucose measurement from three glucometers in critically ill patients. Crit Care Med. 2008. 36:3062–6.
crossref
21.Kavsak PA., Zielinski N., Li D., McNamara PJ., Adeli K. Challenges of implementing point-of-care testing (POCT) glucose meters in a pediatric acute care setting. Clin Biochem. 2004. 37:811–7.
crossref
22.Park AJ., Kim HR., Lee MK. Networking experience of point-of-care test glucometer. Korean J Lab Med. 2006. 26:294–8. (박애자, 김혜련,이미경. 혈당현장검사의전산망연결경험. 대한진단검사의학회지 2006;26:294-8.).
crossref
23.Cha CH., Lee W., Lee YW., Kim YC., Kim YH., Chun S, et al. Installation of data management system for point-of-care blood gas analyzers using local area network. Korean J Lab Med. 2005. 25:471–6. (차충 환, 이우창, 이용화, 김영철, 김윤희, 전사일 등. 근거리 통신망을 이용한 혈액가스현장검사 정보관리 시스템 구축. 대한진단검사의학회지 2005;25:471-6.).

Fig. 1.
Accuracy of the SureStep Flexx compared with GEM Premier 4000 (A) Error Grid Analysis showed that all glucose measurements by SureStep Flexx were included in zone A. Dotted line represents regression analysis. Zone A represents no effect on clinical action; zone B represents altered clinical action-little or no effect on clinical outcome; zone C represents altered clinical action-likely to affect clinical outcome; zone D represents altered clinical action-could have significant medical risk; and zone E represents altered clinical action-could have dangerous consequences [5]. (B) Modified Bland-Altman plots with superimposed ISO15197 tolerance band.
kjlm-29-423f1.tif
Fig. 2.
Correlation of glucose concentrations measured by SureStep Flexx versus TBA-200FR (A) Error Grid Analysis of the SureStep Flexx glucose measurements compared with TBA-200FR. All glucose results by the SureStep Flexx were included in zone A (See Fig. 1.). Dotted line represents regression analysis. (B) Modified Bland-Altman plots with superimposed ISO15197 tolerance band.
kjlm-29-423f2.tif
Fig. 3.
Analytical measuring range of the SureStep Flexx was 36-491 mg/dL. The straight line was determined by a linear regression of the measured glucose concentrations with those of the expected glucose concentrations.
kjlm-29-423f3.tif
Table 1.
Precision of the SureStep Flexx
  Repeatability Intermediate precision
Level 1 Level 2 Level 3 Level 4 Level 5 Level 1 Level 2 Level 3
Mean (mg/dL) 34.1 85.7 135.1 189.0 353.8 34.1 139.2 373.5
SD (mg/dL) 2.5 6.1 6.1 10.6 14.0 2.1 6.0 16.8
CV (%) 7.3 7.1 4.5 5.6 4.0 6.2 4.3 4.5
Table 2.
Accuracy of the SureStep Flexx by ISO Standard Criteria
Glucose concentration of reference method <75 mg/dL ≥75 mg/dL
Interval Within±5 mg/dL Within±10 mg/dL Within±15 mg/dL Within±5% Within±10% Within±15% Within±20%
N (%) 15/16 (93.8) 16/16 (100.0) 16/16 (100.0) 49/84 (58.3) 77/84 (91.7) 84/84 (100.0) 84/84 (100.0)

Abbreviations: ISO, International Organization for Standardization.

TOOLS
Similar articles