Abstract
Background
National reference standards for anti-HIV-1 antibody are needed to evaluate the performance and maintain the quality control of anti-HIV-1 antibody assays. The aim of this study was to prepare a mixed-titer performance panel and assess its suitability as a national reference standard for anti-HIV-1 antibody according to stability, collaboration, and other studies.
Methods
Nineteen serum samples from different HIV patients were obtained, along with 15 units of fresh frozen plasma samples with negative anti-HIV-1 antibody results. Ten anti- HIV-1 antibody-positive candidate standards and two negative candidate standards were prepared based on the reactivity in the Alinity i HIV Ag/Ab combo assay (Abbott Laboratories, Wiesbaden, Germany). A collaborative study was conducted across eight laboratories using five anti-HIV-1 antibody assays. Real-time and accelerated stability were evaluated to assess the long-term stability.
Results
In the collaborative study, results of all five anti-HIV-1 antibody assays were positive for all 10 candidate standards prepared using HIV patient samples. The CV of each assay for every candidate standard was within 10%, except for one assay result. No real-time and accelerated stability change trend was observed at −70°C or −20°C, supporting that the reference standards were maintained in a stable state at −70°C for long-term storage.
According to a WHO report, approximately 37.7 million people were living with HIV worldwide in 2020, with an estimated 680,000 deaths [1]. In Korea, the incidence of HIV infection has increased steadily since 1985, when the first two cases of HIV infection were diagnosed [2]. More than 1,000 cases have been reported annually over the last eight years. According to the Korea Centers for Disease Control and Prevention, there were 1,016 new HIV infection cases in 2020 [2].
Detection of HIV-infected blood is one of the most critical in vitro diagnostic (IVD) screening assays performed for donated blood. Many Korean companies have developed anti-HIV-1 antibody assay devices. Approximately 13% (79/590) of the laboratories participating in external quality assessments for anti-HIV-1 antibody detection use assay devices manufactured in Korea [3]. National reference standards for anti-HIV-1 antibody are needed to evaluate the performance and maintain quality control of IVD assays. The first national reference standard for anti-HIV-1 antibody (Anti-HIV 1, Mixed Titer Performance Panel, code number: 12/038) was established and distributed in 2012 [4]. As all of these first standards have been used with none remaining, we prepared a new mixed-titer performance panel for anti-HIV-1 antibody, which required validation as a candidate national reference standard [5, 6].
This study aimed to assess the suitability of the new mixed-titer performance panel as a national reference standard through the precision of fill, homogeneity, and stability, along with a collaborative study design. These results could establish the second Korean national reference standard for anti-HIV-1 antibody to replace the depleted first standard.
Nineteen serum samples with volumes between 100 mL and 200 mL, obtained from different HIV-infected patients, were provided by the High-Risk Human Serum Bank of Chung-Ang University. Fifteen units of fresh frozen plasma samples with negative anti-HIV-1 antibody assay results were obtained from Chung-Ang University Hospital Blood Center. This two-year retrospective study was approved by the Institutional Review Board of Dongguk University Ilsan Hospital, Korea (DUIH 2019-02-023). Because the samples were collected from the High-Risk Human Serum Bank and Blood Center, informed consent for use of samples from patients and blood donors was waived by the ethics committee of our hospital.
To select suitable materials as candidate standards, samples were screened for anti-HIV-1 antibody with the Alinity i HIV Ag/Ab combo (Alinity i, Abbott Laboratories, Wiesbaden, Germany), HIV combi PT (cobas e601, Roche Diagnostics GmbH, Penzberg, Germany), and SD Bioline HIV 1/2 3.0 (SD, Yongin, Korea) devices, as the three most commonly used assays. Ten samples with positivity in all three screening assays and sufficient volumes (>130 mL) were selected as the candidate standards. The Alinity i HIV Ag/Ab combo was used to select samples with various concentrations. Two negative standards were selected.
Thawed serum samples that had been stored at −70°C were filtered through 0.22-µm micropore vacuum filters (500 mL Vacuum Filter/Storage system, Corning, NY, USA). Bronidox (0.05% final concentration; Sigma-Aldrich, St. Louis, MO, USA) was then added to each sample.
Plasma samples were converted into serum samples using a defibrination procedure with some modifications [7]. CaCl2 was added to the plasma for seroconversion. After continuous mixing for 12–18 hours at 4°C with the aid of magnetic bars, centrifugation was performed at 3,000 g for 30 minutes at 4°C. The upper layer was collected. Fibrin was removed through filtration with a 0.22-µm micropore vacuum filter. The serum was frozen at −70°C, thawed in a 4°C refrigerator, and centrifuged at 3,000 g for 30 minutes at 4°C to collect the supernatant. Bronidox (0.05% final concentration) was then added to each serum sample.
The candidate standards were stored at −70°C in screw-cap microtubes (Sarstedt, Numbrecht, Germany) at 500 µL/tube. Prior to storage, candidate standards were tested for known blood-borne virus markers, including the Alinity i HBsAg (Abbott Laboratories) and Alinity i Anti-HCV (Abbott Laboratories) assays. The presence of anti-HIV-1 antibodies was confirmed using western blot assay (HIV BLOT 2.2; MP Biomedicals, Solon, OH, USA).
Ten microtubes were randomly selected from each of the 12 candidate standards and weighed before and after filling to check the variation in the amount filled into each tube. A CV of <1% for a tube with an expected 500-µL volume was considered to be acceptable according to WHO guidelines [6].
Between-unit homogeneity was assessed for 10 tubes (the minimum number for a simple randomized design) selected from each of the 12 candidate standards. The samples were tested in triplicate in random order on a single run. Between-unit standard deviations were calculated using one-way ANOVA. The F-test was used to determine whether between-unit deviations were significant at a 95% probability level according to the ISO35 guidelines [5].
Eight laboratories with certification in laboratory excellence were selected to participate in this collaborative study. Two sets of 12 candidate standards coded as mixed-titer performance panels (MP/1 to MP/12) were mailed to these laboratories. Each laboratory performed one or more of the five most commonly used anti-HIV-1 antibody assays in Korea (Table 1). Each assay was conducted in a total of three laboratories. The first set of candidate standards was assayed in duplicate on the first day of the study, and the second set was assayed in duplicate on the second day.
For the four assays (Abbott Alinity i, Roche cobas e, Siemens ADVIA Centaur XPT, and BioMérieux Vidas) that were qualitative but displayed numerical values (e.g., the Alinity i HIV Ag/Ab combo assay provides the sample to cut-off index ratio [S/CO] value), the overall mean estimate for each assay was calculated as the mean of all six datasets from three individual laboratories. The CVs of the means of the six datasets were also calculated.
Real-time and accelerated stability of the panel were evaluated to assess the long-term stability. Real-time stability was examined at −70°C for 0, 3, 6, 9, and 12 months. At a given time point, tubes were tested using the Alinity i HIV combo assay in triplicate. The recovery rate was calculated at each time point and compared to that at time point 0. After linear regression assumptions were confirmed, Microsoft Excel (Microsoft, Redmond, WA, USA) was used to calculate the slope P-value.
The accelerated stability was examined at −20°C, 4°C, 24°C, and 37°C for 0, 7, 14, 21, and 28 days. At a given time point, tubes were placed at −70°C. All tubes were then subject to the Alinity i HIV combo assay simultaneously in triplicate on the final day (28 days after storage). The recovery rate compared to time point 0 was calculated for each temperature. The log transformation of the typical first-order degradation kinetics was assumed as the instability model. The Arrhenius equation was applied to the resulting data to predict the stability duration of each candidate standard. After linear regression assumptions were confirmed, t-tests for slopes that were significantly different from zero were performed using Microsoft Excel. Microsoft Excel was also used to calculate the degradation rate constant (k) and other parameters according to the CLSI EP25 and ISO35 guidelines [5, 8].
The results of the three screening assays and the western blot assay for the selected 12 candidate reference standards are presented in Table 2. All candidate standards, except for the two negative candidate standards, were positive in the western blot assay. The standards showed varying results in the Alinity i assay according to the S/CO ratio.
The CV on a 500-µL fill was 0.56%, which was within the acceptable range. CVs of the between-unit homogeneity evaluation of the 12 candidate standards ranged from 0.0% to 1.1%. The F-test showed no significant between-unit heterogeneity (P≥0.05).
All five assays performed by the eight laboratories in the collaborative study were qualitative assays for anti-HIV-1 antibody. The results reported by participating laboratories for every positive candidate standard (MP/01–05, MP/07–11) were positive, and those for negative candidate standards (MP/06, MP/12) were negative. For the four qualitative assays that showed numerical values, the overall mean estimates and CVs were calculated. Aside from the ADVIA Centaur XPT assay, all CVs of 10 positive candidate standards were <10% (Table 3).
There was no significant difference in the results of assays performed for 12 months from the 0-month results (Fig. 1). The recovery rate was 90%–110%. Student’s t-test for the regression slope of each candidate standard showed ]that the slope was not significantly different from zero (P≥0.05), indicating that the stability was maintained for 12 months.
All candidate standards stored at −20°C showed a recovery rate of 95%–105%, indicating no stability reduction after cold storage for 28 days (Table 4). At 37°C, the recovery rate was the highest at 1 week, which then gradually decreased, suggesting denaturation of the antibody. The resulting slope, estimated by linear regression over time, provided the degradation rate constant (k) (Table 4). For MP/1, the stability duration calculated using first-order degradation kinetics and the Arrhenius equation was 5,759 days. For the other candidate standards, two or fewer slopes of the regression for the four temperature conditions were significantly different from zero. This prevented calculating the exact degradation rate constant (k) at the planned storage temperature or the stability duration using the Arrhenius equation.
The WHO is the main organization establishing international biological reference standards that are widely used in the development, evaluation, standardization, and control of products in the medical industry [6]. The WHO recommends preparing and establishing national reference standards owing to the limited availability of international standards [6]. The Korean IVD reference standards were established in 2012 by the Ministry of Food and Drug Safety (MFDS) [9]. The first national reference standards for anti-HIV-1 antibody (MP panel) were prepared and distributed as of 2012, which have now been depleted. In this study, serum samples were obtained from HIV-infected patients to establish new national reference standards for anti-HIV-1 antibody. Ten candidate reference standards were selected based on the positive results of three screening assays, and two candidate standards with negative results in the three screening assays were selected.
Evaluating between-unit homogeneity is important to confirm that each tube has the same quantity of anti-HIV-1 antibody. We confirmed that the variation between tubes was sufficiently small for the candidate reference standards.
The laboratories participating in this collaborative study performed one or more of the five quantitative assays. The results reported by the laboratories for positive candidate standards (MP/01–05, MP/07–11) agreed with the known positivity, and the results for the negative candidate standards (MP/06, MP/12) agreed with the known negativity status. Different assays showed different numerical results for the four qualitative assays with numerical values. Except for ADVIA Centaur XPT, all CVs of the 10 positive candidate standards were <10%. Because the WHO anti-HIV-1 antibody international reference standard is not designated in the form of international units, internationally used HIV antibody assay devices are qualitative assays [10, 11]. The aim of this multi-center collaborative study was not to assign specific values (property values) of candidate standards but rather to confirm the presence of anti-HIV-1 antibody and measure the values of candidate standards using different assays.
According to ISO35 guidelines, when no degradation is found at least 20°C above the planned storage temperature, the degradation rate under planned storage conditions may be assumed to be negligible, subject to confirmation by appropriate monitoring arrangements [5]. Our accelerated stability study results indicated that all candidate standards were stable after storage at −20°C for 1 month. The stability duration of MP/1, for which the typical Arrhenius model could be applied, was 5,759 days. We also determined that these candidate standards were stable at our planned storage temperature of −70°C. We recommend that these reference standards be monitored once a year according to the MFDS guidelines. This is the first report of an accelerated study aimed at applying the Arrhenius equation to Korean IVD reference standards. Previous data for WHO international standards showed stability but without using the Arrhenius model [12], or that it is impossible to use the Arrhenius model because there is no observed drop in the potency of standards [13, 14]. Real-time stability studies on national reference standards should be regularly conducted to ensure quality [15]. Our real-time stability study confirmed that the candidate standards remained stable for 1 year.
In conclusion, we successfully established 12 national reference standards for anti-HIV-1 antibody. The 12 candidate national reference standards presented consistent results across laboratories using five assays and exhibited stability under long-term frozen storage. These candidate standards can be used as a national reference panel for anti-HIV-1 antibody.
Notes
AUTHOR CONTRIBUTIONS
Huh HJ conceived and designed this study and conducted the experiments. Chae SL and Cha YJ supervised the study. Kim SK and Chung JW analyzed the data. Huh HJ prepared the initial draft. Yoo SJ, Roh KH, Chae SL, and Cha YJ reviewed and revised the initial draft. All authors read and approved the final draft.
REFERENCES
1. WHO. Latest HIV estimates and updates on HIV policies uptake 2021. https://cdn.who.int/media/docs/default-source/hq-hiv-hepatitis-and-stis-library/2021_global_summary_web_v32.pdf?sfvrsn=4b8815ad_30. Updated on Mar 2022.
2. Korea Disease Control and Prevention Agency. Annual report on the notified HIV/AIDS in Korea 2020. http://www.kdca.go.kr/filepath/boardDownload.es?bid=0031&list_no=717120&seq=1. Updated on Mar 2022.
3. Korean Association of External Quality Assessment Service. Annual report on external quality assessment 2021. https://keqas.org/. Updated on Mar 2022.
4. List of Ministry of Food and Drug Safety Reference Standards. http://www.nifds.go.kr/brd/m_212/view.do?seq=18700&srchFr=&srchTo=&srchWord=&srchTp=&itm_seq_1=0&itm_seq_2=0&multi_itm_seq=0& company_cd=&company_nm=&page=6. Updated on Sep 2022.
5. ISO. 2017. ISO Guide 35:2017. Reference materials-Guidance for characterization and assessment of homogeneity and stability. International Organization for Standardization;Switzerland: https://www.iso.org/standard/60281.html. Updated on Sep 2022.
6. WHO. 2006. Recommendations for the preparation, characterization and establishment of international and other biological reference standards (revised 2004). Technical Report Series; No. 932, Annex 2. World Health Organization;Switzerland: https://www.who.int/publications/m/item/annex2-trs932. Updated on Sep 2022.
7. Castro AR, Kikkert SE, Fears MB, Pope V. 2002; Defibrination of blood plasma for use in serological tests for syphilis. Clin Diagn Lab Immunol. 9:1376–8. DOI: 10.1128/CDLI.9.6.1376-1378.2002. PMID: 12414778. PMCID: PMC130115.
8. CLSI. 2009. Evaluation of stability of in vitro diagnostic reagents; approved guideline. CLSI EP25-A. Clinical and Laboratory Standards Institute;Wayne, PA:
9. Korean Ministry of Food and Drug Safety. Guidebook on Ministry of Food and Drug Safety reference standards, 2022. https://www.nifds.go.kr/brd/m_212/view.do?seq=33133&srchFr=&srchTo=&srchWord=&srchTp=&itm_seq_1=0&itm_seq_2=0&multi_itm_seq=0&company_cd=&company_nm=&page=4. Updated on Sep 2022.
10. Stone M, Bainbridge J, Sanchez AM, Keating SM, Pappas A, Rountree W, et al. 2018; Comparison of detection limits of fourth- and fifth-generation combination HIV antigen-antibody, p24 antigen, and viral load assays on diverse HIV isolates. J Clin Microbiol. 56:e02045–17. DOI: 10.1128/JCM.02045-17. PMID: 29793968. PMCID: PMC6062817.
11. Park YH, Roh JH, Kim SY. 2022; Performance evaluation of the Aptima assays in comparison with the cobas 6800 assays for the detection of HIV-1, HBV, and HCV in clinical samples. Ann Lab Med. 42:447–56. DOI: 10.3343/alm.2022.42.4.447. PMID: 35177565. PMCID: PMC8859551.
12. Yang YC, Yang-Chih Shih D, Tsai MH, Cheng CH, Cheng HF, Lo CF, et al. 2013; A collaborative study to establish the first National Standard for HIV-1 RNA nucleic acid amplification techniques (NAT) in Taiwan. J Virol Methods. 191:122–7. DOI: 10.1016/j.jviromet.2013.04.002. PMID: 23608407.
13. World Health Organization & WHO Expert Committee on Biological Standardization. 2016. Collaborative study to evaluate the proposed WHO 4th international standard for hepatitis B virus (HBV) DNA for nucleic acid amplification technique (NAT) based assays. World Health Organization;Geneva, Switzerland: https://apps.who.int/iris/bitstream/handle/10665/253052/WHO-BS-2016.2291-eng.pdf?sequence=1&isAllowed=y. Updated on Sep 2022.
14. World Health Organization & WHO Expert Committee on Biological Standardization. WHO/BS.2020.2403. Establishment of the WHO International Standard and Reference Panel for anti-SARS-CoV-2 antibody. https://www.who.int/publications/m/item/WHO-BS-2020.2403. Updated on Nov 2022.
15. Park TJ, Choi CW, Oh HK, Kim JO, Kim BK, Kang HK, et al. 2017; Stability evaluation of national reference standards for blood products in Korea. Toxicol Res. 33:225–31. DOI: 10.5487/TR.2017.33.3.225. PMID: 28744354. PMCID: PMC5523560.
Table 1
Table 2
Reference standard | Antibody screening | Western blot | ||
---|---|---|---|---|
|
|
|||
Abbott Alinity i* (S/CO) | Roche cobas e* (COI) | SD Bioline HIV 1/2 3.0 | MP HIV BLOT 2.2 | |
MP/01 | 41.11 | 641.90 | Positive | Positive |
MP/02 | 156.54 | 829.80 | Positive | Positive |
MP/03 | 396.89 | 430.70 | Positive | Positive |
MP/04 | 609.60 | 288.40 | Positive | Positive |
MP/05 | 167.11 | 581.20 | Positive | Positive |
MP/06 | 0.07 | 0.31 | Negative | Negative |
MP/07 | 91.12 | 961.90 | Positive | Positive |
MP/08 | 121.56 | 772.80 | Positive | Positive |
MP/09 | 345.61 | 406.60 | Positive | Positive |
MP/10 | 901.91 | 897.70 | Positive | Positive |
MP/11 | 655.61 | 333.10 | Positive | Positive |
MP/12 | 0.09 | 0.28 | Negative | Negative |
Table 3
Reference standard | Abbott Alinity i* | Roche cobas e601, e602* | Siemens ADVIA Centaur XPT* | BioMérieux Vidas* | SD Bioline HIV 1/2 3.0 | ||||
---|---|---|---|---|---|---|---|---|---|
|
|
|
|
||||||
Mean (S/CO) | CV (%) | Mean (COI) | CV (%) | Mean (index) | CV (%) | Mean | CV (%) | ||
MP/01 | 40.47 | 3.9 | 581.51 | 3.2 | > 12 | 23.55 | 4.3 | Positive | |
MP/02 | 159.49 | 7.3 | 753.73 | 4.0 | > 12 | 22.04 | 4.0 | Positive | |
MP/03 | 382.58 | 4.2 | 394.37 | 3.7 | > 12 | 25.05 | 3.8 | Positive | |
MP/04 | 644.24 | 4.6 | 282.97 | 3.9 | > 12 | 21.06 | 4.6 | Positive | |
MP/05 | 153.83 | 2.7 | 556.22 | 3.7 | > 12 | 19.69 | 5.1 | Positive | |
MP/06 | 0.06 | 11.9 | 0.28 | 5.5 | < 0.05 | 0.04 | 5.7 | Negative | |
MP/07 | 93.91 | 2.8 | 888.19 | 4.8 | > 12 | 24.27 | 4.2 | Positive | |
MP/08 | 127.93 | 7.2 | 717.35 | 3.9 | > 12 | 21.62 | 4.2 | Positive | |
MP/09 | 372.38 | 7.0 | 373.48 | 5.4 | > 12 | 22.26 | 4.4 | Positive | |
MP/10 | 953.96 | 3.0 | 927.92 | 6.0 | > 12 | 25.28 | 2.8 | Positive | |
MP/11 | 683.99 | 1.5 | 269.65 | 2.8 | 5.00 | 24.0 | 24.07 | 6.3 | Positive |
MP/12 | 0.08 | 35.6 | 0.31 | 11.1 | < 0.05 | 0.04 | 8.4 | Negative |