You are here

Article Text

Article menu

Download PDFPDF

XML
Infectious diseases
Research
Comparison of an automated rapid plasma reagin (RPR) test with the conventional RPR card test in syphilis testing
  1. Jong-Han Lee1,
  2. Chae Seung Lim1,
  3. Min-Geol Lee2,
  4. Hyon-Suk Kim3
  1. 1Department of Laboratory Medicine, Korea University College of Medicine, Seoul, Korea
  2. 2Department of Dermatology, Yonsei University College of Medicine, Seoul, Korea
  3. 3Department of Laboratory Medicine, Yonsei University College of Medicine, Seoul, Korea
  1. Correspondence to Dr Hyon-Suk Kim; kimhs54{at}yuhs.ac

Abstract

Objective We compared the automated non-treponemal reagin (rapid plasma reagin (RPR)) test with the conventional RPR card test for usefulness in clinical applications.

Setting A comparative study of laboratory methods using clinical specimens in a single institute.

Participants A total of 112 serum samples including 59 Treponema pallidum particle agglutination (TPPA)-positive and 53 TPPA-negative specimens were evaluated.

Outcome measures HiSens Auto RPR LTIA (HBI, Anyang, Korea) was compared with Macro-Vue RPR Card Tests (Becton Dickinson BD Microbiology Systems, Sparks, Maryland, USA). Treponemal-specific tests were performed by Serodia TPPA assay (Fujirebio, Tokyo, Japan). The percentage agreement, κ value and overall sensitivity and specificity of the two RPR tests were compared. Seroconversion rates after treatment were also compared for each RPR test.

Results The percentage agreement between the two RPR tests was 78.6% (κ 0.565; 95% CI 0.422 to 0.709). Sensitivity and specificity of the automated RPR test relative to the TPPA test was 52.5% (95% CI 39.1% to 65.7%) and 94.3% (95% CI 84.3% to 98.8%), respectively, while the same values for the conventional RPR card test were 86.4% (95% CI 75% to 93.9%) and 94.3% (95% CI 84.3% to 98.8%), respectively. The conventional RPR card test showed overall higher positivity than the automated RPR test, whereas the automated RPR test showed higher seroconversion (43.5%, 10/23) than the conventional RPR card test (4.3%, 1/23) in treated patients.

Conclusions The automated RPR test showed overall lower sensitivity than the conventional RPR test based on the treponemal test, but higher seroconversion after treatment. The automated RPR test could be used to monitor treatment response, especially in the reverse screening algorithm in syphilis testing.

  • IMMUNOLOGY

This is an Open Access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/

https://doi.org/10.1136/bmjopen-2014-005664

Statistics from Altmetric.com

    Request Permissions

    If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

    Strengths and limitations of this study

    • Automated rapid plasma reagin (RPR) testing has been introduced in clinical laboratories, so we compared the automated test with the conventional RPR card tests.

    • The automated RPR test showed overall lower positivity than the conventional RPR test compared with the treponemal test, Treponema pallidum particle agglutination (TPPA).

    • The automated RPR test showed higher seroconversion after treatment than the conventional manual RPR test. So, the automated RPR test could be used to monitor treatment response, especially in the reverse screening algorithm for syphilis testing.

    • Limitations of this study are small sample size and the patient groups could not be accurately categorised according to the stage of the disease because of the low prevalence of syphilis in Korea.

    Introduction

    There has been a rapid decrease in positive rates for syphilis since the 1970s in Korea, consistent with the global trend. In 2000, ∼0.2% of the general Korean population was estimated to be syphilis-positive; since that time, levels appear to have decreased, and the prevalence rate is still very low.1 Despite these low rates, syphilis is an important infection because it can cause serious health problems including neurosyphilis and congenital infection. Appropriate screening, confirmation and follow-up protocols are required.2–4 Serological analysis of non-treponemal reagin tests, such as the Venereal Disease Research Laboratory (VDRL), rapid plasma reagin (RPR) and treponemal tests such as the Treponema pallidum haemagglutination assay (TPHA), the Treponema pallidum particle agglutination (TPPA) test, the fluorescent treponemal antibody absorption test, and the Treponema-specific antibody test, have been used to diagnose and monitor syphilis infections. Recently, there have been issues regarding selection of the best algorithm for initial screening and follow-up by either non-treponemal- or treponemal-specific tests.2 ,5 ,6 The Centers for Disease Control and Prevention (CDC) still recommend that a non-treponemal reagin test is used as the first-line diagnostic approach.2 Two kinds of non-treponemal test have been widely used: VDRL and RPR. RPR is the most common first-line non-treponemal test used to screen for syphilis infection.7 Recently, automated RPR tests have been introduced, but variable results were reported when the automated test was compared with conventional RPR card tests.8 The automated RPR test has some advantages over the conventional RPR card test, such as greater capacity to deal with a large number of samples, minimal person-to-person variation, and simple automated procedures.

    The aim of this study was to evaluate the possible benefits of an automated RPR test compared with a conventional RPR card test in clinical application.

    Methods

    Subjects

    All sera testing positive for syphilis by one or more tests from November 2012 to April 2013 from a university hospital were included, along with matched controls. Remnant sera from requested treponemal tests after confirmation were included and preserved at −70°C until analysis. Patients were not categorised according to syphilis stage because of the infrequency of syphilis infection. Cases of true syphilis were very rare because of the low prevalence of syphilis in this country. The aim of this study was to evaluate the same RPR tests with ethically protected remnant specimens. This case was exempted by the institutional review board. All study processes complied with the World Medical Association Declaration of Helsinki.

    The automated RPR test was compared with the manual RPR card test (Becton Dickinson BD Microbiology Systems, Sparks, Maryland, USA). A confirmatory treponemal-specific test was performed using a TPPA assay according to the manufacturer's instructions. Seroconversion rates of each non-treponemal RPR test were evaluated on 23 syphilitic patients with a medical history of syphilis treatment.

    Serological tests

    Conventional RPR card test

    The Macro-Vue RPR Card Test (Becton Dickinson BD Microbiology Systems) uses cardiolipin antigen with a carbon particle to detect reagin. Reagin binds to the test antigen, which consists of cardiolipin–lecithin–cholesterol particles, causing macroscopic flocculation. Controls were established for each test to confirm optimal reactivity of the antigen. The test procedure was followed according to the manufacturer's instructions.

    Automated RPR test

    HiSens Auto RPR LTIA (HBI, Anyang, Korea) is a latex turbidimetric immunoassay using latex particles coated with lecithin and cardiolipin. The latex particles react with the reagin in the serum of patients with syphilis. The 15 μL serum samples were allowed to react with 120 μL Hisens auto RPR LTIA R1 (buffer) and 60 μL Hisens auto RPR LTIA R2 (latex reagent containing cardiolipin–lecithin–cholesterol, 1.0 mg/mL) in a CA-400 autoanalyzer (Furuno Electric Co, Nishinomiya, Japan). The CA-400 photometric analyser was used for the automated procedure and analysis. Absorbance at 600 nm was read after 5.3 and 10 s at room temperature, in duplicate. Results of the HiSens auto RPR test equal to or greater than 1.0 RPR unit (RU) were considered to indicate reactive RPR. The upper detection limit was 20 RU.

    Treponema pallidum particle agglutination

    The Serodia TPPA assay (Fujirebio, Tokyo, Japan) is based on agglutination of coloured gelatine particles that have been sensitised (coated) with T. pallidum (Nichols strain) antigen. For each specimen, a 100 μL sample of diluent and 25 μL test specimen were mixed, and then twofold serial dilutions were made with 25 μL sample diluent. The sensitised particles were serially mixed in the neighbouring wells with a plate mixer for 30 s. After 2 h of incubation at room temperature, the result of the agglutination assay was read. The Serodia TPPA assay results were interpreted using the agglutination patterns of positive and negative controls.

    Statistical analysis

    The percentage agreement (κ coefficient) of the automated RPR test with the manual RPR card test was calculated. The overall sensitivity and specificity of each test were calculated based on the TPPA results. κ values were used to categorise results as very good (0.81–1.0), good (0.61–0.8), moderate (0.41–0.6), fair (0.21–0.4) or poor (0–0.2).9 The McNemar test was used to compare seroconversion rates between the automated RPR test and the conventional manual RPR card test and was performed using SPSS Statistics V.20. A p value <0.05 was considered significant.

    Results

    A total of 112 serum samples from 59 patients with syphilis (48±21 years old; male/female ratio 25:34 (0.7)) and 53 non-syphilitic controls (45±17 years old; male/female ratio 27:26 (1)) after the treponemal test were collected from November 2012 to April 2013 in a university hospital in Korea.

    The percentage agreement between the two RPR tests was 78.6% (κ 0.565; 95% CI 0.422 to 0.709; table 1). The strength of agreement between the automated RPR test and the manual RPR card test was considered to be ‘moderate’ according to the κ value scale. Both RPR-positive results (n=32) showed 96.9% (31/32) TPPA-positive results, and both RPR-negative results (n=56) showed 85.7% (48/56) TPPA-negative results.

    View this table:
    Table 1

    Comparison of non-treponemal RPR tests for syphilis detection

    There were 24 discrepant results (21.4%) between the two RPR tests, including 22 negative HBI HiSens Auto RPR LTIA test results that showed positive results on the BD Macro-Vue RPR card test. Of these 22 discrepant results, 20 were TPPA-positive and 2 were TPPA-negative, while 2 cases were positive on the HBI HiSens Auto RPR LTIA test but negative on the BD Macro-Vue RPR card test. These two cases were negative on the TPPA test. There were four results with discrepancies between both the RPR tests and the TPPA assay, which was due to conditions other than syphilis infection (table 2). The strength of agreement between the automated RPR and manual RPR tests was ‘fair’ (κ value 0.296, 59 TPPA-positive results; κ value 0.293, 53 TPPA-negative results) according to the TPPA results (table 3).

    View this table:
    Table 2

    RPR results that were discrepant with the treponemal test for diagnosis of syphilis

    View this table:
    Table 3

    Comparison of non-treponemal RPR tests with TPPA test results

    The overall sensitivity and specificity of the HBI HiSens Auto RPR LTIA test based on TPPA results were 52.5% (95% CI 39.1% to 65.7%) and 94.3% (95% CI 84.3% to 98.8%), respectively. The overall sensitivity and specificity of the BD Macro-Vue RPR card test were 86.4% (95% CI 75% to 93.9%) and 94.3% (95% CI 84.3% to 98.8%), respectively (table 4). Automated RPR gave a higher seroconversion rate after syphilis treatment (43.5% (10/23)) than the conventional RPR card test (4.3% (1/23)) (p=0.004) by the McNemar test. A detailed comparison of the treated syphilis cases is given in table 5.

    View this table:
    Table 4

    Performance characteristics of RPR tests for diagnosis of syphilis

    View this table:
    Table 5

    Comparison of manual and automated RPR test after initial syphilis treatment

    Discussion

    The manual RPR test has been used for decades, but recently an automated RPR test was launched and has been used because of its convenience in clinical settings. However, there was a need for thorough inspection and a comparison of results of this new automated test with the conventional manual RPR test in diagnostic approaches. Treponemal test results will not change even after treatment, and the patients live with positive results for the rest of their lives regardless of treatment or disease activity. Treponemal tests cannot discriminate between past infections, active disease, treated patients and non-treated patients.10 In contrast, non-treponemal tests can discriminate between patients who have been treated during the primary or secondary stage of the disease. When the primary or secondary stage of a first T. pallidum infection is treated, the non-treponemal test titre should show a twofold dilution decline after treatment, usually within 6 months.7 Therefore, the non-treponemal test is important for managing syphilitic patients.

    We compared an automated RPR test with a conventional RPR card test on sera confirmed by the TPPA test. The TPPA test is known to be less subjective than the fluorescent treponemal antibody absorption test and easier to read than the microhaemagglutination assay for antibodies to T. pallidum.11 The TPPA test has also been suggested for use on cerebrospinal fluid samples for diagnosing neurosyphilis.12

    In our study, the conventional BD Macro-Vue RPR card test showed better sensitivity than the HBI HiSens Auto RPR LTIA test in syphilis screening, although the automated RPR test does have some advantages in the clinical setting. For example, the automated RPR test reduced the workload and overall test turnaround time. It can also deal with greater test quantities in a given time than the manual RPR card test and does not require test experts. Furthermore, we observed that the automated RPR test could be used as a monitoring marker of treatment response, especially if treponemal tests are used for first-line screening of syphilis as a reverse algorithm of syphilis testing. This reverse algorithm for syphilis testing has been suggested and adopted in many fields because it may be more sensitive and effective than the traditional algorithm3 ,4 ,6 in a low-prevalence area and can be automated. However, the CDC still recommend first screening for syphilis with a non-treponemal test such as RPR.2

    Our study found that the automated RPR test showed earlier seroconversion than the conventional card RPR test after syphilis treatment (p=0.004). If we adopt the reverse algorithm, treponemal tests can be used first to screen sensitively, and then non-treponemal tests can be used to accurately show negative changes in treated cases. In this situation, we could use treponemal tests for first-line screening and non-treponemal tests for monitoring patients allowing us to observe seroconversion more effectively after treatment.2 ,13 ,14 Unfortunately, our study had a limited number of syphilitic patients because of the low prevalence of syphilis in our country, so the number of samples was small and could not been classified according to syphilis stage. In fact, in some late or latent syphilis cases, the results of the non-treponemal test were hard to interpret after initial treatment in our study (cases 8 and 9 in table 5). So, further well-designed studies are needed to clarify the serological responses of automated RPR tests after treatment and according to the stage of syphilis infection.

    In Korea, automated RPR tests have recently been introduced in clinical laboratories, and evaluations comparing conventional RPR tests and VDRL tests have been reported.8 ,15 However, the results were variable. Onoe et al16 also suggested that, when the automated serological testing method is used in clinical settings, the same reagent should be consistently selected to evaluate the changes in antibody titres, because the manual serological testing method for syphilis showed somewhat different results from the automated serological testing methods. In this study, we noticed reasonably consistent results between automated and manual RPR tests.

    We found that the automated RPR test has greater processing capability within a limited time and is effectively applicable. Through the reverse syphilis screening algorithm, we can increase the detection sensitivity of syphilis screening by using the treponemal test for initial screening, and then the automated RPR test after treatment because of its rapid seroconversion, although the sensitivity of the automated RPR test is lower than that of the manual RPR test.

    In conclusion, the automated RPR test showed an overall lower sensitivity and similar specificity compared with the conventional manual RPR card test. Therefore, we consider that the automated RPR test is not appropriate for use for initial screening for syphilis. However, it produces an earlier seroconversion response in treated cases than the conventional RPR card test. Applying the reverse algorithm, the sensitive treponemal test can be used as the first-line screening test, and then the automated RPR test can be used as an adjunct to detect earlier seroconversion in treated patients.

    Further large-scale studies including patients categorised by syphilis stage are required to clarify the diagnostic efficiency of the automated RPR test.

    References

    1. ↵
      1. Cho YH,
      2. Kim HO,
      3. Lee JB, et al
      . Syphilis prevalence has rapidly decreased in South Korea. Sex Transm Infect 2003;79:323–4. doi:10.1136/sti.79.4.323
      OpenUrlAbstract/FREE Full Text
    2. ↵
      Centers for Disease Control and Prevention (CDC). Discordant results from reverse sequence syphilis screening--five laboratories, United States, 2006–2010. MMWR Morb Mortal Wkly Rep 2011;60:133–7.
      OpenUrlPubMed
    3. ↵
      1. Egglestone SI,
      2. Turner AJ
      . Serological diagnosis of syphilis. PHLS Syphilis Serology Working Group. Commun Dis Public Health 2000;3:158–62.
      OpenUrlPubMed
    4. ↵
      1. French P,
      2. Gomberg M,
      3. Janier M, et al
      . IUSTI: 2008 European Guidelines on the Management of Syphilis. Int J STD AIDS 2009;20:300–9. doi:10.1258/ijsa.2008.008510
      OpenUrlFREE Full Text
    5. ↵
      1. Binnicker MJ
      . Which algorithm should be used to screen for syphilis? Curr Opin Infect Dis 2012;25:79–85. doi:10.1097/QCO.0b013e32834e9a3c
      OpenUrlCrossRefPubMed
    6. ↵
      1. Loeffelholz MJ,
      2. Binnicker MJ
      . It is time to use treponema-specific antibody screening tests for diagnosis of syphilis. J Clin Microbiol 2012;50:2–6. doi:10.1128/JCM.06347-11
      OpenUrlAbstract/FREE Full Text
    7. ↵
      1. Detrick B,
      2. Hamilton RG,
      3. Folds JD
      . Manual of molecular and clinical laboratory immunology. 7th edn. Washington DC: ASM Press, 2006.
    8. ↵
      1. Kim YS,
      2. Lee J,
      3. Lee HK, et al
      . [Comparison of quantitative results among two automated Rapid Plasma Reagin (RPR) assays and a manual RPR test]. Korean J Lab Med 2009;29:331–7. doi:10.3343/kjlm.2009.29.4.331
      OpenUrlPubMed
    9. ↵
      1. Landis JR,
      2. Koch GG
      . The measurement of observer agreement for categorical data. Biometrics 1977;33:159–74. doi:10.2307/2529310
      OpenUrlCrossRefPubMedWeb of Science
    10. ↵
      1. Workowski KA,
      2. Berman S
      , Centers for Disease Control and Prevention (CDC). Sexually transmitted diseases treatment guidelines, 2010. MMWR Recomm Rep 2010;59:1–110.
      OpenUrlPubMed
    11. ↵
      1. Castro RR,
      2. Prieto ES,
      3. Santo I, et al
      . Evaluation of the passive particle agglutination test in the serodiagnosis and follow-up of syphilis. Am J Clin Pathol 2001;116:581–5. doi:10.1309/9TCQ-B1TA-38MV-R6UM
      OpenUrlAbstract/FREE Full Text
    12. ↵
      1. Castro R,
      2. Prieto ES,
      3. Aguas MJ, et al
      . Evaluation of the Treponema pallidum particle agglutination technique (TP.PA) in the diagnosis of neurosyphilis. J Clin Lab Anal 2006;20:233–8. doi:10.1002/jcla.20147
      OpenUrlCrossRefPubMedWeb of Science
    13. ↵
      1. Romanowski B,
      2. Sutherland R,
      3. Fick GH, et al
      . Serologic response to treatment of infectious syphilis. Ann Intern Med 1991;114:1005–9. doi:10.7326/0003-4819-114-12-1005
      OpenUrlCrossRefPubMedWeb of Science
    14. ↵
      1. Sena AC,
      2. White BL,
      3. Sparling PF
      . Novel Treponema pallidum serologic tests: a paradigm shift in syphilis screening for the 21st century. Clin Infect Dis 2010;51:700–8. doi:10.1086/655832
      OpenUrlAbstract/FREE Full Text
    15. ↵
      1. Choi SJ,
      2. Park Y,
      3. Lee EY, et al
      . Comparisons of fully automated syphilis tests with conventional VDRL and FTA-ABS tests. Clin Biochem 2013;46:834–7. doi:10.1016/j.clinbiochem.2013.02.008
      OpenUrlCrossRefPubMed
    16. ↵
      1. Onoe T,
      2. Honda M,
      3. Matsuo K, et al
      . Examination of the correlation between the manual and automated serological testing methods for syphilis. J Dermatol 2012;39:355–61. doi:10.1111/j.1346-8138.2011.01341.x
      OpenUrlPubMed

    Footnotes

    • Contributors H-SK designed and participated in all stages of the study. J-HL participated in the experiments and statistical analyses and drafted the manuscript. CSL and M-GL helped in consultations on the study. All authors read and approved the final manuscript.

    • Funding This research received no specific grant from any funding agency in the public, commercial or not-for-profit sectors.

    • Competing interests None.

    • Provenance and peer review Not commissioned; externally peer reviewed.

    • Data sharing statement No additional data are available.