- Research article
- Open Open Peer Review
The effects of HIV testing advocacy messages on test acceptance: a randomized clinical trial
BMC Medicinevolume 12, Article number: 204 (2014)
Nearly 1 in 5 people living with HIV in the United States are unaware they are infected. Therefore, it is important to develop and evaluate health communication messages that clinicians can use to encourage HIV testing.
The objective was to evaluate health communication messages designed to increase HIV testing rates among women and evaluate possible moderators of message effect. We used a randomized four-arm clinical trial conducted at urban community outpatient health clinics involving 1,919 female patients, 18 to 64 years old. The four health message intervention groups were: i) information-only control; ii) one-sided message describing the advantages of HIV testing; iii) two-sided message acknowledging a superficial objection to testing (i.e., a 20 minute wait for results) followed by a description of the advantages of testing; and iv) two-sided message acknowledging a serious objection (i.e., fear of testing positive for HIV) followed by a description of the advantages of testing. The main outcome was acceptance of an oral rapid HIV test.
Participants were randomized to receive the control message (n = 483), one-sided message (n = 480), two-sided message with a superficial objection (n = 481), or two-sided message with a serious objection (n = 475). The overall rate of HIV test acceptance was 83%. The two-sided message groups were not significantly different from the controls. The one-sided message group, however, had a lower rate of testing (80%) than the controls (86%) (OR, 0.66; 95% CI, 0.47-0.93; P = 0.018). “Perceived obstacles to HIV testing” moderated this effect, indicating that the decrease in HIV test acceptance for the one-sided message group was only statistically significant for those who had reported high levels of obstacles to HIV testing (OR, 0.36; 95% CI, 0.19-0.67; P = 0.001).
None of the messages increased test acceptance. The one-sided message decreased acceptance and this effect was particularly true for women with greater perceived obstacles to testing, the very group one would most want to persuade. This finding suggests that efforts to persuade those who are reluctant to get tested, in some circumstances, may have unanticipated negative effects. Other approaches to messaging around HIV testing should be investigated, particularly with diverse, behaviorally high-risk populations.
Clinicaltrials.gov Identifier: NCT00771537. Registration date: October 10. 2008
The Centers for Disease Control and Prevention (CDC) estimate that there are nearly 1.1 million people living with HIV in the United States today and that nearly 1 in 5 are unaware they are infected . This situation may be explained by a recent report published by the CDC, which indicated that only 45% of adults in the United States have ever been tested for HIV and only 10% to 12% of those had been tested in the last 12 months ,. Higher rates of testing will have to be achieved in order to meet the U.S. Department of Health and Human Services Healthy People 2020 goal of increasing the percentage of HIV-infected persons who know that they are infected from 80.9% to 90% . Early detection of HIV is critical for initiation of treatment to prevent progression to AIDS and for effective viral suppression . Furthermore, people who are aware of their HIV status are more likely to reduce their risky sexual behaviors and are therefore less likely to transmit the virus to their partners . Thus, it is important to evaluate interventions, including health messaging, designed to increase rates of HIV testing.
When recommending a health behavior, one can employ either a one-sided or a two-sided message. A one-sided message presents only arguments supportive of the advocated behavior or position. A two-sided message provides supporting arguments, but also acknowledges (and usually rebuts) one or more potential arguments against the advocated behavior. The instinct of most health professionals is to stress the benefits of the behavior they are advocating; as a consequence, the vast majority of persuasive messages (e.g., advertisements) are one-sided . However, seminal studies by Hovland et al. found that two-sided messages are sometimes more persuasive than one-sided messages . The persuasive superiority of two-sided messages may be more likely to hold if the audience is resistant to persuasion (i.e., holds negative prior attitudes toward the advocated behavior) .
The principal theory addressed in this study is Inoculation Theory, which is said to increase the effectiveness of a two-sided message . Inoculation Theory holds that a two-sided message works in much the same way as vaccination; that is, by exposing subjects to a weakened (e.g., rebutted) form of a negative argument. Subjects are believed to be less likely to raise mental “counter-arguments” during message processing than if they had just heard a one-sided message, theoretically leading to increased message acceptance -. However, it is important to note that Inoculation Theory suggests the effects of a two-sided message may be less effective than a one-sided message if it raises negative arguments that would not otherwise have occurred to the audience. As a result, for some individuals and in some circumstances, a two-sided message may lead to a boomerang effect (i.e., create more negative attitudes than existed prior to message exposure). Furthermore, without the “inoculating” effect of the two-sided message, a one-sided message is likely to generate counter-arguments among resistant audience members (e.g., those who have high perceived barriers to testing), and these counter-arguments may be more persuasive than the message itself, also causing a boomerang effect.
Our objective was to evaluate one-sided and two-sided health communication messages designed to overcome attitudinal barriers with the goal of increasing HIV testing rates among women, who continue to be a significantly underrepresented population in HIV-related research . In addition to evaluating the effects of message sidedness, we were also interested in assessing whether any significant effects of the intervention might vary (i.e., be moderated by) at different levels of socio-demographic factors (age, race/ethnicity, education, income, relationship status, employment status), sexual behavior (total number of sexual partners over the lifetime), and/or HIV testing-related health beliefs.
Procedures and participants
Eligible participants for this study were women who were 18 years of age and older, able to understand English or Spanish, HIV-negative (via self-report), non-pregnant, and seeking clinical services at one of seven urban community health clinics located in Indianapolis, IN, USA. All recruitment sites were full-service health clinics that offered a range of diagnostic and treatment services. Patient demographics varied among the seven different clinic sites with some being fairly equally distributed across Hispanic, non-Hispanic black, and non-Hispanic white while others had higher proportions of either black or white. For the purpose of our study, we oversampled ethnic minorities so that we could assess potential differences in the effects of messaging across different races/ethnicities. Questions, information, and the interventions were presented to the participants one time via audio computer-assisted self-interview (ACASI), so high levels of literacy were not required, and participants only had to be able to recognize individual numbers and letters to indicate their responses. Surveys were completed in a private room and it took each participant an average of 20 minutes to complete the survey. Pregnant women (by self-report) were excluded because HIV testing is routinely recommended and provided to all women who are pregnant.
The study was approved by the Indiana University Institutional Review Board and data were collected from August 2008 to January 2011. Potential participants were recruited from clinic waiting rooms, but all consent and study procedures took place in a private area. All participants provided written informed consent and were compensated with a $25 gift card for the time and effort involved in completing the ACASI. Individuals who met the inclusion criteria and agreed to participate were oriented to the ACASI by the project manager. Throughout the ACASI process the project manager remained available for questions or problems, but did not directly supervise the ACASI.
This study followed a four-group parallel design with balanced randomization across four message groups. We randomized adult women into the following groups: i) an information-only control condition; ii) a one-sided message advocating HIV testing; iii) a two-sided message acknowledging and refuting a superficial objection; and iv) a two-sided message acknowledging and refuting a more serious objection. Individuals in the control group received brief, basic information about HIV/AIDS and about the rapid HIV test being offered (this information was provided to all four arms). The one-sided group saw and heard messages describing only the benefits of HIV testing (e.g., “If you detect HIV early, you can get treatments that can greatly improve your long term health”). The two-sided superficial message involved description of a relatively minor objection to testing (e.g., “Some people may not get tested because they think it is inconvenient to wait 20 minutes to get the result”), followed by refutation of the objection and the message noting the benefits of testing. The two-sided serious message involved a more substantial objection to testing (e.g., “Some people do not get tested for HIV because they are afraid that they will find out that they have HIV infection”) followed by refutation of the objection and the message noting the benefits of testing. By preemptively presenting objections to testing, along with refutations of the objections, Inoculation Theory would predict a decrease in resistance to getting tested for HIV. The messages were developed from qualitative interviews conducted during a pilot study for this project. The serious objection was determined from these qualitative interviews carried out at the same clinics used to conduct the surveys . Wait time was not identified as a serious objection by participants in the qualitative study so we determined that it was a good representation of a superficial barrier. Table 1 shows the full text of the four messaging conditions. Using a computer-generated random number algorithm, participants were randomized within the ACASI program in blocks of 64 to one of the four health message conditions. Across each sequential group of 64 participants, 16 would be assigned to each study arm with a 1:1:1:1 allocation ratio. Both research staff and participants were blinded to the intervention.
Measures and interventions
The ACASI measured socio-demographic factors (age, sex, education, race, employment status, relationship status, and family income). In addition, we assessed potential attitudinal moderators of framing effects with three scales: perceived obstacles to testing, perceived benefits of testing, and normative beliefs about testing. These health beliefs were adapted from previous research on other medical diagnostic tests and vaccine acceptance studies -. They were assessed with items that used a 5-point Likert-type response scale ranging from `Strongly Disagree’ to `Strongly Agree’. The perception of obstacles to HIV testing was assessed with a single item (“I can think of a lot of reasons not to get tested for HIV”). Perceived benefits of testing was assessed with five items (e.g., “Getting tested for HIV/AIDS would be a good way to protect my health”) and had good internal reliability (coefficient alpha = 0.81). Normative beliefs about testing were assessed with six items (e.g., “Most of the people I know think that getting tested for HIV/AIDS is a good thing to do for your health”) and had a good internal reliability (alpha coefficient = 0.76).
The outcome of interest was HIV test acceptance. At the conclusion of the survey, participants were offered free oral fluid rapid HIV testing (Oraquick® Test by OraSure Technologies, Inc., Bethlehem, PA, USA). Test acceptance was measured as a binary yes/no variable.
The data were analyzed using logistic regression, with the control message serving as the reference level. First, we analyzed the main effect of the intervention on HIV testing rates. We planned to further analyze any significant main effects with a series of moderation analyses. These analyses were performed in order to determine whether the identified main effect might vary based on subgroups. Potential moderators were age, education, race/ethnicity, employment status, number of lifetime partners, perceived benefits, perceived norms, or perceived obstacles. For the moderation analyses, the designated moderator was added as a predictor, as well as the interaction between the moderator and message type. Any statistically significant moderator analyses (i.e., those that had a statistically significant interaction with message type) were further explored by doing separate logistic regression analyses, stratified by levels of the moderator in order to examine the specific nature of the moderation.
We enrolled 1,919 participants in the main portion of the study or approximately 480 per experimental condition. Testing acceptance in the control group was 86%. Based on a logistic regression model with a two-tailed 5% significance level, we had 88% power to detect a linear effect with a 2% increase with each successive group, i.e., 92% acceptance in the best (expected to be two-sided major objection) message group. For an intervention effect that is not linear, we would still have 93% power to detect a main effect if the groups were evenly spread between 86% and 93.5% acceptance. The main contrasts planned to be examined were comparisons of the control and the intervention groups. We estimated that there was 80% power to detect a 5.7% difference.
A total of 6,763 women were screened for eligibility and 2,148 were ultimately randomized to the four messaging conditions. Computer and electronic survey failures led to the loss of data from 113 participants (5.3%). In light of the CDC’s recommendation for routine opt-out testing for individuals aged 13 to 64, for this paper we excluded women who were aged 65 years and older (n = 116), resulting in a final sample of 1,919 (Figure 1) a. These women were 18 to 64 years of age (mean = 42.7), 20% identified as Latina, 44% identified as non-Latina Black, and 36% identified as non-Latina White/Other. Race was assessed by self-report; Table 2 shows the complete description of socio-demographic characteristics. As shown in Figure 1, participants were distributed fairly equally across intervention conditions and a randomization check indicated that there were no statistically significant differences at baseline across conditions (see columns 2-6 of Table 2). Overall, of the 1,919 participants, 83% accepted the HIV test. Among the women who accepted the HIV test, there was one Western Blot confirmed true positive and one false positive.
HIV test acceptance
The highest rate of testing (86%) occurred among participants in the control group, who received no persuasive message. Neither the two-sided superficial nor the two-sided serious message group (test acceptance rates 83% and 82%, respectively) differed significantly from the control group (86%) in acceptance of HIV testing. However, the one-sided message group had significantly lower rates of testing (80%) than the control group (86%) (OR, 0.66; 95% CI, 0.47-0.93; P = 0.018).
Of the eight potential moderators, only the interaction between the intervention and “perceived obstacles to testing” was statistically significant (P = 0.048). Specifically, compared to the control condition, the one-sided message resulted in lower rates of test acceptance with increases in perceived obstacles (OR, 0.70; 95% CI, 0.53-0.93; P = 0.013). To further explain this moderator effect, we dichotomized the sample based on perceived obstacles: low obstacles (i.e., responses of “Strongly Disagree” and “Disagree”) and high obstacles (i.e., responses of “Neither Agree nor Disagree”, “Agree”, and “Strongly Agree”). Logistic regression analyses stratified by level of perceived obstacles indicated no significant effect for participants in the “low perceived obstacles” group, but significantly lower rates of testing with the one-sided message for the “high perceived obstacles” group (OR, 0.36; 95% CI, 0.19-0.67; P = 0.001). Table 3 shows the full results of the stratification analysis. Figure 2 shows a graphical representation of the moderating effect of the intervention on test acceptance between those with low and high obstacles.
In this study, the women who received either of the two-sided messages did not have HIV testing rates that were significantly higher than those who received information only. Surprisingly, the one-sided message had negative effects on test acceptance, particularly for those women who came into the study perceiving high obstacles to HIV testing. This finding is particularly noteworthy, in that it suggests that efforts at direct persuasion may have the unanticipated effect of discouraging acceptance of HIV testing, particularly among those individuals one would most want to persuade (i.e., those who are reluctant to get tested). Yet, many HIV testing brochures developed by local, state, and federal governments take a largely one-sided approach to health messaging about HIV testing -.
The unanticipated negative effect or “boomerang effect” of the one-sided message that was identified in this study has been described in previous literature on message framing and mammography screening ,, suggesting that health messaging interventions need to be carefully evaluated and compared to a control condition. If we had simply tested one-sided vs. two-sided messages, for instance, without an information-only control group, we would not have identified the negative impact of the one-sided condition. Overall, reactance reduced test acceptance by 6%, which is a modest effect size, but meaningful when extrapolated across a large population. However, it is notable that for the high perceived obstacles group, the one-sided message had a very large effect size and reduced test acceptance by nearly 18 percentage points (85.4% vs. 67.5%).
There are a number of limitations to this study which may limit generalizability and suggests that the results should be interpreted with some caution. First, we had a relatively high rate of test acceptance across groups, indicating that a ceiling effect may have limited our ability to increase testing rates with simple health messages. It is possible that two-sided messages might work more effectively in populations with lower base rates of test acceptance. Also, although the study sample was racially/ethnically diverse, it was composed only of women attending clinics in Indianapolis. Moreover, although there was a relatively low participation rate among those screened for eligibility (just over 30%), most of the women who declined did so due to a lack of time, not due to objections about the nature of the study. It is possible that there was a self-selection bias with this study and the participants who were willing to participate in the study were also more willing to get tested for HIV. Furthermore, males, people with differing levels of perceived vulnerability, and those from other geographic locations may respond differently to HIV test messages. A recent study, for instance, found that men and women responded in opposite directions to two-sided messages related to news coverage . In another study, induction of mortality salience increased rates of HIV testing, but only among those who were exposed to a message that increased their feelings of vulnerability to HIV. Mortality salience among participants in the low vulnerability condition resulted in lower rates of testing . It is possible that a brief intervention such as this may work in a population where HIV test acceptance is low. In order to increase test acceptance beyond the already high rate identified in this study may require a more in-depth intervention derived from theories of behavior change such as Social Cognitive Theory ,.
To our knowledge, this is among the first randomized clinical trials examining the effect of persuasive health messages on HIV test acceptance in a clinical setting. We found high rates of test acceptance across health messaging conditions, but no increased testing rates in the intervention groups. In fact, the one-sided persuasive message unexpectedly led to decreased acceptance of testing compared to an information-only control group. This finding suggests that certain approaches to health messaging, commonly used in clinical practice, can actually undermine efforts to maximize rates of HIV testing, particularly among those who express reluctance to get tested. Further research is needed to identify effective health messaging and to evaluate messages in diverse populations.
aWhen women over 65 were included, the results were the same.
MLK and GDZ had full access to all of the data in the study and take responsibility for the integrity of the data and the accuracy of the data analysis. All authors approved the final version of the manuscript. Study concept and design: MLK, GDZ, ADC, DC, KHF, and BPK. Acquisition of data: GDZ, ADC, DC, and KHF. Analysis and interpretation of data: MLK, GDZ, ADC, DC, and BPK. Drafting of the manuscript: MLK and GDZ. Critical revision of the manuscript for important intellectual content: MLK, ADC, DC, KHF, BPK, and GDZ. Statistical analysis: MLK, ADC, BPK, and GDZ. Obtained funding: GDZ, ADC, DC, KHF, and BPK. Study supervision: GDZ, ADC, DC, and KHF.
Audio computer-assisted self-interview
Centers for Disease Control and Prevention
Centers for Disease Control and Prevention: Monitoring Selected National HIV Prevention and Care Objectives by Using HIV Surveillance Data - United States and 6 U.S. Dependent Areas - 2010. HIV Surveillance Supplemental Report 2012, 17(No. 3). . Accessed June 25, 2012., [http://www.cdc.gov/hiv/topics/surveillance/resources/reports/]
Centers for Disease Control and Prevention: HIV Testing Trends in the United States, 2000-2011. . Accessed June 15, 2013., [http://www.cdc.gov/hiv/pdf/testing_trends.pdf]
Number of persons tested for HIV - United States, 2002. MMWR. 2004, 53: 1110-1113.
U.S. Department of Health and Human Services: Healthy People 2020. Washington, DC: . Accessed December 26, 2013., [http://www.healthypeople.gov/2020/topics-objectives/topic/hiv/objectives?topicId=22]
Centers for Disease Control and Prevention: HIV/AIDS Testing. . Accessed December 26, 2013., [http://www.cdc.gov/hiv/basics/testing.html]
Smith KM, Putstein SE, Powers KA, Fidler S, Miller WC, Eron JJ, Cohen MS: The detection and management of early HIV infection: a clinical and public health emergency. J Acquir Immune Defic Syndr. 2013, 63: S187-S199. 10.1097/QAI.0b013e31829871e0.
Crowley A, Hoyer W: An integrative framework for understanding two-side persuasion. J Consum Res. 1994, 20: 561-574. 10.1086/209370.
Hovland C, Lumsdaine A, Sheffield F: Experiments in Mass Communication. 1949, Princeton University Press, Princeton, NJ
Eagly A, Chaiken S: The Psychology of Attitudes. 1993, Harcourt Brace College Publishers, Fort Worth
Belch GE: An examination of comparative and noncomparative television commercials: the effects of claim variation and repetition on cognitive response and message acceptance. J Market Res. 1981, 18: 222-249. 10.2307/3150974.
Kamins MA, Assael H: Two-sided versus one-sided appeals: a cognitive perspective on argumentation, source derogation, and the effect of disconfirming trial on belief change. J Market Res. 1987, 24: 29-39. 10.2307/3151751.
Swinyard WR: The interaction between comparative advertising and copy claim variation. J Market Res. 1981, 18: 175-186. 10.2307/3150952.
Lunny C, Shearer B, Cruikshank J, Thomas K, Smith A: Women in HIV conference research: trends and content analysis of abstracts presented at 17 HIV/AIDS conferences from 2003 to 2010. Women’s Health Issues. 2011, 21: 407-417. 10.1016/j.whi.2011.06.009.
Mays RM, Sturm LA, Rasche JC, Cox DS, Cox AD, Zimet GD: Use of drawings to explore U.S. women’s perspectives on why people might decline HIV testing. Health Care Women Int. 2011, 32: 328-343. 10.1080/07399332.2010.510585.
Zimet GD, Liau A, Fortenberry JD: Health beliefs and intention to get immunized for HIV. J Adolesc Health. 1997, 20: 354-359. 10.1016/S1054-139X(97)00031-1.
Zimet GD, Rosenthal SL, Fortenberry JD, Brady RC, Tu W, Wu J, Bernstein DI, Stanberry LR, Stone KM, Leichliter JS, Fife KH: Factors predicting the acceptance of herpes simplex virus type 2 antibody testing among adolescents and young adults. Sex Transm Dis. 2004, 31: 665-669. 10.1097/01.olq.0000143089.77493.c2.
Zimet GD, Perkins SM, Winston Y, Kee R: Predictors of first and second dose acceptance of hepatitis B vaccine among STD clinic patients. Int J STD AIDS. 2008, 19: 246-250. 10.1258/ijsa.2007.007136.
Revised recommendations for HIV testing of adults, adolescents, and pregnant women in health-care settings. MMWR. 2006, 55: 1-17.
Centers for Disease Control and Prevention: No Matter Who You Are, This Test is for You. June 2010. . Accessed February 10, 2014., [http://www.cdc.gov/actagainstaids/pdf/hssc_brochure_english.pdf]
Department of Veterans Affairs: Get Checked, Just to be Sure. March 2010. . Accessed February 10, 2014., [http://www.hiv.va.gov/pdf/get-checked-brochure.pdf]
Michigan Department of Community Health: What You Need to Know About HIV Testing. May 2010. . Accessed February 10, 2014., [https://www.michigan.gov/documents/DCH-0675electronicversion_163987_7.pdf]
New York City Department of Health: What You Need to Know about an HIV Test: Anybody can get HIV. . Accessed February 10, 2014., [http://www.nyc.gov/html/doh/downloads/pdf/ah/hiv-nycknows-brochure.pdf]
Finney LJ, Iannotti RJ: Message framing and mammography screening: a theory-driven intervention. Behav Med. 2002, 28: 5-14. 10.1080/08964280209596393.
Cox A, Cox D: Communicating the consequences of early detection: the role of evidence and framing. J Mark. 2001, 65: 91-103. 10.1509/jmkg.22.214.171.12436.
Chang C: Men’s and women’s responses to two-sided health news coverage: a moderated mediation model. J Health Commun. 2013, 18: 1326-1344. 10.1080/10810730.2013.778363.
Grover KW, Miller CT: Effects of mortality salience and perceived vulnerability on HIV testing intentions and behaviour. Psychol Health. 2014, 29: 475-490. 10.1080/08870446.2013.866672.
Lopez LM, Tolley EE, Grimes DA, Chen M, Stockton LL: Theory-based interventions for contraception (Review). Cochrane Database Syst Rev. 2013, 8: CD007249.
Wingood GM, DiClemente RJ, Robinson-Simpson L, Lang DL, Caliendo A, Hardin JW: Efficacy of an HIV intervention in reducing high-risk HPV, non-viral STIs, and concurrency among African-American Women: a randomized controlled trial. J Acquir Immune Defic Syndr. 2013, 63: S36-10.1097/QAI.0b013e3182920031.
This study was supported by a research grant from NIH (R01 NR010004) and a training grant from the Walther Foundation. The full protocol is available by request from Dr. Zimet (email@example.com).
Role of the sponsor
The funder had no role in the design and conduct of the study, collection, management, analysis, and interpretation of the data, preparation, review, or approval of manuscript, or decision to submit the manuscript for publication.
Findings from the study were presented at the 35th Annual Meeting of the Society of Behavioral Medicine, April 23-26, 2014.
Dr. Fife reported having received a grant from GlaxoSmithKline/ViiV Healthcare for an HIV clinical treatment trial. The other authors declare no competing interests.