A differentiated digital intervention to improve antiretroviral therapy adherence among men who have sex with men living with HIV in China: a randomized controlled trial
BMC Medicine volume 20, Article number: 341 (2022)
Antiretroviral therapy (ART) adherence is still suboptimal among some key populations, highlighting the need for innovative tailored strategies. This randomized controlled trial (RCT) aimed to evaluate the effect of a differentiated digital intervention on ART adherence among men who have sex with men (MSM) living with HIV in China.
The two-armed parallel RCT was conducted at one HIV clinic in Jinan of China from October 19, 2020, to June 31, 2021. Men were referred by health providers to join the study and then choose one of three digital strategies—text message, only instant message, or instant message plus social media. They were assigned in a 1:1 ratio to the intervention arm or control arm using block randomization, and inside each arm, there were three groups depending on the type of delivering the message. The groups were divided according to participants’ preferred digital strategies. The intervention arm received ART medication messages, medication reminders, peer education, and involved in online discussion. The control arm received messages on health behavior and nutrition. The primary outcome was self-reported optimal ART adherence, defined as not missing any doses and not having any delayed doses within a one-month period. Secondary outcomes included CD4 T cell counts, viral suppression, HIV treatment adherence self-efficacy, and quality of life. Intention-to-treat analysis with generalized linear mixed models was used to evaluate the intervention’s effect.
A total of 576 participants were enrolled, including 288 participants assigned in the intervention arm and 288 assigned in the control arm. Most were ≤ 40 years old (79.9%) and initiated ART ≤ 3 years (60.4%). After intervention, the proportion of participants achieving optimal ART adherence in the intervention arm was higher than in the control arm (82.9% vs 71.1%). The differentiated digital intervention significantly improved ART adherence (RR = 1.74, 95%CI 1.21–2.50). Subgroup analysis showed one-to-one instant message-based intervention significantly improved ART adherence (RR = 2.40, 95% CI 1.39–4.17).
The differentiated digital intervention improved ART adherence among MSM living with HIV in China, which could be integrated into people living with HIV (PLWH) management and further promoted in areas where PLWH can access text messaging and instant messaging services.
ChiCTR2000041282. Retrospectively registered on 23 December 2020.
The treat-all strategy has allowed most PLWH to start antiretroviral therapy (ART), and on this circumstance, improving the adherence is essential in achieving the target of treat-all [1, 2]. By the end of June 2021, about 28.2 million people living with HIV (PLWH) globally were on ART . However, suboptimal ART adherence has been reported in both high-income countries [4, 5] and low- and middle-income countries (LMICs), including China [6, 7]. The reasons of suboptimal adherence are diverse and include individual, inter-personal and structural factors [8, 9].
Men who have sex with men (MSM) are the key populations who are particularly vulnerable to HIV infection and present an increasing public health challenge. In 2020, MSM accounted for 45% of HIV infections outside of sub-Saharan Africa . In China, the proportion of male-to-male transmission increased from 9.1% in 2009 to 23.3% in 2020 . In Shandong Province of China, male-to-male transmission accounted for 57.3% (6195/10808) of all HIV/AIDS cases reported from 1992 to 2016 . Stigma associated with taking ART, limited access to HIV care, and diminished trust in health providers may be particularly important in driving poor ART adherence among MSM living with HIV [13, 14]. For instance, less than 80% of Hispanic/Latino MSM in the USA reported high level of ART adherence . And furthermore, only about 60% of all MSM living with HIV were estimated to achieve viral suppression in US . In Kenya, 40% of MSM had less than 95% adherence (versus 28.6% of heterosexual men) . Nevertheless, few specific adherence interventions focused on MSM, highlighting the need for tailored and innovative strategies to enhance ART adherence in this population . Due to convenience and confidentiality, digital technology may be an important tool to reach the marginalized group .
Digital health interventions are defined as interventions using information and communication technology to support health . Digital innovations can be further divided into non-Internet (e.g., text message/short message service [SMS] and phone calls) and Internet-based (e.g., social media, mobile application and website) technologies . Internet-based digital interventions allow users to generate content and disseminate information on sensitive topics at any time or place and can potentially decrease inadvertent disclosure of sensitive behaviors [19,20,21]. The global expansion of instant messaging platforms has provided a foundation for Internet-based digital intervention in recent years. For example, one instant messaging service (WhatsApp) has two billion monthly active users globally and is common in 180 countries, with options that do not require a smartphone . However, few randomized controlled trials (RCT) have assessed Internet-based digital interventions to improve ART adherence . By contrast, SMS has been widely used to deliver adherence interventions and is already recommended by the World Health Organization and others [23,24,25,26].
Although many strategies have been used to improve ART adherence, much is still not well known about optimizing ART adherence. A meta-analysis showed that multiple strategies were superior to a single strategy, suggesting the importance of multi-component interventions . The World Health Organization and the Joint United Nations Programme on HIV/AIDS (UNAIDS) have highlighted the need for differentiated care across the HIV care continuum [10, 23]. Differentiated care is defined as a patient-centered approach adapting HIV services to reflect the preferences and expectations of PLWH . The central driver of differentiated care is patients’ need. Differentiated care can improve adherence, increase patients’ satisfaction, empower patients, and make health systems more efficient . Duncombe et al. developed a differentiated framework for HIV treatment services with variations in type of services delivered, service frequency, health worker cadre, and service location . Despite the known importance of patient-centered approaches, few studies have differentiated ART adherence strategies .
This RCT aimed to evaluate a differentiated digital intervention to improve ART adherence among MSM living with HIV in China.
This is a pragmatic two-armed parallel RCT, and inside each arm, there were three groups depending on the type of delivering the message and the type of information (see Fig. 1). According to the study design, participants were allowed to choose one of the three digital strategies (text message, only instant message, and instant message plus social media) based on their preferences. Then, they were assigned in a 1:1 ratio to the intervention arm or control arm using stratified block randomization. Stratification was according to participants’ preferred digital strategy and block randomization was triggered within each stratum. We used WeChat for instant messaging and QQ for social media. Both of these Chinese platforms are common instant messaging platforms similar to Facebook and Twitter, respectively. This RCT included a baseline survey and two follow-ups with 3-month interval. More details about study design were displayed in study protocol (see Additional file 1). We followed the standard guidelines for reporting parallel group RCTs (see Additional file 2) .
This RCT was conducted in an infectious diseases hospital in Jinan, Shandong Province of China from October 19, 2020 to June 31, 2021. This hospital is a tertiary referral site that provides ART and post-exposure prophylaxis (PEP) for approximately 1600 MSM (accounting for about 80% of all patients). All patients need to visit their health care providers at least every 3 months for medication refills and physical examinations.
Eligible participants were aged 18 years or above, living with HIV and currently on ART in the hospital, born biologically male, having ever reported anal sex with men, and willing to choose one of the three provided digital strategies. Individuals were excluded if they did not have their own mobile phones or could not access Internet or could not complete the survey due to personal reasons (e.g., psychiatric disorders). Participants were recruited when they came to refill medication. The health providers first screened the eligibility of each patient and referred eligible people to a waiting room where trained investigators further identified their eligibility and provided a detailed introduction of the study. Those who showed interest, met eligibility criteria, and provided written informed consent were asked to complete a baseline survey. At the same time, they were required to provide their phone number or WeChat account according to their preferred digital strategy. Thereafter, they were asked to complete two follow-up surveys every three months when they came to refill ART medications. Men were reimbursed about 7.85 USD for each of the survey questionnaires completed.
The development of intervention was guided by the theory of planned behavior , a scoping literature review on digital ART adherence interventions [16, 23, 27, 33, 34], and formative research focused on barriers and facilitators of digital interventions (see details in Additional file 1).
The final comprehensive interventions included health messaging (ART medication messages and HIV clinical messages), medication reminder, peer education, and online group discussion. For the control arm, participants also received additional messages (health behavior and nutrition messages) based on routine care. According to the study design, there were three groups within each arm depending on the type of delivering the message and the type of information. For instance, we delivered health messages using text in text message group but using images in instant message group (see Fig. 2).
In the text message-based intervention group, we delivered ART medication messages (12 items in total, Additional file 3: Table S1) biweekly and HIV clinical messages (6 items in total, Additional file 3: Table S2) monthly via text message. After the first follow-up, we additionally delivered peer education stories (6 items in total, Additional file 3: Table S3) biweekly via text message. Daily medication reminders were sent to those who needed the service at 3 min before their dose-timing via a customized SMS platform.
In the instant message-based intervention group, we delivered images of ART medication messages (https://github.com/JKD-epidemiology/Intervention-materials.git) biweekly and HIV clinical messages (https://github.com/JKD-epidemiology/Intervention-materials.git) monthly via WeChat. After the first follow-up, we additionally delivered peer education videos (https://github.com/JKD-epidemiology/Intervention-materials.git) biweekly via WeChat. The images and videos were designed and recorded by peer volunteers from a MSM community-based organization. A WeChat mini-program (a lightweight “APP” without the need of downloading) was developed to provide daily medication reminders and online clock punching after taking medication (see user interface in https://github.com/JKD-epidemiology/Intervention-materials.git) . Participants who were interested could enter the mini-program to complete clock punching within one hour of prescribed dose-timing. Those who completed 30-day uninterrupted clock punching could receive about 4.71 USD as a reward and this was cumulative during the intervention periods. In addition, the mini-program sent daily medication reminders to those who needed the service at 3 min before their dose-timing.
In the instant message plus social media intervention group, we additionally established a QQ group. A project member (as group administrator) and a health provider were invited to the QQ group to encourage participants to communicate about ART experience and share health messaging. In addition, the administrator shared short articles (24 items in total, Additional file 4) about frontiers of HIV research and tips of ART to this group weekly, which were adapted from authoritative website (e.g., UNAIDS, China CDC).
In the control arm, we delivered messages about health behavior and nutrition (12 items in total, Additional file 3: Table S4) biweekly based on routine care provided by the local hospital and CDC. We also delivered messages according to participants’ preferred digital strategies. Specifically, we delivered text messages for text message control group and images (https://github.com/JKD-epidemiology/Intervention-materials.git) for instant message control group and instant message plus social media control group.
The primary outcome was the proportion of achieving optimal ART adherence over the previous month, which was assessed based on self-report at baseline and each follow-up. ART adherence had two components: percent adherence (percent of prescribed doses taken) and dose-timing adherence (how many hours it was taken is away from the recommended time for the particular antiretroviral medication). We defined optimal ART adherence as not missing any doses and not having any delayed doses (more than 1 h) within a month period. The 1-h window of dose-timing adherence was based on clinical suggestion and a digital intervention study in China . The secondary outcome included proportions of viral suppression (defined as viral load < 20 copies/ml), CD4 T cell counts (cells/mm3), HIV treatment adherence self-efficacy, and quality of life. We collected CD4 T cell counts and HIV viral load from medical records. We adapted validated scales to measure HIV treatment adherence self-efficacy  and quality of life . Detailed introduction of the scales were displayed in study protocol (Additional file 1). The self-efficacy and quality of life were measured at baseline and in each follow-up survey. The designated ART hospital regularly provides free CD4 T cells and viral load testing for all patients from March to June every year, the time of which is basically consistent with our second follow-up. We collected data in 2020 as baseline (pre-intervention) measurement and data in 2021 as post-intervention measurement.
We first calculated a sample size based on our pre-specified subgroup analyses by different digital strategies and then extrapolated the total sample size according to the estimated proportions of joining each subgroup. We assumed a fifteen-percentage difference in proportions of achieving optimal ART adherence post-intervention for the text message subgroup (95% in intervention group vs. 80% in control group) based on a previous SMS intervention in Chinese context . Assuming two-sided alpha = 0.05, 80% power, and 20% loss to follow-up, we calculated the target sample size of text message subgroup was 190. For the instant message and instant message plus social media subgroups, there was no preliminary data, and we estimated that the percentage difference of achieving optimal adherence was no less than fifteen.
A pilot survey in another designated ART delivery site of Shandong Province showed two-thirds of PLWH would prefer instant message and the remaining one third preferred text message. Accordingly, we anticipated that one-third of participants would choose text message in this study and extrapolated the total sample size was 570.
Randomization and blinding
We randomly assigned the participants in a 1:1 ratio to either the intervention arm or control arm with a stratified block design (block sizes of four). Stratification was according to participants’ preferred digital strategy (n = 3). A research assistant with no involvement in the trial generated the computerized random allocation sequence and performed packaging of sequentially numbered, opaque, sealed envelopes. The health providers and investigators who were masked to random allocation sequence participated in enrolling participants. The investigators who were independent of outcome assessment assigned participants to interventions. The allocation sequence was applied to participants sequentially in the order in which they were enrolled within the group they chose.
Due to study design, participants and intervention providers were aware of the assigned arm. Those assessing outcomes, field investigators, and health providers who referred participants to this study were kept blind to assignment.
Descriptive analysis was used to summarize basic characteristics. We also described and compared the proportions of participants achieving optimal ART adherence between the intervention arm and control arm at baseline and each follow-up. We evaluated the effect of intervention on primary and secondary outcomes with intention-to-treat (ITT) analysis using generalized linear mixed models (GLMMs). For GLMMs, the intervention status, stratification status, time indicators, and baseline outcome (to control for potential imbalance after randomization) were regarded as fixed effects, while individuals with multiple measurements were regarded as random effects. Further, we evaluated the intervention effect adjusted for age, education, and ART duration. The estimated intervention effects (risk ratio [RR] and absolute risk difference [RD] for binary outcomes and mean difference [MD] for continuous outcomes) were reported with 95% confidence intervals (CI). Subgroup analysis by different digital strategies (text message versus instant message versus instant message plus social media group) was conducted to evaluate the primary and secondary outcomes between the intervention group and control group within each stratum. Additional subgroup analysis by ART duration (≤ 3 years versus > 3 years) was conducted to evaluate the difference in proportion of optimal ART adherence between the intervention arm and control arm based on pre-specified analysis plan.
We conducted sensitivity analysis using per-protocol (PP) strategy and as-treated (AT) strategy to evaluate the stability of intervention and effect of contamination. In PP analysis, we encountered non-convergence phenomenon and used log Poisson GLMM to substitute log binomial GLMM. Given baseline differences in the ART adherence in the instant message subgroup, we additionally conducted sensitivity analysis by combining two subgroups (i.e., instant message subgroup and instant message plus social media subgroup) to evaluate the effectiveness of instant message-based intervention. According to our pre-specified analysis plan, we used complete-case analysis without adopting multiple imputations because the missing of outcome variable was < 15%.
Descriptive analysis was conducted using SPSS 24.0. The GLMMs were conducted using SAS 9.4.
This study was performed in accordance with the Declaration of Helsinki and approved by the Ethical Review Committee of School of Public Health in Shandong University (20190210). Written informed consent were obtained from all participants. All investigators, intervention providers, and assessors signed non-disclosure protocols before recruitment. The trial was registered in the Chinese Clinical Trial Registry (ChiCTR2000041282).
Men were recruited from October 19, 2020, to December 4, 2020, and followed until June 31, 2021. Among 593 people referred by health providers, 586 were eligible and completed the baseline survey. Among those who were excluded, three men reported never having anal sex with men, two men were not interested or refused to provide informed consent, and two had already enrolled once in the study. Among eligible participants, nine people refused to provide a phone number or WeChat account after completing baseline survey, and one dropped out before randomization. A total of 576 participants were enrolled and randomized. Among this group, 144 (25.0%) chose text messages, 290 (50.3%) chose instant messages, and 142 (24.7%) chose instant messages plus social media. Based on the predetermined randomization list, stratified block randomization was performed, and 288 participants (including 72 in text message intervention group, 145 in instant message intervention group, 71 in instant message plus social media intervention group) were assigned to the intervention arm and 288 (including 72 in text message control group, 145 in instant message control group, 71 in instant message plus social media control group) were assigned to the control arm.
A total of 500 participants completed the 3-month follow-up survey with a loss-to-follow-up rate of 13.2% (76/576) and 501 completed the 6-month follow-up survey with a loss-to-follow-up rate of 13.0% (75/576). The reasons of lost to follow-up mainly included that participants were reluctant to participate in this study or health providers forgot referral of the follow-up surveys. A total of 547 participants (95.0%) completed as least one follow-up and were included in ITT analysis (including 268 participants in the intervention arm and 279 participants in the control arm) (Fig. 3).
Baseline characteristics of the participants
As displayed in Table 1, participants’ sociodemographic, behavioral, and clinical characteristics in the intervention arm and control arm were similar. The majority of participants were 40 years old or younger (79.9%), had a college degree or beyond (61.3%), had an annual income below 15158 USD (78.6%), and were unmarried/divorced/widowed (80.7%). About 60% of participants reported their sexual orientation as gay. 55.9% and 62.3% of participants had disclosed their sexual orientation and HIV status to others. More than half of the participants (58.3%) reported alcohol use in the past 12 months.
The proportion of virally suppressed was 84.5% (missing values were not taken into account) and the median of CD4 T cell counts was 584.50 ± 385.00. In addition, 60.4% of participants initiated ART ≤ 3 years, 57.4% took ART medications once a day, and 62.0% experienced side effects during ART. Most participants took three kinds of antiretroviral medication (92.2%), received adherence education before ART initiation (94.6%), and used medication reminders (91.5%).
The basic characteristics of three groups within each arm were displayed in Table S1 of Additional file 5.
Proportion of achieving optimal ART medication adherence
At baseline, the proportion of optimal ART adherence was 77.1% in the intervention arm (72.2% in text message intervention group; 81.4% in instant message intervention group; 73.2% in instant message plus social media intervention group) and 74.0% in the control arm (77.8% in text message control group; 71.0% in instant message control group; 76.1% in instant message plus social media control group) (Fig. 4).
At the second follow-up (post-intervention), the proportion of optimal ART adherence was 82.9% in the intervention arm (76.6% in text message intervention group; 86.5% in instant message intervention group; 81.8% in instant message plus social media intervention group) and 71.1% in the control arm (71.4% in text message control group; 69.3% in instant message intervention group; 74.2% in instant message plus social media intervention group) (Fig. 4).
The measurements of secondary outcomes during the study periods are shown in Table S1-S3 of Additional file 6.
Effect of differentiated digital intervention on ART adherence
The ITT analysis showed that the differentiated digital intervention significantly improved the proportions of optimal ART adherence (RR = 1.74, 95% CI 1.21–2.50). Subgroup analysis by ART duration showed that the differentiated digital intervention was effective among those who initiated ART ≤ 3 years (RR = 1.75, 95% CI 1.08–2.84). Subgroup analyses by different digital strategies showed that instant message-based intervention was effective in improving ART adherence (RR = 2.40, 95% CI 1.39–4.17).
The PP and AT analysis produced similar results and the estimated effects were larger. In PP and AT analysis, the effect of differentiated digital intervention on ART adherence was 2.15 (95% CI 1.43–3.23) and 2.00 (95% CI 1.37–2.93) respectively. The effect of instant message-based intervention was 3.25 (95% CI 1.76–6.00) and 3.21 (95% CI 1.85–5.59), respectively. In addition, the differentiated digital intervention was effective among both those initiated ART ≤ 3 years (PP analysis: RR = 2.04, 95% CI 1.20–3.48; AT analysis: RR = 1.80, 95% CI 1.09–2.97) and >3 years (PP analysis: RR = 2.05, 95% CI 1.06–3.97; AT analysis: RR = 2.06, 95% CI 1.12–3.80) (Fig. 5). After combining the instant message subgroup and instant message plus social media subgroup, the intervention was still effective (ITT: RR = 1.81, 95% CI: 1.16–2.82; PP analysis: RR = 2.52, 95% CI 1.52–4.17; AT analysis: RR = 2.46, 95% CI 1.55–3.88) (Additional file 7: Figure S2). In addition, the absolute effect size (i.e., RD and 95% CI) for primary outcomes are presented in Table S1 of Additional file 8.
Effect of differentiated digital intervention on secondary outcomes
Table 2 displays the results of secondary outcomes using ITT strategies. There was no significant difference in proportions of viral suppression (RR = 1.39, 95% CI 0.64–3.05), CD4 T cell counts (MD = − 1.55, 95% CI − 17.51–14.42), HIV treatment adherence self-efficacy (MD = 1.41, 95% CI − 0.09–2.92), and quality of life (MD = 0.47, 95% CI − 0.43–1.36). Subgroup analysis showed that instant message plus social media group intervention increased the psychological quality of life (MD = 0.64, 95% CI 0.16–1.11) (Additional file 9: Table S1). The sensitivity analysis (PP and AT) of secondary outcomes are displayed in Table S1-S2 of Additional file 10.
ART adherence is critical to achieving viral suppression and reducing HIV-associated mortality and morbidity . This study evaluated the effectiveness of a differentiated digital intervention on ART adherence among MSM living with HIV using a pragmatic RCT. We found that the differentiated digital intervention was effective in improving ART adherence. The one-to-one instant message was particularly useful in increasing ART adherence in terms of different digital strategies. This study expands the existing literature on differentiated digital interventions, selects digital media based on MSM preferences, and focuses on a middle-income country context . Most digital HIV interventions focused on testing and were conducted in high-income countries .
Our data suggested that a differentiated digital intervention increased ART adherence among MSM living with HIV. Within our study cohort, 23.2% of participants (including 17.1% in the intervention arm and 28.9% in the control arm) self-reported suboptimal adherence at 6-months follow-up. The prevalence of suboptimal adherence was higher than that (4.8%) reported in an Asian cohort . However, this cohort only measured percent adherence without considering dose-timing. Taking ART medications at irregular times can change its pharmacokinetic and pharmacodynamics effects, suggesting the equivalent importance of monitoring dose-timing adherence. Our finding contrasts with an RCT in China, which found that a combined digital intervention (text message and instant message) did not improve ART adherence (also be categorized as binary outcome based on ever missed doses within one-month period) . One important difference was that all participants were allowed to decide the digital strategy based on their preferences in this study, suggesting that differentiation may enhance ART adherence . Given that digital technologies offer the potential to reach large number of PLWH and differentiation strategy can improve engagement, similar differentiated digital interventions may be worth promoting in LMIC contexts.
Our findings showed that the differentiated intervention was effective among those who started ART more recently and long ago. Considering that patients with short ART duration were relatively inexperience, we speculated that the intervention may be particularly effective. However, PP and AT analyses showed that the intervention effect was larger among patients with longer ART duration. Previous cohort studies suggested that adherence would decrease with the extension of ART duration [44, 45]. In view of this, intensive and novel intervention may have greater room to promote adherence in this subgroup.
In this study, most MSM preferred one-to-one instant messaging and this digital strategy was effective. Our study utilized instant message platform to deliver multimedia (e.g., images and videos) materials, which volunteers designed from a MSM organization with extensive HIV intervention experience. Previous studies showed that community engagement and multimedia materials were more attractive and effective in delivering HIV interventions [46, 47]. In addition, we customized a WeChat mini-program as a reminder and clock-punching tool, and provided financial incentives for those who used online clock-punching. The WeChat mini-program attracted some participants’ engagement and assisted in developing habits of taking medications on time. About a quarter of MSM preferred text messaging, but it did not significantly improve ART adherence, which may be because simple text messages were not sufficient to sustain the attention of participants . Contrary to expectations, the instant message plus social media intervention did not significantly improve ART adherence. Although we nominated the administrators to guide communications in the group, we could not prevent group members from contacting with each other in private. Unsupervised online communication could result in a number of unforeseen risks, including exposure to misleading information, facing hostile or derogatory comments from others, and feeling more uncertain about one’s health condition . Additional research with larger samples is needed to further evaluate the group intervention effects.
After the intervention, we did not observe significant improvements in CD4 T cell counts and HIV viral suppression. It may be due to the relatively short duration of follow-up. Previous data showed that changes in biological outcomes could be delayed up to two years since reporting suboptimal ART adherence .
This study has several research and policy implications. First, the differentiated digital intervention is responsive to the needs of PLWH and can contribute to adherence and patient satisfaction. Policy makers can consider integrating this intervention model into PLWH management. Further, most participants preferred one-to-one instant messaging and the digital strategy was effective. Researchers should consider instant message delivery when planning HIV interventions among MSM living with HIV. Text messages may be complementary to expanding dissemination, especially for elders who cannot access the Internet and those who are more concerned about Internet privacy . Finally, in addition to serving as an intervention component, WeChat mini-programs could also be a long-term adherence monitoring tool (tracking the records of clock-punching). The mini-program is more convenient, private, and cost-effective than the Wisepill device .
This study is subject to several limitations. First, the primary outcome of ART medication adherence was based on self-report. Nevertheless, previous studies showed that self-reported adherence was strongly associated with biological outcomes [53, 54]. We also collected biological outcomes (CD4 T cell counts and viral load) from medical records as secondary outcomes. Second, participants were allowed to choose digital strategy based on their preferences, and the end of recruitment was based on reaching the total sample size instead of satisfying the sample sizes of all three subgroups. Hence, the sample size of text message subgroup and instant message plus social media subgroup was slightly lower than expected, which may decrease power of the two subgroup analyses. Third, the generalizability of the study was limited because we only recruited participants from one site in China. These interventions did not generalize to other settings with fewer resources, varied access to technology and the Internet, and people with different cultural and social perspectives or lower literacy, and increased infection in the elderly. Further studies are needed among groups of different ages, cultures, and locations. In addition, there may be contamination between intervention and control arm. To evaluate the effect of contamination, we asked the participants whether they had seen materials that should only be delivered to intervention arm in the second follow-up, and then conducted PP and AT analyses. Fourth, adherence is a complex phenomenon and PLWH may become habituated to the intervention. The 6-month follow-up may be not enough to evaluate the long-term intervention effect considering that the effect of adherence interventions would wane over time . A longer follow-up time would be important to understand sustainment over time.
The differentiated digital intervention effectively improved ART adherence among MSM living with HIV in China. This intervention could be integrated into PLWH management and further considered in middle-income countries (e.g., Brazil, Nigeria) where there are large numbers of PLWH who can access text messaging or instant messaging services. In terms of different digital strategies, one-to-one instant message with multimedia technologies was particularly useful in increasing ART adherence. Instant message delivery may be considered as priority when planning HIV interventions among MSM living with HIV. The study contributed to recommendations to promote community engagement and multimedia technologies (e.g., images, videos, and mini program) in health service delivery and use differentiation strategy to expand service coverage.
Availability of data and materials
The datasets used and/or analyzed during the current study are available from the corresponding author (email@example.com) on reasonable request.
Center for Disease Prevention and Control
Generalized linear mixed model
Low- and middle-income country
Men who have sex with men
People living with HIV
Randomized controlled trial
Short message service
Sexually transmitted infection
The Joint United Nations Programme on HIV/AIDS
United States dollars
Cohen MS, Chen YQ, McCauley M, Gamble T, Hosseinipour MC, Kumarasamy N, et al. Prevention of HIV-1 infection with early antiretroviral therapy. N Engl J Med. 2011;365(6):493–505.
Deeks SG, Lewin SR, Havlir DV. The end of AIDS: HIV infection as a chronic disease. Lancet. 2013;382(9903):1525–33.
The Joint United Nations Programme on HIV/AIDS. 2021 World AIDS Day report - Unequal, unprepared, under threat: why bold action against inequalities is needed to end AIDS, stop COVID-19 and prepare for future pandemics. https://www.unaids.org/sites/default/files/media_asset/2021_WAD_report_en.pdf. Accessed 30 Mar 2022.
Costa JDO, Schaffer AL, Medland NA, Litchfield M, Narayan SW, Guy R, et al. Adherence to antiretroviral regimens in australia: a nationwide cohort study. AIDS Patient Care STDS. 2020;34(2):81–91.
Benson C, Wang X, Dunn KJ, Li N, Mesana L, Lai J, et al. Antiretroviral adherence, drug resistance, and the impact of social determinants of health in HIV-1 patients in the US. AIDS Behav. 2020;24(12):3562–73.
Chakraborty A, Hershow RC, Qato DM, Stayner L, Dworkin MS. Adherence to antiretroviral therapy among HIV patients in India: a systematic review and meta-analysis. AIDS Behav. 2020;24(7):2130–48.
Zhou H, Wang F, Liu L, Zhang M, Chen X, Jin S. Comparisons of adherence to antiretroviral therapy in a high- risk population in China: a systematic review and meta-analysis. PLoS One. 2016;11(1):e146659.
Shubber Z, Mills EJ, Nachega JB, Vreeman R, Freitas M, Bock P, et al. Patient-reported barriers to adherence to antiretroviral therapy: a systematic review and meta-analysis. PLoS Med. 2016;13(11):e1002183.
Quinn KG, Voisin DR. ART adherence among men who have sex with men living with HIV: key challenges and opportunities. Curr HIV/AIDS Rep. 2020;17(4):290–300.
The Joint United Nations Programme on HIV/AIDS. 2021 UNAIDS Global AIDS Update - Confronting inequalities - lessons for pandemic responses from 40 years of AIDS. https://www.unaids.org/sites/default/files/media_asset/2021-global-aids-update_en.pdf. Accessed 31 Aug 2021.
He N. Research progress in the epidemiology of HIV/AIDS in China. China CDC Wkly. 2021;3(48):1022–30.
Yang X, Qian Y, Zhang N, Hao L, Huang P, Hu J, et al. Analysis of the epidemiological characteristics of HIV/AIDS in Shandong Province. J Pathog Biol. 2018;13(01):68–71 (In Chinese).
Crim SM, Tie Y, Beer L, Weiser J, Dasgupta S. Barriers to antiretroviral therapy adherence among HIV-positive hispanic and Latino men who have sex with men -United States, 2015-2019. MMWR Morb Mortal Wkly Rep. 2020;69(40):1437–42.
Graham SM, Mugo P, Gichuru E, Thiong’ OA, Macharia M, Okuku HS, et al. Adherence to antiretroviral therapy and clinical outcomes among young adults reporting high-risk sexual behavior, including men who have sex with men, in coastal Kenya. AIDS Behav. 2013;17(4):1255–65.
Risher KA, Kapoor S, Daramola AM, Paz-Bailey G, Skarbinski J, Doyle K, et al. Challenges in the evaluation of interventions to improve engagement along the HIV care continuum in the United States: a systematic review. AIDS Behav. 2017;21(7):2101–23.
Cao B, Gupta S, Wang J, Hightow-Weidman LB, Muessig KE, Tang W, et al. Social media interventions to promote HIV testing, linkage, adherence, and retention: systematic review and meta-analysis. J Med Internet Res. 2017;19(11):e394.
World Health Organization. WHO Guideline: Recommendations on Digital Interventions for Health System Strengthening. https://www.who.int/servicedeliverysafety/areas/people-centred-care/ipchs-what/en/#:~:text=People%2Dcentred%20health%20services%20is,in%20humane%20and% 20holistic%20ways. Accessed 30 Mar 2022.
Daher J, Vijh R, Linthwaite B, Dave S, Kim J, Dheda K, et al. Do digital innovations for HIV and sexually transmitted infections work? Results from a systematic review (1996-2017). BMJ Open. 2017;7(11):e17604.
Saberi P, Johnson MO. Correlation of Internet use for health care engagement purposes and HIV clinical outcomes among HIV-positive individuals using online social media. J Health Commun. 2015;20(9):1026–32.
Obar JA, Wildman S. Social media definition and the governance challenge: an introduction to the special issue. Telecommun. Policy. 2015;39(9SI):745–50.
Garett R, Smith J, Young SD. A review of social media technologies across the global HIV care continuum. Curr Opin Psychol. 2016;9:56–66.
Statista. https://www.statista.com/statistics/272014/global-social-networks-ranked-by-number-of-users/. Accessed 30 Mar 2022.
World Health Organization. Consolidated Guidelines on the Use of Antiretroviral Drugs for Treating and Preventing HIV Infection 2016 Recommendations for a public health approach. http://www.who.int/hiv/pub/arv/arv-2016/en/. Accessed 30 Mar 2022.
Demena BA, Artavia-Mora L, Ouedraogo D, Thiombiano BA, Wagner N. A systematic review of mobile phone interventions (SMS/IVR/Calls) to improve adherence and retention to antiretroviral treatment in low-and middle-income countries. AIDS Patient Care STDS. 2020;34(2):59–71.
Rooks-Peck CR, Wichser ME, Adegbite AH, DeLuca JB, Barham T, Ross LW, et al. Analysis of systematic reviews of medication adherence interventions for persons with HIV, 1996-2017. AIDS Patient Care STDS. 2019;33(12):528–37.
Finitsis DJ, Pellowski JA, Johnson BT. Text message intervention designs to promote adherence to antiretroviral therapy (ART): a meta-analysis of randomized controlled trials. PLoS One. 2014;9(2):e88166.
Kanters S, Park JJ, Chan K, Socias ME, Ford N, Forrest JI, et al. Interventions to improve adherence to antiretroviral therapy: a systematic review and network meta-analysis. Lancet HIV. 2017;4(1):e31–40.
International AIDS Society. Differentiated care for HIV: a decision framework for Antiretroviral therapy. http://www.differentiatedcare.org/Portals/0/adam/Content/yS6M-GKB5EWs_uTBHk1C1Q/File/Decision%20Framework.pdf. Accessed 31 Aug 2021
Duncombe C, Rosenblum S, Hellmann N, Holmes C, Wilkinson L, et al. Reframing HIV care: putting people at the centre of antiretroviral delivery. Trop Med Int Health. 2015;20:430–47.
Tanner AE, Mann L, Song E, Alonzo J, Schafer K, Arellano E, et al. weCARE: A social media-based intervention designed to increase HIV care linkage, retention, and health outcomes for racially and ethnically diverse young MSM. AIDS Educ Prev. 2016;28(3):216–30.
Schulz KF, Altman DG, Moher D. CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials. BMJ. 2010;340:c332.
Ajzen I. The theory of planned behavior. Organ Behav Hum Dec. 1991;50(2):179–211.
Kanters S, Park JJ, Chan K, Ford N, Forrest J, Thorlund K, et al. Use of peers to improve adherence to antiretroviral therapy: a global network meta-analysis. J Int AIDS Soc. 2016;19(1):21141.
Whiteley LB, Olsen EM, Haubrick KK, Odoom E, Tarantino N, Brown LK. A review of interventions to enhance HIV medication adherence. Curr HIV/AIDS Rep. 2021;18(5):443–57.
Hao L, Wan F, Ma N, Wang Y. Analysis of the development of WeChat mini program. J Phys: Conf Ser. 2018;1087:62040.
Sabin LL, Bachman DM, Gill CJ, Zhong L, Vian T, Xie W, et al. Improving adherence to antiretroviral therapy with triggered real-time text message reminders: the China adherence through technology study. J Acquir Immune Defic Syndr. 2015;69(5):551–9.
Sun L, Yang SM, Wu H, Chen B, Wang CJ, Li XF. Reliability and validity of the Chinese version of the HIV Treatment Adherence Self-Efficacy Scale in mainland China. Int J STD AIDS. 2017;28(8):829–37.
O’Connell KA, Skevington SM. An international quality of life instrument to assess wellbeing in adults who are HIV-positive: a short form of the WHOQOL-HIV (31 items). AIDS Behav. 2012;16(2):452–60.
Ruan Y, Xiao X, Chen J, Li X, Williams AB, Wang H. Acceptability and efficacy of interactive short message service intervention in improving HIV medication adherence in Chinese antiretroviral treatment-naive individuals. Patient Prefer Adherence. 2017;11:221–8.
Maartens G, Celum C, Lewin SR. HIV infection: epidemiology, pathogenesis, treatment, and prevention. Lancet. 2014;384(9939):258–71.
Bijker R, Jiamsakul A, Kityo C, Kiertiburanakul S, Siwale M, Phanuphak P, et al. Adherence to antiretroviral therapy for HIV in sub-Saharan Africa and Asia: a comparative analysis of two regional cohorts. J Int AIDS Soc. 2017;20(1):21218.
Guo Y, Xu Z, Qiao J, Hong YA, Zhang H, Zeng C, et al. Development and feasibility testing of an mHealth (text message and WeChat) Intervention to improve the medication adherence and quality of life of people living with HIV in China: pilot randomized controlled trial. JMIR Mhealth Uhealth. 2018;6(9):e10274.
World Health Organization. Global strategy on people-centred and integrated health services: interim report. https://apps.who.int/iris/bitstream/handle/10665/155002/WHO_HIS_SDS_2015.6_eng.pdf;jsessionid=E8F7EB1647169FE215A07D5DE58D99A7?sequence=1. Accessed 31 Aug 2021
Lima VD, Harrigan R, Bangsberg DR, Hogg RS, Gross R, Yip B, et al. The combined effect of modern highly active antiretroviral therapy regimens and adherence on mortality over time. J Acquir Immune Defic Syndr. 2009;50(5):529–36.
Parruti G, Manzoli L, Toro PM, D’Amico G, Rotolo S, Graziani V, et al. Long-term adherence to first-line highly active antiretroviral therapy in a hospital-based cohort: predictors and impact on virologic response and relapse. AIDS Patient Care STDS. 2006;20(1):48–56.41.
Tang W, Wei C, Cao B, Wu D, Li KT, Lu H, et al. Crowdsourcing to expand HIV testing among men who have sex with men in China: a closed cohort stepped wedge cluster randomized controlled trial. PLoS Med. 2018;15(8):e1002645.
Tang W, Han L, Best J, Zhang Y, Mollan K, Kim J, et al. Crowdsourcing HIV Test promotion videos: a noninferiority randomized controlled trial in China. Clin Infect Dis. 2016;62(11):1436–42.
Linnemayr S, Huang H, Luoto J, Kambugu A, Thirumurthy H, Haberer JE, et al. Text messaging for improving antiretroviral therapy adherence: no effects after 1 year in a randomized controlled trial among adolescents and young adults. Am J Public Health. 2017;107(12):1944–50.
Naslund JA, Aschbrenner KA, Marsch LA, Bartels SJ. The future of mental health care: peer-to-peer support and social media. Epidemiol Psychiatr Sci. 2016;25(2):113–22.
Nachega JB, Hislop M, Dowdy DW, Chaisson RE, Regensberg L, Maartens G. Adherence to nonnucleoside reverse transcriptase inhibitor-based HIV therapy and virologic outcomes. Ann Intern Med. 2007;146(8):564–73.
Zhou XF, Chen L. Digital health care in China and access for older people. Lancet Public Health. 2021;6:e873–4.
Bachman DM, Gifford AL, Keyi X, Li Z, Feng C, Brooks M, et al. Feasibility and acceptability of a real-time adherence device among HIV-positive IDU patients in China. AIDS Res Treat. 2013;2013:957862.
Mannheimer S, Friedland G, Matts J, Child C, Chesney M. The consistency of adherence to antiretroviral therapy predicts biologic outcomes for human immunodeficiency virus-infected persons in clinical trials. Clin Infect Dis. 2002;34(8):1115–1121.52.
Dziva CC, Ferrand RA, Simms V. Association between self-reported adherence and HIV viral load suppression among older children and adolescents. J Acquir Immune Defic Syndr. 2017;76(3):e87–9.
We would like to thank Tiger and other volunteers from Qingdao Qingtong Anti-AIDS Volunteer Service Center for designing images of intervention materials and recording peer education videos. We would like to thank Kaka from Jinan Rainbow Group for helping to develop the WeChat mini-program. We would like to thank Guangmei Liu, Xiuhong Zhao, Yanmei Bi, Qian Chen, and other health providers from Shandong Public Health Clinical Center for helping to recruit participants. We would like to thank Chunxiao Cheng, Yu Yan, Yijun Li, Wenwen Jia, Lina Wang, Yanwen Cao, Zhonghui Zhao, Jing Meng, and Xuan Yang from Shandong University for data collection and entry.
The study was supported by the National Key Research and Development Program of China (grant number: 2017YFE0103800). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Ethics approval and consent to participate
Written informed consents were obtained from all participants. This study was reviewed and approved by the Ethical Review Committee of School of Public Health in Shandong University (20190210).
Consent for publication
The authors declare that they have no competing interests.
CONSORT 2010 Checklist for reporting parallel group RCTs.
Health messages and peer education stories. Table S1. ART medication messages. Table S2. HIV clinical messages. Table S3. Peer education stories. Table S4. Health behavior and nutrition messages.
Short articles shared to QQ group.
Basic characteristics of the participants in three digital subgroups. Table S1. Socio-demographic, behavioral and clinical characteristics of the study participants in three digital subgroups.
Measurements of the secondary outcomes at baseline and two follow-ups. Table S1. Measurements of CD4 T cell counts and proportions of HIV viral suppression at baseline and two follow-ups. Table S2. Measurements of HIV treatment adherence self-efficacy at baseline and two follow-ups. Table S3. Measurements of quality of life at baseline and two follow-ups.
Sensitivity analysis of combining two subgroups. Figure S1. Proportions of optimal ART adherence in the combined subgroups (i.e., instant message subgroup and instant message plus social media subgroup). Figure S2. Effect of the combined instant message-based and instant message plus social media intervention on ART adherence among MSM living with HIV in China, 2020-2021. Abbreviations: ART, antiretroviral therapy; RR, risk ratio; CI, confidence interval; ITT, intention-to-treat; PP, per-protocol; AT, as-treated.
Absolute effect size of primary outcome. Table S1. Absolut effect size of differentiated digital intervention on ART adherence among MSM living with HIV in China, 2020-2021.
Intervention effect on various domains of quality of life using ITT analysis. Table S1. Effect of differentiated digital intervention on various domains of quality of life using ITT analysis among MSM living with HIV in China, 2020-2021.
Sensitivity analyses of the secondary outcomes. Table S1. Effect of differentiated digital intervention on secondary outcomes using PP analysis among MSM living with HIV in China, 2020-2021. Table S2. Effect of differentiated digital intervention on secondary outcomes using AT analysis among MSM living with HIV in China, 2020-2021.
About this article
Cite this article
Jiao, K., Wang, C., Liao, M. et al. A differentiated digital intervention to improve antiretroviral therapy adherence among men who have sex with men living with HIV in China: a randomized controlled trial. BMC Med 20, 341 (2022). https://doi.org/10.1186/s12916-022-02538-3