Skip to main content
Download PDF

Adaptation and validation of the Treatment Burden Questionnaire (TBQ) in English using an internet platform

BMC Medicine volume 12, Article number: 109 (2014) Cite this article

Abstract

Background

Treatment burden refers to the workload imposed by healthcare on patients, and the effect this has on quality of life. The Treatment Burden Questionnaire (TBQ) aims to assess treatment burden in different condition and treatment contexts. Here, we aimed to evaluate the validity and reliability of an English version of the TBQ, a scale that was originally developed in French.

Methods

The TBQ was translated into English by a forward-backward translation method. Wording and possible missing items were assessed during a pretest involving 200 patients with chronic conditions. Measurement properties of the instrument were assessed online with a patient network, using the PatientsLikeMe website. Dimensional structure of the questionnaire was assessed by factor analysis. Construct validity was assessed by associating TBQ global score wıth clinical variables, adherence to medication assessed by Morisky’s Medication Adherence Scale (MMAS-8), quality of life (QOL) assessed by the PatientsLikeMe Quality of Life Scale (PLMQOL), and patients’ confidence in their knowledge of their conditions and treatments. Reliability was determined by a test–retest method.

Results

In total, 610 patients with chronic conditions, mainly from the USA, UK, Canada, Australia, or New Zealand, completed the TBQ between September and October 2013. The English TBQ showed a unidimensional structure with Cronbach α of 0.90. The TBQ global score was negatively correlated with the PLMQOL score (rs = −0.50; p < 0.0001). Low rather than moderate or high adherence to medication was associated with high TBQ score (mean [SD] TBQ score 61.8 [30.5] vs. 37.7 [27.5]; P < 0.0001). The treatment burden was higher for patients who had insufficient knowledge compared with those who had sufficient knowledge about their treatments (mean ± SD TBQ score 62.3 ± 31.3 vs. 47.8 ± 30.4; P < 0.0001) and conditions (63.0 ± 31.6 vs. 49.3 ± 30.7; P < 0.0001). The intraclass correlation coefficient for the retest (n = 282) was 0.77 (95% CI 0.70 to 0.82).

Conclusions

We found that the English TBQ is a reliable instrument in this population, and provide evidence supporting the construct validity for its use to assess treatment burden for patients with one or more chronic conditions in English-speaking countries.

Peer Review reports

Background

Treatment burden is defined as the ‘work’ of being a patient and its effect on the quality of life (QOL) of patients. It represents the challenges associated with everything patients have to do to take care of themselves (e.g. medication intake, drug management, self-monitoring, visits to the physician, laboratory tests, lifestyle changes, administrative tasks to access and coordinate care) [1–3]. This work can represent a tremendous investment of time, attention, cognitive energy, and effort. For example, a patient with a chronic condition may spend 2 hours or more per day on health-related activities [4], and this increases for patients with multiple chronic conditions who receive treatment or recommendations for each of their diseases [5, 6]. For these patients, treatment burden could be considered a crucial outcome for disease management [7]. Difficulties with their treatment are often not shared in depth by patients during medical consultations [8], and physicians are often not aware of the challenges their patients face in coping with everything asked of them [9]. Thus, a tool that is simple to understand and easy to administer is needed to identify overburdened patients in daily practice and for research, in order to design new therapeutic strategies that are both efficient and acceptable for patients.

The Treatment Burden Questionnaire (TBQ) is the only existing instrument that measures treatment burden without restricting its scope to a single condition or treatment context [9, 10]. The TBQ is composed of 13 items rated on a Likert scale ranging from 0 (not a problem), to 10 (big problem). The TBQ was derived from a literature review and qualitative semi-structured interviews with patients in France. It assesses the burden associated with taking medicine, self-monitoring, laboratory tests, doctor visits, need for organization, administrative tasks, following advice on diet and physical activity, and social impact of the treatment. Item scores can be summed into a global score, ranging from 0 to 130. The instrument was first developed with a sample of patients with one or more chronic conditions, who were recruited from hospitals and general-practice clinics in France.

To measure treatment burden in English-speaking countries, the TBQ needs to be adapted: items must remain comprehensible without changing their original meaning, and it should be recognized that new items could arise in different contexts whereas some existing items might be irrelevant. Patients must be involved in the process to ensure that the resulting tool is clear and relevant [11].

In this study, we aimed to assess the validity and reliability of an English version of the TBQ intended to be used in both routine practice and in research for patients with at least one chronic condition living in the USA, Canada, UK, Australia, or New Zealand.

Methods

Adaptation and validation of the TBQ in English followed a multi-step approach recommended in the literature [12–14]: 1) review the conceptual evidence about treatment burden in English-speaking countries; 2) translate the TBQ into English; 3) pretest the instrument with patients to assess the relevance of items, clarity and wording and; 4) assess validity and reliability by a test–retest of the adapted instrument.

Conceptual evidence of treatment burden in English-speaking countries

During a literature review of MEDLINE via Pubmed, we identified several articles describing the concept of treatment burden in English-speaking countries. In the USA, Eton and colleagues identified three broad themes for treatment burden: 1) work patients must do to take care of their health, 2) problem-focused strategies to facilitate self-care, and 3) factors that exacerbate the perceived burden [2]. In the UK, Gallacher and associates found four similar themes in patients with chronic heart failure and stroke: 1) learning about treatments and their consequences, 2) engaging with others, 3) adhering to treatment and lifestyle changes, and 4) monitoring their treatments [15, 16]. Finally, in Australia, Sav and associates identified four inter-related components of treatment burden: 1) financial, 2) time and travel, 3) medication, and 4) healthcare access burdens [17].

The original TBQ encompassed all of these domains, with the exception of the financial treatment burden, because in France, the public health insurance program guarantees healthcare free of charge for patients with chronic conditions. Therefore, we added a new item in the English adaptation of the TBQ: ‘How would you rate the financial burden associated with your healthcare (e.g., out-of-pocket expenses or expenses not covered by insurance)?’

Translation of the TBQ into English

Translation of the TBQ intoEnglish involved a classic ‘forward-backward’ translation method [13]. First, the original instrument in French was translated into English by two bilingual translators; one (CB) had a medical background, and was familiar with the concept of treatment burden. Second, the two obtained translations were synthesized and reviewed by a committee, which included the authors of the original questionnaire. Third, two different translators, blinded to the original version, back-translated the questionnaire into French. Finally, the committee reviewed and synthesized all translations to elaborate English items that were similar to the original items and easy to answer.

Pre-testing the instrument

To assess the relevance of items, clarity, and wording, we pre-tested the obtained instrument with a convenience sample of 200 participants in August 2013 (see Additional file 1). We used an internet platform, the Open Research Exchange (ORE) [18, 19], to recruit patients on PatientsLikeMe (PLM) [20], an online network where 200,000 voluntary participants with chronic conditions share data about their treatment, conditions, and symptoms. Members of PLM join the site with the expectation that they will be participating in research. To participate, patients had to have at least one chronic condition (defined as requiring ongoing healthcare for at least 6 months). After having answered the questionnaire, they provided feedback about 1) the clarity, wording, and relevance of the items, and 2) any burden that they felt was not covered or insufficiently covered in the questionnaire in an open-ended manner. Their answers were categorized and discussed by two of the authors (VT-T and CB).

Concerning the wording of items, 10 patients (5.0%) felt that the word ‘constraints’ was confusing, thus we replaced the word ‘constraints’ by the word ‘problem’, as suggested by the patients. Patients were also asked whether there were any important elements of treatment burden that they considered to be missing from questions: 15 patients (7.5%) thought that relationships between patients and healthcare providers were insufficiently covered in the original items. Other suggestions were either specific to a particular condition, were related to the burden of disease, or were already covered in the existing items. Thus, we added a new item for testing: ‘How would you rate the difficulties you could have in your relationships with healthcare providers (e.g., feeling not listened to enough or not taken seriously)?’ After the pretest, the English TBQ was therefore composed of 15 items, with rating scales ranging from 0 to 10 and labeled anchors (‘not a problem’ and ‘large problem’).

Assessment of validity and reliability of the English TBQ

We studied the measurement properties of the instrument by 1) describing the item properties, 2) assessing factor structure, 3) assessing construct validity, and 4) assessing reliability by test–retest.

We recruited a convenience sample of patients via the aforementioned internet platform. Patients were eligible if they were 18 years or older, and had at least one condition that had required ongoing health care for at least 6 months. We sent email invitations to a random sample of 3,000 members on the internet platform who did not participate in the pretest and who met the eligibility criteria, encouraging them to connect to the website and complete the questionnaire. To increase the number of respondents, an email reminder was sent after 2 months. Patients consented electronically to participate in the study. The recruitment message outlined the purpose of the study and reminded patients that they were under no obligation to participate, that their aggregated results may be published. Because there were no anticipated adverse consequences for participation, institutional review board (IRB) approval was not sought for this project.

Item properties were described using three criteria: 1) proportion of missing answers, 2) relevance of items assessed by the proportion of ‘does not apply,’ and 3) score distributions.

Factor structure was investigated by exploratory factorial analysis. Scree plots were used to visualize a break between factors with large eigenvalues and those with smaller eigenvalues. Factors that appeared before the horizontal break were assumed to be meaningful. Internal consistency was assessed by Cronbach’s α [21], and was considered acceptable between 0.70 and 0.95 [22].

The global score of the TBQ (TBQ Global score) was the sum of the answers to each item. ‘Does not apply’ or missing answers were considered the lowest possible score (0) because we considered that a patient not concerned by a domain of treatment burden had no burden for that domain.

Construct validity was tested by confirming four pre-specified hypotheses. First, we expected a negative correlation between treatment burden (as measured by the TBQ global score) by the TBQ global score) and quality of life. Quality of life was measured by the PatientsLikeMe Quality of Life (PLMQOL) scale, a validated 24-item questionnaire assessing physical, mental, and social quality of life. PLMQOL scores range from 0 to 100 for each domain (higher scores indicating better quality of life) and are summed for a global assessment of quality of life [23]. Second, we predicted an association between TBQ global score and adherence to medication: the greater the treatment burden, the lower the adherence to treatment. Adherence to medical treatment was measured by Morisky’s Medication Adherence Scale 8 (MMAS-8) [24, 25], a validated eight-item questionnaire, with scores ranging from 0 to 8. High adherence is a score of 8; medium adherence, 6 to 7; and low adherence, less than 6 [24]. Third, we hypothesized that patients with better knowledge of their conditions and treatments would have a low treatment burden. Confidence in patients’ knowledge about their treatments and conditions was assessed by two questions: ‘Do you think you have sufficient knowledge about your conditions (e.g., symptoms, disease progression)?’ and ‘Do you think you have sufficient knowledge about your treatments (e.g., possible side effects, expected benefits, other treatment options)?’. Answers were rated on a five-step scale: ‘very sufficient’, ‘sufficient’, ‘average’, ‘insufficient’ and ‘very insufficient’. Finally, we assumed a positive correlation between TBQ global score and the following clinical variables: 1) number of conditions, 2) drug administration (number of tablets, injections, and administrations per day), and 3) medical follow-up (number of different physicians, medical appointments per month, and hospitalizations per year).

To elicit the chronic conditions a patient had, we asked the patient to self identify the condition(s) from a list recommended as core for any measure of multimorbidity [26]. Options were presented as categories illustrated by common conditions; for example: ‘Rheumatologic disease (e.g. osteoporosis, arthritis, or inflammatory polyarthropathies)’. Patients were encouraged to complete their answer with free text. The text was analyzed, and the condition was categorized in the appropriate category by a single investigator (VTT).

The association between the TBQ global score, quality of life score and clinical variables was assessed by Spearman correlation coefficient (rs), which was considered high when greater 0.50, and moderate when 0.35 to 0.50 [27]. Wilcoxon and Kruskal-Wallis tests were used to compare qualitative variables across groups. P < 0.05 was considered statistically significant.

Reliability of the instrument was determined by a test–retest method. Patients were asked to complete the new instrument twice: at baseline and again after 2 weeks when they received an email reminder. Reliability was assessed by the intraclass correlation coefficient (ICC) for agreement [28], defined as the ratio of the subject variance by the sum of the subject variance, the rater variance and the residual. The 95% confidence interval (CI) was determined by a bootstrap method. Agreement was considered acceptable when ICC was greater than 0.60 [29]. Agreement was represented by Bland and Altman plots, which represent the differences between two measurements against the means of the two measurements [30].

Statistical analyses were performed using SAS (version 9.3; SAS Inst., Cary, NC, USA) and R (version 3.0 [31], the R Foundation for Statistical Computing, Vienna, Austria).

Results

In total, 3,000 patients were invited to complete the TBQ, and 610 (20.3%) did so between September and October 2013. The mean ± SD age was 51.5 ± 2.4 years. Patients resided mainly in the USA (57.5%), Canada (8.4%), UK (8.7%), and Australia/New Zealand (3.4%). Some patients (13.3%) lived in other countries (Belgium, Brazil, Chile, Czech Republic, Denmark, Finland, France, Germany, India, Ireland, Israel, Italy, Malaysia, Norway, Oman, Portugal, Russia, South Africa, Spain, Switzerland, Ukraine, and Uzbekistan), or the country of residence was missing (8.7%). The mean ± SD number of chronic conditions was 2.9 ± 1.9 (range 1 to 11) (Table 1).

Table 1 Demographic and clinical characteristics of patients in the validation study (n = 610) and retest of the Treatment Burden Questionnaire (TBQ) for an English-speaking population (n = 282)
Full size table

We found a high completion rate (>99%) for all items. All items were relevant for all patients, with the proportion of ‘does not apply’ ranging from 0.6% to 7.2%, with the exception of the burden associated with self-monitoring (30.3%) (see Additional file 2). The TBQ global score was the sum of the answers to each of the 15 items, and ranged from 0 to 150 (‘Does not apply’ was considered the lowest possible score). The global score had a high correlation with the score for each item of the TBQ (rs = 0.47 to 0.71) (see Additional file 3).

Factor structure, assessed by scree plots, favored a unidimensional instrument. The first factor explained 87% of the variance, and had an eigenvalue of 5.91. For subsequent factors, eigenvalues wereless than 0.80 (see Additional file 4).

Construct validity showed a significant moderate negative correlation between the TBQ global score and PLMQOL score (rs = −0.50; P < 0.0001). Correlation coefficients ranged from rs = −0.39 (P < 0.0001) for physical quality of life to rs = −0.50 (P < 0.0001) for mental quality of life, indicating that patients with high TBQ score had low quality of life (Table 2). We found a significant association between treatment burden measured by the TBQ global score and adherence to medication measured by the MMAS-8: mean ± SD TBQ global score was 37.7 ± 27.5 for patients with high or moderate adherence, and 61.8 ± 30.5 for patients with low adherence (P < 0.0001) (Table 2). The TBQ score was also significantly associated with patients’ confidence in their knowledge about their treatments and conditions. The mean ± SD TBQ global score was 47.8 ± 30.4 for patients who felt that they had sufficient knowledge about their treatment, versus 62.3 ± 31.3 for those who felt that they had insufficient knowledge (P < 0.0001). The mean ± SD TBQ global score was 49.3 ± 30.7 for patients declaring sufficient knowledge about their conditions versus 63.0 ± 31.6 for those with insufficient knowledge (P < 0.0001) (Table 2). Finally, we found a low to moderate significant positive correlation of TBQ score with clinical variables in terms of number of different conditions, drug administrations (number of tablets, injections, and administrations per day) and medical follow-up (number of different physicians, medical appointments per month, and hospitalizations per year) (see Additional file 5).

Table 2 Association of adherence to medication, patients’ evaluation of their knowledge about their treatment and conditions and QOL with TBQ global score (n = 610)
Full size table

Reliability was assessed by a test–retest method for 282 patients (46%). Participants in the retest showed similar characteristics as patients in the test phase (Table 1). For the TBQ global score, the ICC for agreement was 0.77 (95% CI 0.70 to 0.82) (see Additional file 6). Bland and Altman plots for the global TBQ score showed a mean difference of −0.58; 95% limits of agreement −43.5 and 42.3 (Figure 1).

Figure 1
figure 1

Bland and Altman plot of the test–retest reliability of the TBQ global score (n = 280).

Full size image

Subgroup analysis showed a high TBQ global score for patients who needed equipment such as wheelchairs or canes (mean ± SD score 69.0 ± 33.4), those who received physical therapy (62.7 ± 33.9), and those who had gastrointestinal (65.4 ± 32.5) or skin (64.9 ± 30.8) diseases (see Additional file 7). TBQ scores did not differ for the most common healthcare location (public hospital, private hospital, general practice, or specialist clinic) (P = 0.97).Overall, treatment burden scores were homogeneous and comparable between countries. The lowest mean (SD) TBQ score was for the item related to self-monitoring (from 0.6 ± 1.1 in Canada to 1.7 ± 2.8 in Australia/New Zealand) and the highest was for the item related to the effect of healthcare on relationships with others (from 4.0 ± 3.5 in Canada to 6.7 ± 3.8 for Australia/New Zealand) (Figure 2).

Figure 2
figure 2

Comparison of scores for TBQ items by country (n = 529) a .

Full size image

Discussion

We adapted the TBQ for patients with one or more chronic conditions living in the USA, Canada, the UK, Australia, or New Zealand. This is the first valid and reliable instrument assessing treatment burden across multiple conditions and treatments.

During the adaptation process, we added two new items to the English TBQ that did not exist in the original study, which took place in France [9]. First, we added an item about the financial treatment burden. In France, the national health program guarantees healthcare free of charge for patients with chronic conditions. However, in countries where the English TBQ was administered, this is not always the case [10, 17]. For example, 30% to 47% of patients in the USA may have problems paying medical bills [32]. Second, during the pretest, patients expressed difficulties that they had in their relationships with healthcare providers. This item was not included in the original French questionnaire because the authors felt that it measured a concept different from treatment burden. However, it was mentioned in subsequent qualitative studies [2, 15, 16] and, in the present study, participants insisted on including this item to take into account how discussion with physicians could affect how much they knew about their conditions and treatment, and how non-optimal relationships with healthcare providers could hinder adherence to treatment, lifestyle changes, or follow-up. During the first study, patients may have felt hindered in mentioning this issue to the investigators during face-to-face interviews and therefore the point was underestimated. Use of a web-based questionnaire has shown a decrease in socially desirable responses, and an increase in willingness to disclose sensitive information [33].

Our results highlight the advantages of using an internet platform: we were able to include 200 patients with chronic conditions from different countries in the pretest in less than 1 month. Therefore, we gathered rich qualitative data on questionnaire items and possible missing concepts, indicating the high content validity of our tool.

The item properties of the English TBQ were comparable with those from the original study in France with 1) a significant floor effect (>15%) for all items, which reflects that patients could have no burden in the aspects of their care that they have already integrated into their lives, and 2) about 30% of ‘Does not apply’ for the item related to self-monitoring. As for the original questionnaire in French, we chose to keep the item about self-monitoring because it was considered a mandatory item for other patients, particularly those with diabetes.

The validation study included 610 patients from different countries with different conditions and treatments. As hypothesized, we highlighted statistically significant associations between the overall treatment burden and adherence to medication, patients’ confidence in their knowledge about their conditions and treatment, and quality of life. To our knowledge, this is the first study to report such associations independent of disease or treatment contexts. Development of interventions to improve patient knowledge about therapeutic options could lead to shared decision making, reduced treatment burden,better adherence to medication, and better quality of life for patients.

We compared TBQ scores between countries and found that most item scores were homogeneous for patients in the USA, UK, Canada, and Australia/New Zealand, with two exceptions. First, we found increased financial treatment burden for patients residing in the USA and Australia. This result was expected because qualitative studies in these countries described the financial burden as one of the issues most widely discussed by patients [10, 17]. Second, in the UK, we found increased treatment burden related to patients’ relationships with their healthcare providers. This finding could be related to pay-for-performance initiatives (for example, Quality and Outcomes Framework) that may encourage physicians to focus on biomedical objectives and spend less time listening to patients’ non-medical problems. More research is needed to understand the precise aspects of treatment burden, and why patients might experience different aspects in each of these countries.

This study has several limitations. First, to measure patients' confidence in their knowledge about their treatments and conditions, we used questions that were not validated. However, participants reviewed these questions during the pretest in the same way they reviewed the questions of the TBQ. Patients expressed no difficulties in answering these questions, and we found neither any missing answers, nor a floor or ceiling effect. Second, we recruited patients through the PLM website only, and from this patient group, only 20% of the invited patients responded to the web survey. This response rate was similar to that from other studies involving online surveys. This recruitment method might have selected patients willing to share their experiences with others and/or with severe or rare conditions. We did not include participants who were not able to access a computer. Therefore, our sample is not representative of the general population of patients with one or more chronic conditions: overall patients in our study were younger, more educated, and more often female (similar to other studies involving the PLM website [34–36]). Prevalence of chronic conditions in our study differed from those of chronic conditions of patients seeking healthcare in national surveys. For example, we found a high proportion of patients with neurological conditions, because PLM was initially developed for these patients. Although these biases were considered relatively small, psychometric properties for the TBQ (especially reliability estimates) might differ in other populations. Despite these limitations, use of an online platform has a number of advantages. First, we were able to involve a larger number of patients than in usual cross-cultural adaptation studies (800 participants including pretest) [37] in a very short time (2 months from pretest to results). Second, the recruited patients were geographically dispersed and thus, we might have avoided selecting only patients living near research centers. Finally, patients involved were engaged in research, and therefore provided us with rich feedback at every stage of our research, which may have contributed to the development of questionnaire items closer to patients’ own words and problems.

The present study advances the evidence of the validity of the TBQ. Further studies should focus on testing other psychometric properties such as responsiveness in longitudinal and prospective studies. The TBQ can be implemented in clinical trials assessing interventions intended to mitigate treatment burden and its negative effect on quality of life to develop a Minimally Disruptive Medicine [1].

Conclusions

We adapted and validated the TBQ for English-speaking countries (USA, UK, Canada, and Australia) using an online patient-based platform for direct interaction with patients. This study resulted in the first instrument assessing treatment burdenfor any condition and treatment context in these countries.

References

  1. May C, Montori VM, Mair FS: We need minimally disruptive medicine. BMJ. 2009, 339: b2803-10.1136/bmj.b2803.

    Article  PubMed  Google Scholar 

  2. Eton DT, Ramalho de Oliveira D, Egginton JS, Ridgeway JL, Odell L, May CR, Montori VM: Building a measurement framework of burden of treatment in complex patients with chronic conditions: a qualitative study. Patient Relat Outcome Meas. 2012, 3: 39-49.

    Article  PubMed  PubMed Central  Google Scholar 

  3. Eton DT, Elraiyah TA, Yost KJ, Ridgeway JL, Johnson A, Egginton JS, Mullan RJ, Murad MH, Erwin PJ, Montori VM: A systematic review of patient-reported measures of burden of treatment in three chronic diseases. Patient Relat Outcome Meas. 2013, 4: 7-20.

    Article  PubMed  PubMed Central  Google Scholar 

  4. Jowsey T, Yen L, PM W: Time spent on health related activities associated with chronic illness: a scoping literature review. BMC Public Health. 2012, 12: 1044-10.1186/1471-2458-12-1044.

    Article  PubMed  PubMed Central  Google Scholar 

  5. Boyd CM, Darer J, Boult C, Fried LP, Boult L, Wu AW: Clinical practice guidelines and quality of care for older patients with multiple comorbid diseases: implications for pay for performance. JAMA. 2005, 294: 716-724. 10.1001/jama.294.6.716.

    Article  CAS  PubMed  Google Scholar 

  6. Guthrie B, Payne K, Alderson P, McMurdo ME, Mercer SW: Adapting clinical guidelines to take account of multimorbidity. BMJ. 2012, 345: e6341-10.1136/bmj.e6341.

    Article  PubMed  Google Scholar 

  7. Montori VM, Brito JP, Murad MH: The optimal practice of evidence-based medicine: incorporating patient preferences in practice guidelines. JAMA. 2013, 310: 2503-2504. 10.1001/jama.2013.281422.

    Article  CAS  PubMed  Google Scholar 

  8. Bohlen K, Scoville E, Shippee ND, May CR, Montori VM: Overwhelmed patients: a videographic analysis of how patients with type 2 diabetes and clinicians articulate and address treatment burden during clinical encounters. Diabetes Care. 2012, 35: 47-49. 10.2337/dc11-1082.

    Article  PubMed  Google Scholar 

  9. Tran VT, Montori VM, Eton DT, Baruch D, Falissard B, Ravaud P: Development and description of measurement properties of an instrument to assess Treatment Burden among patients with multiple chronic conditions. BMC Med. 2012, 10: 68-10.1186/1741-7015-10-68.

    Article  PubMed  PubMed Central  Google Scholar 

  10. Eton DT, Oliveira DR, Egginton J, Mair FS, May C, Montori VM: Understanding the burden of treatment in patients with multiple chronic conditions: Evidence from exploratory interviews. Qual Life Res. 2010, 19: ab-1673

    Article  Google Scholar 

  11. McKenna SP: Measuring patient-reported outcomes: moving beyond misplaced common sense to hard science. BMC Med. 2011, 9: 86-10.1186/1741-7015-9-86.

    Article  PubMed  PubMed Central  Google Scholar 

  12. Acquadro C, Conway K, Hareendran A, Aaronson N: Literature review of methods to translate health-related quality of life questionnaires for use in multinational clinical trials. Value Health. 2008, 11: 509-521. 10.1111/j.1524-4733.2007.00292.x.

    Article  PubMed  Google Scholar 

  13. Beaton DE, Bombardier C, Guillemin F, Ferraz MB: Guidelines for the process of cross-cultural adaptation of self-report measures. Spine (Phila Pa 1976). 2000, 25: 3186-3191. 10.1097/00007632-200012150-00014.

    Article  CAS  Google Scholar 

  14. Wild D, Grove A, Martin M, Eremenco S, McElroy S, Verjee-Lorenz A, Erikson P: Principles of good practice for the translation and cultural adaptation process for patient-reported outcomes (PRO) measures: report of the ISPOR Task Force for Translation and Cultural Adaptation. Value Health. 2005, 8: 94-104. 10.1111/j.1524-4733.2005.04054.x.

    Article  PubMed  Google Scholar 

  15. Gallacher K, May CR, Montori VM, Mair FS: Understanding patients’ experiences of treatment burden in chronic heart failure using normalization process theory. Ann Fam Med. 2011, 9: 235-243. 10.1370/afm.1249.

    Article  PubMed  PubMed Central  Google Scholar 

  16. Gallacher K, Morrison D, Jani B, Macdonald S, May CR, Montori VM, Erwin PJ, Batty GD, Eton DT, Langhorne P, Mair FS: Uncovering treatment burden as a key concept for stroke care: a systematic review of qualitative research. PLoS Med. 2013, 10: e1001473-10.1371/journal.pmed.1001473.

    Article  PubMed  PubMed Central  Google Scholar 

  17. Sav A, Kendall E, McMillan SS, Kelly F, Whitty JA, King MA, Wheeler AJ: ‘You say treatment, I say hard work’: treatment burden among people with chronic illness and their carers in Australia. Health Soc Care Community. 2013, 21: 665-674.

    PubMed  Google Scholar 

  18. The Open Research Exchange. [http://www.openresearchexchange.com]

  19. Wicks P, Heywood B, Heywood J: Online platform to accelerate patient involvement in open instrument development. Qual Life Res. 2013, 22: 55.

    Google Scholar 

  20. PatientsLikeMe. [http://www.patientslikeme.com]

  21. Cronbach L: Coefficient alpha and the internal structure of tests. Psychometrika. 1951, 16: 297-334. 10.1007/BF02310555.

    Article  Google Scholar 

  22. Nunnaly J, Bernstein I: Psychometric theory. 1994, New York: McGraw-Hill, 3

    Google Scholar 

  23. Slawsky K, Massagli M, Wicks P: PRM30 a comparison of the PatientsLikeMe Quality of Life Questionnaire (PLMQOL) with the RAND SF-36. Value Health. 2011, 14: A426.

    Article  Google Scholar 

  24. Morisky DE, Ang A, Krousel-Wood M, Ward HJ: Predictive validity of a medication adherence measure in an outpatient setting. J ClinHypertens (Greenwich). 2008, 10: 348-354. 10.1111/j.1751-7176.2008.07572.x.

    Article  Google Scholar 

  25. Morisky DE, Green LW, Levine DM: Concurrent and predictive validity of a self-reported measure of medication adherence. Med Care. 1986, 24: 67-74. 10.1097/00005650-198601000-00007.

    Article  CAS  PubMed  Google Scholar 

  26. Diederichs C, Berger K, Bartels DB: The measurement of multiple chronic diseases–a systematic review on existing multimorbidity indices. J Gerontol A BiolSci Med Sci. 2011, 66: 301-311.

    Article  Google Scholar 

  27. Juniper E, Guyatt G, Jaeschke R: How to develop and validate a new health-related quality of life instrument. Quality of life and pharmacoeconomics in clinical trials. Edited by: Spilker B. 1996, Philadelphia - New York: Lippincott - Raven, 49-56.

    Google Scholar 

  28. Shrout PE, Fleiss JL: Intraclass correlations: uses in assessing rater reliability. Psychol Bull. 1979, 86: 420-428.

    Article  CAS  PubMed  Google Scholar 

  29. Streiner D, Norman G: Health Measurement Scales: a practical guide to their development and use, Fourth Edition edn. 2008, Oxford: Oxford University Press

    Book  Google Scholar 

  30. Bland JM, Altman DG: Measuring agreement in method comparison studies. Stat Methods Med Res. 1999, 8: 135-160. 10.1191/096228099673819272.

    Article  CAS  PubMed  Google Scholar 

  31. The R Project for Statistical Computing. [http://www.R-project.org]

  32. Ubel PA, Abernethy AP, Zafar SY: Full disclosure–out-of-pocket costs as side effects. N Engl J Med. 2013, 369: 1484-1486. 10.1056/NEJMp1306826.

    Article  CAS  PubMed  Google Scholar 

  33. Ekman A, Litton JE: New times, new needs; e-epidemiology. Eur J Epidemiol. 2007, 22: 285-292. 10.1007/s10654-007-9119-0.

    Article  PubMed  Google Scholar 

  34. Bove R, Secor E, Healy BC, Musallam A, Vaughan T, Glanz BI, Greeke E, Weiner HL, Chitnis T, Wicks P, De Jager PL: Evaluation of an online platform for multiple sclerosis research: patient description, validation of severity scale, and exploration of BMI effects on disease course. PLoS One. 2013, 8: e59707-10.1371/journal.pone.0059707.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  35. Wicks P, Sulham KA, Gnanasakthy A: Quality of life in organ transplant recipients participating in an online transplant community. Patient. 2014, 7: 73-84. 10.1007/s40271-013-0033-0.

    Article  PubMed  Google Scholar 

  36. De la Loge C, Keininger D, Isojärvi J, Massagli MP, Wicks P: Characteristics of users of the epilepsy community of PatientsLikeMe.com and comparison with a representative claims database. 63rd Annual Meeting of the American Academy of Neurology. 2011, Honolulu, USA

    Google Scholar 

  37. Bowden A, Fox-Rushby JA: A systematic and critical review of the process of translation and adaptation of generic health-related quality of life measures in Africa, Asia, Eastern Europe, the Middle East, South America. Soc Sci Med. 2003, 57: 1289-1306. 10.1016/S0277-9536(02)00503-8.

    Article  PubMed  Google Scholar 

Pre-publication history

Download references

Acknowledgments

We thank Laura Smales (BioMedEditing), ADT International (Paris) and ISInfoglobal support (Barcelona) for editing and translation work, and Shimon Rura for help with data collection.

Funding

This study was funded by the French Health Ministry (PHRC AOM13127).

Author information

Authors and Affiliations

  1. Department of General Medicine, Paris Diderot University, Paris, France

    Viet-Thi Tran

  2. METHODS Team, Epidemiology and Statistics Sorbonne Paris Cité Research Centre, UMR 1153, INSERM, 1 place du Parvis Notre-Dame, Paris, 75181, France

    Viet-Thi Tran, Caroline Barnes & Philippe Ravaud

  3. Centre d'Épidémiologie Clinique, HôpitalHôtel-Dieu, Assistance Publique-Hôpitaux de Paris, Paris, France

    Viet-Thi Tran, Caroline Barnes & Philippe Ravaud

  4. PatientsLikeMe, Inc., Cambridge, Massachusetts, USA

    Magdalena Harrington & Paul Wicks

  5. Division of Health Care and Policy Research, Department of Health Sciences Research and Knowledge and Evaluation Research Unit, Mayo Clinic, Rochester, MN, USA

    Victor M Montori

  6. Paris Descartes University, Paris, France

    Caroline Barnes & Philippe Ravaud

  7. Department of Epidemiology, Columbia University Mailman School of Public Health, New York, NY, USA

    Philippe Ravaud

Authors
  1. Viet-Thi Tran
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Magdalena Harrington
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Victor M Montori
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Caroline Barnes
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Paul Wicks
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Philippe Ravaud
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Viet-Thi Tran.

Additional information

Competing interests

MH and PW are employees of PatientsLikeMe, and own stock or stock options in the company. The PatientsLikeMe research and development team has received research support from pharmaceutical companies and private foundations. VTT, VMM, CB and PR have no financial interests in PatientsLikeMe and no other conflicts of interest to disclose.

Authors’ contribution

VTT, MH, VMM, CB, PW, and PR conceived and designed the study. MH and PW acquired the data. VTT and CB analyzed and interpreted the data. VTT drafted the manuscript. MH, VMM, CB, PW, and PR critically revised the manuscript for important intellectual content. PR and PW provided administrative, technical, and material support. All authors saw and approved the final manuscript. PR is the guarantor, had full access to the data in the study, and takes responsibility for the integrity of the data and the accuracy of the data analysis.

Electronic supplementary material

12916_2014_992_MOESM1_ESM.docx

Additional file 1: Demographic and clinical characteristics of patients included in the pretest of the Treatment Burden Questionnaire (TBQ) (n = 200).(DOCX 14 KB)

Additional file 2: Item properties of the Treatment Burden Questionnaire (TBQ) (n = 610 patients).(DOCX 14 KB)

12916_2014_992_MOESM3_ESM.docx

Additional file 3: Correlation of each item of the Treatment Burden Questionnaire (TBQ) with the global score, omitting that item from the total (n = 610).(DOCX 13 KB)

Additional file 4: Scree plots and eigenvalues for the correlation matrix of the factor analysis (n = 610).(DOCX 28 KB)

12916_2014_992_MOESM5_ESM.docx

Additional file 5: Correlation between treatment burden scores and clinical variables in terms of treatment workload (n = 610).(DOCX 13 KB)

Additional file 6: Reliability testing by a test–retest method (n = 282).(DOCX 13 KB)

Additional file 7: Treatment Burden Questionnaire (TBQ) global score by different subgroups (n = 610).(DOCX 13 KB)

Authors’ original submitted files for images

Rights and permissions

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and Permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Tran, VT., Harrington, M., Montori, V.M. et al. Adaptation and validation of the Treatment Burden Questionnaire (TBQ) in English using an internet platform. BMC Med 12, 109 (2014). https://doi.org/10.1186/1741-7015-12-109

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/1741-7015-12-109

Keywords

  • Chronic Disease/therapy
  • Patient Participation
  • Quality of Life
  • Medication Adherence
  • Questionnaires

BMC Medicine

ISSN: 1741-7015

Contact us