Validity and reliability of the Italian version of the cardiac quality of life questionnaire for pediatric patients with heart disease (PedsQLTM)

Abstract

Background

Congenital heart disease (CHD) accounts for nearly a third of all major congenital anomalies. Advances in pediatric cardiology shifted attention from mortality to morbidity and health-related quality of life (HRQOL) of patients with CHD and impact on their families. The purposes of this study were to assess the validity and reliability of the Italian version of the Pediatric Quality of Life (PedsQL) Cardiac Module and to create normative data for the Italian population.

Methods

This was an observational cross-sectional study of pediatric patients (aged 2–18 years) with congenital or acquired Heart Disease (HD) and their parents. Families were asked to complete the cardiac pediatric health-related quality of life questionnaire (the Italian PedsQL™ 3.0 Cardiac Module) and the generic pediatric health-related quality of life questionnaire (PedsQL™ 4.0 Generic Core Scales). The sequential validation procedure of the original United States version of the PedsQL™ 3.0 Cardiac Module was carried out under the instruction of the MAPI Research Institute.

To assess construct validity, Pearson’s correlation coefficients were assessed between scores on the Cardiac Module scales and scores on the scales of the General Module. To determine agreement between patient self-report and parent proxy-report, we used intraclass correlation coefficients (ICCs). To evaluate Internal consistency of items, we used Cronbach’s alpha Coefficient.

Results

The study enrolled 400 patients. Construct validity is good between PedsQL Cardiac Module total scores and PedsQL total scores (p < 0.001). The recommended standard value of 0.7 was reached on the Cardiac and General Module core scales. Intercorrelations between PedsQL Cardiac module and PedsQL scores revealed medium to large correlations. In general, correlations between Patient self-reports are poorer than Parent-proxy ones.

Conclusions

Cardiac PedsQL scores are valid and reliable for pediatric patients with congenital and acquired HD and may be useful for future research and clinical management.

Background

Congenital heart diseases (CHD) accounts for nearly a third of all major congenital anomalies. The reported incidence of congenital heart disease (CHD) is 7–9 per 1000 live births and remains the leading cause of death for children under 1 year of age [1]. Literature does not provide certain and unambiguous data on the incidence of acquired heart diseases in pediatric population [2]. In recent decades, new surgical techniques and advances in cardiopulmonary bypass, intensive care, heart transplantation, and interventional catheterization have significantly reduced mortality rates for children with heart diseases (HD). Consequently, an increasing number of children are living with chronic HD, 85–90% of whom will reach adulthood, although many of them will require lifelong follow-up [3, 4]. These advances in pediatric cardiology have an influence on morbidity, quality of life (QOL), and health-related quality of life (HRQOL) of children with heart disease, and the impact on their families [4]. Chronic heart disease is often associated with physical symptoms and may impair the patient’s psychological and social well-being and functioning. Therefore, in order to increase overall understanding of the disease, specific tools for assessment of health-related quality of life are advocated [5, 6]. HRQOL is a multidimensional construct which includes physical, psychological and social well-being and functioning [7].

The Pediatric Quality of Life Inventory Version 4.0 Generic Core Scales (PedsQL) is one of the main instruments for measuring pediatric patients’ health related quality of life and one of the very few instruments widely used to assess HRQOL among patients between the ages of 2 and 18 years [8]. PedsQL includes patient and parent versions and assesses different dimensions: physical, emotional, social, and school functioning [9]. Moreover, in order to evaluate HRQoL according to specific clinic conditions, Authors have developed disease-specific modules concerning, for example, ADHD, cancer, asthma and heart disease [10,11,12,13,14,15]. In particular, Uzark et al. determined reliability and validity of the PedsQL™ 3.0 Cardiac Module as a brief, multidimensional measure of health related quality of life in pediatric cardiology [15]. The instrument has five scales related to symptoms (7 items), perceived physical appearance (3 items), treatment anxiety (4 items), cognitive problems (5 items), and communication (3 items) for parent proxy-report and pediatric patients 8–18 years. The communication scale was not included for toddlers and young children who do not have the cognitive or language ability to verbalize questions and explanations about the heart. An additional treatment barriers scale (5 items) was imbedded in the module to measure adherence issues in subjects taking cardiac medications [15].

The aim of this study was to produce an Italian version of the PedsQL Cardiac Module that is semantically and culturally equivalent to the original English version and to assess its psychometric properties in a sample of pediatric patients with heart disease between 2 and 18 years of age.

Methods

This was an observational cross-sectional study of pediatric patients with congenital or acquired Heart Disease (HD) and their parents. It was performed at Bambino Gesù Children’s Hospital and Research Institute between September 2016 and December 2017. The study involved patients aged 2–18 with congenital or acquired HD attending an outpatient cardiology unit. Exclusion criteria: major developmental delay that could affect health-related quality of life, developmental problems that limited understanding and/or verbal communication, language barrier. Parents or legal tutors of all patients signed a detailed written informed consent, all patients above 16 years of age signed a written informed assent. All eligible, consenting/assenting patients and parents were enrolled in the study. Participants completed a battery of questionnaires that included: a family form to collect socio-demographic information, the PedsQL™ 3.0 Cardiac Module, and the Italian version of the PedsQL Generic Core Scales 4.0.

As described in previous studies by Uzark et al., do Nascimento et al. and Berkes et al., the PedsQL™ 3.0 Cardiac Module presents a list of items to the patients/parents and asks them to report how problematic each item has been for the patient in the past month [6, 15, 16]. The Cardiac Module provides child self-report and parent proxy-report forms. Ages for child self-report forms are: 5–7, 8–12 and 13–18 years. In parallel, ages for parent proxy-report forms are: 2–4 (toddler), 5–7 (young child), 8–12 (child), and 13–18 (adolescent). In parent-proxy report forms parents are asked to evaluate their child’s HRQOL. Five answer options are listed in the versions for patients 8 to 18 years old and for all versions for parents (0 = it is never a problem; 1 = it is almost never a problem; 2 = it is sometimes a problem; 3 = it is often a problem; and 4 = it is almost always a problem). The answers in the version for children 5–7 years old was simplified to three options (0 = not at all; 2 = sometimes; and 4 = a lot) on a visual scale that exhibited a happy, neutral, and sad face, respectively. As to the scoring, answer options must be transformed as follows: 0 = 100; 1 = 75; 2 = 50; 3 = 25; and 4 = 0. Higher scores indicated a better HRQOL. The sum of all the items over the number of items answered provides mean score. Child self-report and parent proxy-report formats are shown in Additional file 1.

The instruction of the MAPI Research Institute, in accordance with the guidelines of the QOL-SIG TCA (Quality of Life—Special Interest Group Translation and Cultural Adaptation) group, were followed for the validation procedure of the original U. S. version of the PedsQL™ 3.0 Cardiac Module [6, 15,16,17,18,19,20,21].

As described in above-cited studies, the validation process begins with two professional native language speakers’ translators who translate the PedsQL™ 3.0 Cardiac Module independently into Italian. Both translators debated the two translated versions with a pediatric cardiologist creating a single agreed version that was translated back into English. This version was sent to the questionnaire’s author for comments and approval. Cognitive interviews with 8 couples of parents of patients with HD aged 2–18 years and with 8 patients aged 5–18 years were performed to control if each item was simple enough to be understood. MAPI Research Institute gave its approval to the so-built final version.

As described by Uzark et al., the PedsQL™ 4.0 Generic Core Scales encompasses Physical Functioning (8 items), Emotional Functioning (5 items), Social Functioning (5 items), and School Functioning (5 items) [15]. The PedsQL™ provides child self-report and parent proxy-report forms. Ages for child self-report forms are: 5–7, 8–12 and 13–18 years. In parallel, ages for parent proxy-report forms are: 2–4, 5–7, 8–12 and 13–18 years. In parent-proxy report forms parents are asked to evaluate their child’s HRQOL. Five answer options are listed in the versions for patients 8 to 18 years old and for all versions for parents (0 = it is never a problem; 1 = it is almost never a problem; 2 = it is sometimes a problem; 3 = it is often a problem; and 4 = it is almost always a problem). The answers in the version for children 5–7 years old was simplified to three options (0 = not at all; 2 = sometimes; and 4 = a lot) on a visual scale that exhibited a happy, neutral, and sad face, respectively. As to the scoring, answer options must be transformed as follows: 0 = 100; 1 = 75; 2 = 50; 3 = 25; and 4 = 0. Higher scores indicated a better HRQOL. The sum of all the items over the number of items answered provides mean score.

Statistical analysis

We describe the clinical and demographic characteristics of all the patients enrolled in this study. We calculated descriptive statistics and report mean ± SDs or median with IQR and ranges as appropriate for the data distribution. We report percentages for categorical or dichotomous variables.

Acceptability of this study was determined by the low percentage of missing values.

Since the response items were expressed on an ordinal scale, we used Cronbach coefficient to evaluate scale internal consistency reliability [22]. Psychological scales with internal consistency reliabilities of 0.90 are usually recommended for analysing individual patient scores, whereas an internal consistency reliability criterion of 0.70 is recommended for comparing patient groups [23]. Range of measurement was based on the percentage of scores at the minimum and maximum of the scaling range, that is, the minimum possible score (floor effect matches at percentage of scale scores at 0) and the maximum possible score (ceiling effect matches percentage of scale scores at 100).

Study with moderate floor or ceiling effects (> 15%) are considered less precise in measuring latent constructs at the extremes of the scale, similarly study with small floor or ceiling effects (1–15%) are considered to meet acceptable measurement standards [24].

Construct validity was assessed by examining Pearson’s correlation coefficients between scores on the Cardiac Module scales and scores on the scales of the General Module. Pearson Correlation coefficients are defined small if r < 0.30, medium if r ≥ 0.30 and r ≤ 0.50, and large if r ≥ 0.50 [24]. In this regard, we expected large correlations between Cardiac Module total score and Generic Core Scales total score; Heart Problems and Treatment (Cardiac module) and Physical Health (Generic module); Cognitive Problems (Cardiac module) and School Functioning (Generic module).

Since the considered variables can be treated as continuous variables, we used intra-class correlation coefficients (ICCs) to determine agreement between patient self-report and parent proxy-report because it takes into account the ratio between subject variability and total variability [25]. ICCs are defined poor if agreement are less than 0.40, between 0.41 and 0.60 are defined moderate agreement, between 0.61 and 0.80 are good agreement, and between 0.81 and 1.00 are excellent agreement [26].

Statistical significance was assumed as p < 0.05 for all tests. All statistical analyses were performed using STATA, Statistical Software: Release 13. College Station, Tx: StataCorp 2013.

Results

Subjects’ demographic characteristics

Families of 400 patients were consecutively enrolled in the study. In 318 families, only one parent filled up the questionnaires, in 82 families both parents filled up the questionnaires. Of the 482 parents who took part in the study, 291 (60.4%) were mothers and 191 (39.6%) were fathers. Sociodemographic data of the sample are shown in Table 1.

Table 1 Demographic characteristics

Subjects’ heart clinical characteristics

Heart diagnosis of the 400 patients and their distribution in age cluster are shown in Table 2. It was not possible to conduct comparisons with a group of healthy children and the cardiologists considered the categories not comparable by disease severity.

Table 2 Heart diseases

Association of PedsQL cardiac module with PedsQL scores

Internal consistency-reliability

The internal consistency-reliability values of the 2 modules are presented in Tables 3 and 4, respectively. The recommended standard value of 0.7 was reached on the Cardiac and General Module core scales. Internal consistency was more than 0.7 for some dimensions in the different age groups. Patients in 5–18 age groups and Parents in 2–18 age groups presented high values in Treatment Anxiety scale and Communication scale in Cardiac Module (Table 5).

Table 3 Internal consistency reliability of patients PedsQL cardiac module and patients PedsQL generic module (Cronbach coefficient)

Table 4 Internal consistency reliability of parents PedsQL cardiac module and parents PedsQL generic module (Cronbach coefficient)

Table 5 Pearson’s correlation coefficients between cardiac and generic module (n = 400)

However, internal consistency was less than 0.7 for some dimensions such as Heart Problems and Treatment scale in Cardiac Module in Patients in 5–18 age groups, in Perceived Physical Appearance scale in Cardiac Module in Children and Parents in 5–7 age groups, and in Cognitive Problems scale in Cardiac Module in Children in 5–7 age groups and Parents in 2–7 age groups.

Internal consistency was more than 0.7 for some dimensions of the Generic Module such as Emotional Functioning in Parents and Patients in 8–18 age groups and School Functioning in Parents in 2–4 age groups in Generic Module.

When considering patients’ gender, some differences were found for internal consistency reliability scores for female versus male patients (Table 3).

Comparison of patient and parent in PedsQL Cardiac module and PedsQL scores

Intercorrelations between PedsQL Cardiac module and PedsQL scores revealed medium to large correlations. In general, correlations between Patient self-reports are poorer than Parent-proxy ones.

As hypothesized, PedsQL Cardiac Module total score correlates with PedsQL total score in all age clusters and for both the Patient version and Parent version r > 0.38 and r > 0.88 (p < 0.001); Heart Problems and treatment score correlates with Physical Health score r > 0.47 and r > 0.92 (p < 0.001); Cognitive problems score (r > 0.41, p < 0.001) correlates with School functioning r > 0.79, p < 0.001).

Parent-patient agreement in cardiac module

The ICCs between Patient self-reports and Parent proxy-reports of the PedsQL™ 3.0 Cardiac Module are given in Table 6. The results obtained were: moderate to good values in both patient and parent groups in the Cardiac Scale; lower values in the Heart problems and treatment, Cognitive problems and Communication Scales across all age groups, and in the Perceived Physical appearance and Treatment anxiety Scales in 8–18 year-olds from the patient group.

Table 6 Intraclass correlations (ICCs) between Cardiac Module for child self-report and parent cardiac module proxy-report

Intraclass Correlations (ICC) showed good agreement in the Perceived Physical appearance and Treatment anxiety Scale scores of children aged 5–7 years and in Treatment II Scale scores of Patients age 8–18 years. ICCs for the Cardiac Module indicated excellent agreement in Treatment II scale in the 5–7 age group.

Additional file 2 shows Reliability and percent Floor and Ceiling Effects for Child Self Report and Parent Proxy-Report for PedsQL™ 3.0 Cardiac Module (Table 7) and PedsQL Generic Core Scales 4.0 (Table 8).

Discussion

The aim of the present study was to assess psychometric properties of the Italian version of the PedsQL™ 3.0 Cardiac Module and the PedsQL™ 4.0 Generic Core Scale in CHD population. Overall, our results show that the Italian translation of the PedsQL™ 3.0 Cardiac Module is a valid tool to assess HRQoL of Italian pediatric patients with CHD aged 2–18 years.

In particular, internal consistency was generally satisfactory, but nevertheless below the recommended standard value for some dimensions such as Heart Problems and Treatment Scale in patients 5–18 age group, Perceived Physical Appearance in patients and parents in the 2–7 age group and in Cognitive Problems in children and their parents in the 2–7 age group. Similar results had been found in previous studies, Berkes and colleagues in their validation study of the Hungarian Version of PedsQL Cardiac Module ascribe similar results to extremely high frequencies of missing values detected for the Treatment II and Perceived Physical Appearance subscales [6]. In accordance with our results, Gonzales and colleagues, in their validation of the Spanish version, found low internal consistency values in the Perceived Physical Appearance scale, and considered this to be related to the lack of consistency between the items and the neuromaturation and developmental level of the children in the lower age range [27]. Furthermore, when interpreting data of the Cognitive Problems scale, we must remember that in Italy primary school starts from the age of 6, but it frequently happens that children with CHD or other invalidating conditions postpone the beginning of school attending. This might have determined a high percentage of pre-school respondents influencing the data of Cognitive Problems scale. For the same reason, the issue of using school functioning subscale for children aged 2–7 years has been reported as a problem by other European researchers [6, 28, 29].

However, good internal consistency reliability values were found for the Treatment anxiety and Communication Scales, confirming the PedsQL Cardiac Module as a valid measure of the health related quality of life in medical context. This is an interesting finding considering how important it is for clinicians to be aware of how patients experience medical visits and examinations. In fact, as reported by Berkes et al. in accordance with other previous studies, heart diseases had an evident impact on the physical state, but also they considerably influence psychosocial dimensions [6, 7, 15, 16, 30,31,32].

Interestingly, when considering results of the PedsQL Generic Core Scales 4.0, our data showed low internal consistency in the Emotional Functioning dimension, especially in the 8–18 ages group. This finding seems to show a low emotional awareness in CHD patients in everyday life. As suggested by other Authors, these data may reflect patients’ emotional distress associated with their cardiac condition (see Additional file 2) [7, 33,34,35].

Lower internal consistency reliability values were calculated in the 2–4 age group for the School Functioning Scales of the Generic Core, which is consistent with previous findings [7]. We must consider that many children in our sample of this age do not attend school because of their disease, and therefore the small sample size could possibly compromise the precision of results.

Intercorrelations between the Cardiac Module Scales and the Generic Scales were significant, in particular the formulated hypothesis (i.e. correlations between total scores; Heart Problems and Treatment vs. Physical Health; Cognitive Problems vs. School Functioning) was confirmed substantiating the construct validity of the tool.

In contrast with previous studies [16], our data showed a poor agreement between child self- and parent proxy-reports, in particular for 8–18 age groups. We can speculate, as reported in literature, a tendency to parental underestimation of QOL and coping mechanisms of chronically ill children which can lead to disagreement [7, 29, 33, 36, 37]. Health care providers should be aware of the frequent disagreement in HRQoL perception which may result in pediatric patients being left alone with their unrecognized emotional distress or, on the other hand, lead to overprotection by parents due to underestimation of their child’s coping skills.

Conclusions

The Italian version of PedsQL™ 3.0 Cardiac Module is valid and reliable for pediatric patients with congenital and acquired HD and may be useful for future research and clinical management.