1477-7525-2-24 1477-7525 Research <p>Testing the performance of the ENRICHD Social Support Instrument in cardiac patients</p> Vaglio Joseph Jr jvaglio@kumc.edu Conard Mark mwc13c@umkc.edu Poston S Walker PostonWa@umkc.edu O'Keefe James jhokeefe@cc-pc.com Haddock C Keith HaddockC@umkc.edu House John j1house@saint-lukes.org Spertus A John spertusj@umkc.edu

Mid America Heart Institute at St Lukes Hospital, Kansas City, MO, USA

University of Missouri, Kansas City, MO, USA

Health and Quality of Life Outcomes 1477-7525 2004 2 1 24 http://www.hqlo.com/content/2/1/24 15142277 10.1186/1477-7525-2-24
09 3 2004 13 5 2004 13 5 2004 2004 Vaglio et al; licensee BioMed Central Ltd. This is an Open Access article: verbatim copying and redistribution of this article are permitted in all media for any purpose, provided this notice is preserved along with the article's original URL. social support ESSI ENRICHD ischemic heart disease reliability validity

Abstract

Background

Previous investigations suggest an important role of social support in the outcomes of patients treated for ischemic heart disease. The ENRICHD Social Support Instrument (ESSI) is a 7-item self-report survey that assesses social support. Validity and reliability of the ESSI, however, has not been formally tested in patients undergoing percutaneous coronary intervention (PCI).

Methods

The ESSI, along with the Short Form-36 (SF-36), was sequentially administered to a cohort of 271 patients undergoing PCI. The test-retest reliability was examined with an intra-class correlation coefficient by comparing scores among 174 patients who completed both instruments 5 and 6 months after their procedure. Internal reliability was assessed using Cronbach's alpha at the time of patients' baseline procedure. The concurrent validity of the ESSI was assessed by comparing scores between depressed (MHI-5 score < 44) vs. non-depressed patients. The correlation between the ESSI and the SF-36 Social Functioning sub-scale, an accepted measure of social functioning, was also examined.

Results

Test-retest reliability showed no significant differences in mean scores among ESSI questionnaires administered 1 month apart (27.8+/-1.4 vs 27.8+/-1.5, p = 0.98). The intra-class correlation coefficient was 0.94 and Cronbach's alpha was 0.88. Mean ESSI scores were significantly lower among depressed vs. non-depressed patients (24.6+/-1.7 vs 27+/-1.4, p < 0.018) and a positive albeit modest correlation with social functioning was seen (r = 0.19, p = 0.002).

Conclusion

The ESSI appears to be a valid and reliable measure of social support in patients undergoing treatment for coronary artery disease. It may prove to be a valuable method of controlling for patient variability in outcomes studies where the outcomes are related to patients' social support.

Background

Social support is broadly defined as the existence or availability of people on whom one can rely; people who let one know that they are cared about, valued, and loved 1. Lack of social support is associated with increased morbidity and mortality in patients with ischemic heart disease 23. Growing awareness of the importance of social support on cardiovascular outcomes has necessitated the development of instruments to measure social support. The ENRICHD Social Support Instrument (ESSI) is one such measure derived from questions on the Medical Outcomes Survey and earlier work examining the influences of social support 345. The ESSI is a seven-item measure, used in recent clinical trials, that assesses the four defining attributes of social support: emotional, instrumental, informational, and appraisal 67.

The ESSI has demonstrated acceptable internal consistency and has shown to correlate positively with other social support instruments and negatively with measures of depression 689. Despite these scattered findings, the literature lacks a strong validation study of the questionnaire's psychometric properties. Therefore, our objective was to test the validity and reproducibility of the ESSI in patients undergoing percutaneous coronary intervention (PCI). In the absence of a "gold standard" for social support, the construct validity of the instrument was assessed by a series of comparisons of the ESSI with depression, social, mental, and physical functioning, disease-specific symptom severity, and quality of life. These analyses were undertaken to support the use of the ESSI when examining the relationship between social support and outcomes in cardiovascular disease.

Methods

Subjects and procedures

Participants in this study were from a consecutive cohort of PCI patients participating in the Post-revascularization REcovery StudieS (PRESS) at the Mid-America Heart Institute. The process of patient recruitment, mechanism, success and potential selection biases of baseline health status data collection have been previously described 10. In brief, 271 consecutive patients undergoing PCI from February to April 1999 were asked to participate in an observational research study documenting the recovery of their health status after coronary revascularization. Each consenting patient was administered a series of questionnaires at baseline and monthly thereafter for six months. During the 6-month recovery period, patients completed monthly a packet of self-report questionnaires identical to those at baseline, omitting the demographic information. These data were used to supplement an existing procedural database. Approval from the Saint Luke's Hospital Institutional Review Board was obtained prior to the beginning of this study.

Instruments

ENRICHD Social Support Instrument (ESSI)

As noted previously, the ESSI is a seven-item, self-report measure used in the ENRICHD trial 67. Individual items are then summed for a total score, with higher scores indicating greater social support. During this study, data on patients' marital status were collected at baseline, but omitted in follow-up questionnaires to eliminate redundant collection. Therefore, baseline marital status was extrapolated to each survey period although actual follow-up data was not collected. The seven ESSI items are presented in the Appendix (see Table 3).

SF-36 Mental Health Index and Social Functioning subscale

The SF-36 is a well-known and widely used generic measure of health status. The 36 items cover eight domains including: physical functioning, social functioning, role-physical, role-emotional, mental health, vitality, bodily pain, and general health 11. For the purposes of this study, we examined the Mental and Physical Health Component Scores, and Social Functioning subscale, which is a measure of the individual's functioning as a member of society. We also used the Mental Health Index (MHI) subscale, which assesses the individual's level of depression. The MHI subscale has demonstrated validity as a depression screen when compared to the Diagnostic Interview Schedule (area under the receiver operating curve = 0.89) 12.

Seattle Angina Questionnaire (SAQ) – Angina Frequency and disease-specific Quality of Life

The SAQ is a valid, reliable and responsive disease-specific measure of health status for patients with coronary disease 13141516. SAQ subscales used in this study were the angina frequency (SAQ-AF) and quality of life (SAQ-QOL) scales. The SAQ-AF measures the frequency of angina during the previous four weeks and the SAQ-QOL measures patients' perceptions of how their coronary disease impacts their quality of life. The SAQ-QOL has been found to be predictive of both 1-year mortality and 1-year hospital admission for acute coronary syndrome in univariate models. In addition, the SAQ-AF was a significant predictor of 1-year admission in adjusted multivariate models 17.

Statistical analysis

Determining reliability

The internal consistency of the ESSI was calculated using Cronbach's α, which measures the dispersion of different items within a single domain 18. Reproducibility, or test-retest reliability of the instrument was examined using paired t-tests of the mean ESSI scores at months 5 and 6. The most distant time points after patients procedure were selected to capture a stable and consistent period patients' social support; a period during which transient changes in social support around the time of coronary revascularization should have dissolved. In addition, the intra-class correlation coefficient (ICC) also was used to assess test-retest reliability between months 5 and 6. The ICC ranges from 0 – 1 and describes the proportion of total score variability due to between person differences 13. Higher ICCs reflect greater reproducibility.

Determining validity

In the absence of a "gold standard" measure of social support, several constructs were examined to support the validity of the ESSI. We expected that ESSI scores among depressed patients would be lower than non-depressed patients. To define depression, we used the SF-36 MHI score where those patients with scores less than 44 were classified as depressed. To quantitatively assess construct validity, independent sample t-tests of baseline mean ESSI scores were compared among depressed versus non-depressed patients.

Concurrent and predictive validity were examined by calculating the correlation coefficient between the ESSI total score and the SF-36 Social Functioning subscale, the SF-36 Physical and Mental Component Scores, and the SAQ-QOL scale at baseline and 6-months post-revascularization. We anticipated positive associations between social support and social functioning, general, and disease-specific QOL at both time points.

Results

Patient demographics

The study population consisted of 271 patients ranging in age from 37 to 87 years old who underwent PCI to treat ischemic coronary artery disease. The mean patient age was 64.1 years old (SD = 11.2). The population consisted of 32.5% women and 5.9% minorities. Seventy-four percent (74 %) of the patients reported being married. The mean level of education was 12.4 years (SD = 2.0) with 72% of the cohort reported attending some college or vocational school. On average, patients were able to complete the ESSI in 2–3 minutes. Furthermore, the data collectors reported no complaints from patients about completing the instrument.

Reliability

Internal consistency for the ESSI, using Cronbach's α, was 0.88. The inter-item correlations were examined, with significant associations being found between all items and item-total score (p < 0.001). However, question 7 (patient's marital status) consistently had the lowest correlation with the other ESSI items and total score. These results are presented in Table 1.

<p>Table 1</p>

ESSI inter-item correlations

ESSI Q1

ESSI Q2

ESSI Q3

ESSI Q4

ESSI Q5

ESSI Q6

ESSI Q7

ESSI Total


ESSI Q1

1.0

0.78

0.63

0.47

0.70

0.65

0.26

0.84

ESSI Q2

1.0

0.56

0.41

0.70

0.57

0.18*

0.80

ESSI Q3

1.0

0.46

0.65

0.65

0.37

0.79

ESSI Q4

1.0

0.49

0.48

0.42

0.74

ESSI Q5

1.0

0.76

0.28

0.87

ESSI Q6

1.0

0.25

0.83

ESSI Q7

1.0

0.38

ESSI Total

1.0

All ESSI inter-item correlations p < 0.001, except * p = 0.004.

Test-retest analysis was used to compare mean scores of ESSIs administered at months 5 and 6 after PCI. These time points were selected because they were thought to represent post-procedural periods of relative medical stability. The mean score at month 5 was 28.5 ± 5.6 (M ± SD) and month 6 was 28.5 ± 5.8 (p = 0.98), indicating no significant differences in ESSI scores. The intra-class correlation coefficient was 0.94, reflecting excellent reproducibility.

Concurrent and predictive validity

At baseline, the mean ESSI score among depressed patients was 22.8 ± 4.6 while the non-depressed group mean score was 26 ± 4.3 (p < 0.001). Similarly, patients living alone had significantly lower scores (16 ± 5.1) vs. patients living with someone (20 ± 3.8; p < 0.001). The SF-36 Social Functioning subscale showed a statistically significant albeit modest correlation with the ESSI (r = 0.19, p = 0.002).

Concurrent and predictive validity also was assessed by examining the correlations between the ESSI total score and the SF-36 Social Functioning, Mental Health Index, Mental Component, and Physical Component scales and the SAQ-QOL scale at both baseline and 6-months post-PCI. As can be seen in Table 2, the ESSI demonstrated modest, but statistically significant correlations with these measures at both time points. This suggests that patients with greater social support also experience better social functioning, improved symptom control, and better general and disease-specific quality of life.

<p>Table 2</p>

ESSI correlations with the SF-36 scales and the SAQ-QOL

Correlations at Baseline


SF-36 Social Functioning

SF-36 MHI

SF-36 PCS

SF-36 MCS

SAQ-AF

SAQ-QOL


ESSI Total

0.20

(p = .001)

0.36

(p < .001)

0.13

(p = .040)

0.31

(p < .001)

0.14

(p = .029)

0.22

(p = .001)


Correlations 6-Months Post-Revascularization


SF-36 Social Functioning

SF-36 MHI

SF-36 PCS

SF-36 MCS

SAQ-AF

SAQ-QOL


ESSI Total

0.33

(p < .001)

0.29

(p < .001)

0.20

(p = .004)

0.29

(p < .001)

0.18

(p = .008)

0.22

(p = .002)

Discussion

The present study confirms the concurrent and predictive validity and utility of the ESSI as an index of social support for use with PCI patients. The internal and test-retest reliability exceeds the recommended level of 0.70 for group assessments 19. The ESSI also demonstrated a positive correlation with social functioning (r = 0.20) and demonstrated the anticipated relationship of significantly lower scores among those who were depressed or living alone. In addition, it correlated with symptom improvement and better general and disease-specific quality of life at both baseline and 6-months post-PCI.

The results also provide conceptual insight into the nature of social support. The majority of questions on the ESSI consider general feelings about being loved and valued rather than instrumental types of support. This supports the theory that social support is not a tally of actual supportive "services" rendered, but rather a patient's belief that others care about them and are available if needed 20. This trend can be seen when examining the inter-item correlations presented in Table 1. Two items in particular, questions four and seven, have considerably lower correlations with the other questions. Question four has instrumental overtones and asks "Is there someone available to help you with daily chores?" The weaker associations with these items support the contention that instrumental support is a distinct construct when compared with other types of support that impact patients' health and well-being.

This study has several design limitations that should be noted. First, baseline social support was measured using a self-report questionnaire at the time of PCI and patient responses were not substantiated with family members, as would have ideally been the case. Secondly, the size and diversity of the patient sample was limited. With 271 patients and only 6% minorities, drawn from a single region of the United States, the population number and make-up limits the ability to generalize these results to the general population.

Despite these limitations, the results confirm the reliability and validity of the ESSI for gathering social support data among PCI patients. This study supports it's use in outcomes research that may help define the role of social support in affecting health outcomes. With psychometrically validated instruments in hand, future researchers should further elucidate the effects of social support on health and recovery in cardiac patients.

<p>Table 3</p>

ENRICHD Social Support Instrument

Item 1

Is there someone avaliable to whom you can count on to listen to you when you need to talk?

None of

the time

A little of

the time

Some of

the time

Most of

the time

All of

the time

Item 2

Is there someone avaliable to you to give you good advice about a problem?

Item 3

Is there someone avaliable to you who shows you love and affection?

Item 4

Is there someone avaliable to help with daily chores?

Item 5

Can you count on anyone to provide you with emotional support (talking over problems or helping you make a difficult decision)?

Item 6

Do you have as much contact as you would like with someone you feel close to, someone in whom you can trust and confide in?

Item 7

Are you currently married or living with a partner?

Yes

No

Authors' contributions

JV conceived the study and drafted the manuscript. MC participated in coordination of the study and statistical analyses. CP participated in design and coordination of this project. JO & KH contributed to the conception of the study. JH performed the statistical analysis. JS oversaw the execution of this project and edited the manuscript. All authors have read and approved the final manuscript.

Acknowledgements

This project was supported, in part, by an unrestricted grant from Searle Pharmaceuticals and, in part, by R-01 HS11282-01 from the Agency for Healthcare Research and Quality.

<p>Assessing Social Support: The social support questionnaire.</p> Sarason I., Levine, H., Basham, R., & Sarason, B. Journal of Personality and Social Psychology 1983 44 127 139 10.1037//0022-3514.44.1.127 <p>Biobehavioral variables and mortality or cardiac arrest in the Cardiac Arrhythmia Pilot Study (CAPS)</p> Ahern DK Gorkin L Anderson JL Tierney C Hallstrom A Ewart C Capone RJ Schron E Kornfeld D Herd JA et al. Am J Cardiol 1990 66 59 62 10.1016/0002-9149(90)90736-K 2193497 <p>Psychosocial predictors of mortality in the Cardiac Arrhythmia Suppression Trial-1 (CAST-1)</p> Gorkin L Schron EB Brooks MM Wiklund I Kellen J Verter J Schoenberger JA Pawitan Y Morris M Shumaker S Am J Cardiol 1993 71 263 267 10.1016/0002-9149(93)90788-E 8427165 <p>Emotional support and survival after myocardial infarction. A prospective, population-based study of the elderly</p> Berkman LF Leo-Summers L Horwitz RI Ann Intern Med 1992 117 1003 1009 1443968 <p>Prognostic importance of social and economic resources among medically treated patients with angiographically documented coronary artery disease</p> Williams RB Barefoot JC Califf RM Haney TL Saunders WB Pryor DB Hlatky MA Siegler IC Mark DB Jama 1992 267 520 524 10.1001/jama.267.4.520 1729574 <p>[No authors listed] Enhancing recovery in coronary heart disease patients (ENRICHD): study design and methods. The ENRICHD investigators</p> Am Heart J 2000 139 1 9 <p>Enhancing Recovery in Coronary Heart Disease (ENRICHD) study intervention: rationale and design</p> Psychosom Med 2001 63 747 755 11573023 <p>Social support, type A behavior, and coronary artery disease</p> Blumenthal JA Burg MM Barefoot J Williams RB Haney T Zimet G Psychosom Med 1987 49 331 340 3615762 <p>Psychometric properties of the depression inventory. Twenty-five years of evaluation.</p> Beck A., Steer, R., & Garbin, M. Clinical Psychology Review 1981 8 1003 1009 <p>Integrating baseline health status data collection into the process of care</p> Spertus JA Bliven BD Farner M Gillen A Hewitt T Jones P McCallister BD Jt Comm J Qual Improv 2001 27 369 380 11433628 <p>The MOS 36-Item Short-Form Health Survey (SF-36): II. Psychometric and clinical tests of validity in measuring physical and mental health constructs</p> McHorney CA Ware J. E., Jr. Raczek AE Med Care 1993 31 247 263 8450681 <p>Performance of a five-item mental health screening test</p> Berwick DM Murphy JM Goldman PA Ware J. E., Jr. Barsky AJ Weinstein MC Med Care 1991 29 169 176 1994148 <p>Reproducibility and responsiveness of health status measures. Statistics and strategies for evaluation</p> Deyo RA Diehr P Patrick DL Control Clin Trials 1991 12 142S 158S 1663851 <p>Comparison of three quality of life instruments in stable angina pectoris: Seattle Angina Questionnaire, Short Form Health Survey (SF-36), and Quality of Life Index-Cardiac Version III</p> Dougherty CM Dewhurst T Nichol WP Spertus J J Clin Epidemiol 1998 51 569 575 10.1016/S0895-4356(98)00028-6 9674663 <p>Monitoring the quality of life in patients with coronary artery disease</p> Spertus JA Winder JA Dewhurst TA Deyo RA Fihn SD Am J Cardiol 1994 74 1240 1244 10.1016/0002-9149(94)90555-X 7977097 <p>Development and evaluation of the Seattle Angina Questionnaire: a new functional status measure for coronary artery disease</p> Spertus JA Winder JA Dewhurst TA Deyo RA Prodzinski J McDonell M Fihn SD J Am Coll Cardiol 1995 25 333 341 10.1016/0735-1097(94)00397-9 7829785 <p>Health status predicts long-term outcome in outpatients with coronary disease</p> Spertus JA Jones P McDonell M Fan V Fihn SD Circulation 2002 106 43 49 10.1161/01.CIR.0000020688.24874.90 12093768 <p>Assessment of a short scale to measure social support among older people</p> Goodger B Byles J Higganbotham N Mishra G Aust N Z J Public Health 1999 23 260 265 10388169 <p>Health measurement scales: a practical guide to their development and use.</p> Streiner D. & Norman, G. Oxford, Oxford University Press 1991 <p>Social support: a conceptual analysis</p> Langford CP Bowsher J Maloney JP Lillis PP J Adv Nurs 1997 25 95 100 10.1046/j.1365-2648.1997.1997025095.x 9004016