Evaluating a complex intervention: A process evaluation of a psycho-education program for lung cancer patients receiving palliative radiotherapy

Carmen WH Chan
Professor, The Nethersole School of Nursing, The Chinese University of Hong Kong, Sha Tin, NT, Hong Kong, P.R. China

Alison Richardson
Clinical Professor of Cancer Nursing and End of Life Care, School of Health Sciences, University of Southampton, UK

Janet Richardson
Professor of Health Service Research, Faculty of Health, University of Plymouth, Plymouth, UK

PP: 234 - 244

Abstract

This study was to examine the integrity of intervention delivery and identify precursory factors contributing to successful delivery and the effectiveness of a psycho-educational intervention comprising progressive muscle relaxation and health education in patients receiving palliative lung cancer radiotherapy. This mixed methods study employed both quantitative and qualitative methods to investigate intervention integrity and to identify key precursory factors among 70 Hong Kong Chinese lung cancer patients. Results show that the intervention conducted by two support nurses, in line with that planned at the outset of the study, achieved a high degree of consistency. Full adherence to the 20-minute muscle relaxation component was an important factor contributing to better symptom management. Other contributing factors included use of supplementary audio and reading materials and frequent self-practice of muscle relaxation. Reinforcement strategies, together with the use of supplementary learning materials and a flexible approach to progressive muscle relaxation, are recommended for future research.

Keywords

psycho-education, process evaluation, palliative care, advance lung cancer

Article Text

Psychoeducational interventions (PEIs) are considered to be complex interventions since they are made up of several components and involve the active participation of patients and interveners (Campbell et al 2000).  It is not easy to define 'active ingredients' of such interventions as they are built up from the nature of the intervention (for example dose and frequency), and the specification of delivering the intervention (for example type of intervener and their required skill).  Complex interventions, even with random assignment, can violate the assumptions of traditional randomized controlled trial (RCT), as there may be variations in the delivery of the dose and participation level of the patient in the clinical environment that may threaten the integrity of the intervention.  Integrity is the degree to which the intervention is carried out as planned (Campbell et al 2000).   Hodges et al (2010) advocate all aspects of a psychological intervention need to be delineated adequately in order to assess and enhance intervention integrity.

One problem with evaluating and implementing a complex intervention is that the integrity of intervention delivery is likely to influence the extent to what it is meant to achieve. Arguably, it is fairly easy to standardize delivery of a drug. But quality of interventions, particularly psychosocial approaches, depending on the work of interveners may be much affected by other factors, such as their training, and quality of associated written materials. There is growing evidence that variation in mode of delivery results in very different outcomes. Two school-based interventions designed to increase fruit and vegetable intake (Resnicow et al 1998) and physical activity (Saunders et al 2006) reported a direct correlation between intervention integrity and trial outcomes.

Consequently it is argued the simple RCT paradigm needs to be replaced with a more flexible pragmatic design that mirrors the complexity of intervention delivery (Campbell et al 2000). A pragmatic design allows interveners to treat patients slightly differently according to their needs and recognize patients play an active part in the outcome of an intervention, without sacrificing the quality and essential elements of an intervention (Richardson 2000).  In this type of design contextual factors, such as patients' attention or the way treatment is given, are optimized and evaluated in order to ensure the approach closely mirrors clinical practice (Richardson 2000).  To achieve this, and ensure integrity of the intervention, process evaluation is advocated by many researchers (Chan 2009; Billings 2000) as a particularly useful approach to examine the process of complex interventions against the planned criteria of a quality intervention.

Process evaluation involves investigation of how an intervention was delivered. Lack of intervention integrity can occur when specific activities provided to patients deviate from those originally planned; and when patients are exposed to partial or different components of the intervention and at different levels of strength according to individual patient needs or changes in the intervener's performance (Chan 2009).  Therefore, process evaluation may include different aspects of patient, intervener and intervention (e.g., dose and frequency) variables. Variability in responses to an intervention can be explained in light of these variables (Chan 2009; Richardson 2000; Sidani & Braden 1998).  For instance, poor patient compliance to the full intervention package may explain why an intervention fails to achieve the intended outcome.

The main study

A psychoeducational intervention (PEI) combining multiple cognitive, psychological and behavioral ingredients was developed to manage breathlessness, fatigue and anxiety for Hong Kong Chinese patients with advanced lung cancer undergoing palliative radiotherapy (Chan et al 2011).  It was an evidence-based intervention based on the results of a systematic review (Chan 2006) and previous palliative care program by Bredin (1999), Quinn (1999) and Frith (1991). A 40-minute educational package plus 20 minutes coaching of progressive muscle relaxation (PMR) was delivered to patients prior to the beginning of the course of radiotherapy and repeated once after three weeks.  The education package consisted of discussion and counseling on the selected symptoms and their self-care management, supplemented by leaflets and audio tapes. During the education sessions, patients were told the focus of the intervention and its outline.  First, patients were given preparatory information about the description and causes of the three symptoms.  They were then provided the opportunity to discuss their perception of these symptoms, and explore the meaning these 3 symptoms held for them personally.  They were encouraged to explore their hopes and realistic goals in living with these symptoms.  Since not all patients had experienced all symptoms at the week 1 session, the support nurse needed to ask patients to imagine and anticipate the occurrence of these symptoms and be prepared for them.  This explained and justified the need to repeat the same activities in week 3 when patients might have more experience of the symptoms. 

The support nurse also gave advice on self care strategies, and coaching in PMR.  Coaching in PMR included a brief introduction to the mechanism and function of the technique, a demonstration of the contraction and relaxation of each muscle group, and rehearsal of the technique performed by patients.

At the end of the session, the support nurse briefly explained the content of the information leaflet to the patients.  She also requested patients and family members read the leaflet and listen to the audio tape at their own time and pace.  Lastly, patients were encouraged to self-practice PMR daily. Other details of the intervention are reported elsewhere (Chan et al 2011).  The effectiveness of the PEI was evaluated through the pragmatic RCT and shown to have positive and significant outcome effects in managing the symptoms of breathlessness, fatigue, and anxiety and improve patients' functional ability.  This paper involves secondary analysis of process data extracted from the main study.

Aim of the study

The present paper focuses on the evaluation of the process of delivering the PEI during the main study.  The aims of this study were to: (1) examine the integrity of intervention delivery and (2) identify precursory factors that contribute to successful delivery and the effectiveness of the PEI among the 70 patients recruited to the intervention group.


View references

References

Bernstein DA, Borkovec TD and Hazlett-Stevens H (2000) New Direction in Progressive Relaxation Training: A Guidebook for Helping Professionals, Praeger, Westport, Connecticut.

Billings JR (2000) Community development: A critical review of approaches to evaluation, Journal of Advanced Nursing 31(2): 472-480.

Bredin M, Corner J, Krishnasamy M, Plant H, Bailey C and A'Hern R (1999) Multicentre randomised controlled trial of nursing intervention for breathlessness in patients with lung cancer, British Medical Journal, 318(7188): 901-904.

Campbell M, Fitzpatrick R, Haines A, Kinmonth AL, Sanderock P, Spiegelhalter D and Tyrer P (2000) Framework for design and evaluation of complex interventions to improve health, British Medical Journal 321: 694-696.

Chan CWH, Molassiotis A, Yam B, Chan E and Lam C (2001) Traveling through the cancer trajectory: Social support perceived by women with gynecological cancer in Hong Kong,  Cancer Nursing 24(5): 387-394.

Chan CWH, Hon HC, Chien WT and Lopez V (2004) Social support and coping in Chinese patients undergoing cancer surgery, Cancer Nursing 27(3): 230-236.

Chan CWH (2006)  Psychoeducational intervention: A critical review of systematic analyses, Clinical Effectiveness in Nursing 9: 101-111.

Chan CWH (2009) Process-focused evaluation: How does it work, in Chien WT (ed) Strategies in Evaluation of Complex Health Care Interventions for People with Physical or Mental Health Issues, pp.51-59, Nova Science Publishers, New York.

Chan CWH, Richardson A and Richardson J (2011) Managing symptoms in patients with advanced lung cancer during radiotherapy: Results of a psychoeducational randomized controlled trial, Journal of Pain and Symptom Management 41(2): 347-357.

Cheung YL, Molassiotis A and Chang AM (2001) A pilot study on the effect of progressive muscle relaxation training of patients after stoma surgery, European Journal of Cancer

Care 10(2): 107-114.

Davydov D, Shapiro D and Goldstein I (2010) Relationship of resting Baroreflex activity to 24-hour blood pressure and mood in healthy people, Journal of Psychophysiology 24(3): 149-160.

Frith B (1991) Giving information to radiotherapy patients, Nursing Standard 5(34): 33-35.

Gu C, Chan CWH and Twinn SF (2010) How sexual history and knowledge of cervical cancer and screening influence Chinese women's screening behavior in Mainland China,  Cancer Nursing 33(6): 445- 453.

Helgeson VS, Cohen S, Schulz R and Yasko J (2001) Long-term effects of educational and peer discussion group interventions on adjustment to breast cancer, Health Psychology 20(5): 387-392.

Hodges L, Walker J, Kleiboer A, Ramirez AJ, Richardson A, Velikova G and Sharpe M (2010) What is a psychological intervention: A meta review and practical proposal, Psycho-oncology 20(5): 470-478.

Karnofsky D and Buchenal J (1949) The clinical evaluation of chemotherapeutic agents in cancer, in Macleod CM (eds) Evaluation of Chemotherapy Agents, Columbia University, New York.

Quinn S (1999) Lung cancer: The role of the nurse in treatment and prevention, Nursing Standard 13(41): 49-54.

Qureshi KN and Hodkinson HM (1974)  Evaluation of a ten-question mental test in the institutionalized elderly, Age & Ageing 3(3): 152-157.

 

Resnicow K, Smith M, Baranowski T, Baranowski J, Vaughan R and Davis M (1998)  2-year tracking of children's fruit and vegetable intake, Journal of the American Dietetic Association 98: 785-789.

Richardson J (2000) The use of randomized control trials in complementary therapies: Exploring the issues, Journal of Advanced Nursing 32(2): 398-406.

Saunders R, Ward D, Felton G, Dowda M and Pate R (2006) Examining the link between program implementation and behavior outcomes in the lifestyle education for activity program (LEAP), Evaluation and Program Planning 29: 352-364.

Sidani S and Braden CJ (1998) Evaluating Nursing Interventions: A Theory-Driven Approach, Sage Publications, Thousand Oaks, California.

Snyder M, Pestka E and Bly C (2002) Progressive muscle relaxation, in Snyder M and Lindquist R (eds) Complementary Alternative Therapies in Nursing, 4th edn, Springhouse Publishing Company, New York.

Streubert HJ and Carpenter DR (1999) Qualitiative Research in Nursing Advancing the Humanistic Imperative, 2nd edn, Lippincott Williams & Wilkins, Philadelphia.

Tashakkori A and Teddlie C (2003) Handbook of Mixed Methods in Social and Behavioral Research, Sage, Thousand Oaks, California.



RSS Facebook Twitter

Sign Me Up for latest release updates

*  Email Address:
    First Name:
    Last Name:
*  I am interested in::





 

Web Feed

Latest Articles

Special Issues

Advances in Contemporary Health Care for Vulnerable Populations
Volume 42/1
Summary | Contents


Advances in Contemporary Community & Family Health Care (3rd edn)
Volume 41/1
Summary | Contents


Advances in Contemporary Complex Health Care: Nursing Interventions
Volume 40/2
Summary | Contents


Advances in Contemporary Community and Family Health Care (2nd edn)
Volume 40/1
Summary | Contents


Advances in Contemporary Nurse Education (2nd edn)
Volume 38/1-2
Summary | Contents


Advances in Contemporary Indigenous Health Care (2nd edn)
Volume 37/1
Summary | Contents


Advances in Contemporary Nursing: Workforce and Workplaces
Volume 36/1-2
Summary | Contents


Advances in Contemporary Modeling of Clinical Nursing Care
Volume 35/2
Contents


Advances in Contemporary Mental Health Nursing (2nd edn)
Volume 34/2
Summary | Contents


Advances in Contemporary Nursing and Gender
Volume 33/2
Summary | Contents


Advances in Contemporary Nurse Education
Volume 32/1-2
Summary | Contents


Advances in Contemporary Nursing: History of Nursing and Midwifery in Australasia
Volume 30/2
Summary | Contents


crossref.org - The citation linking backbone



Website by Arrowsmith Websites. Website Design Sunshine Coast, Australia.