Advertisement

A Systematic Review of Satisfaction Measures in Hand and Wrist Surgery

Published:November 26, 2022DOI:https://doi.org/10.1016/j.jhsa.2022.10.012

      Purpose

      Patient-reported experience measures (quantifying satisfaction, trust, perceived clinician empathy, and communication effectiveness) may not be developed with the same rigor as patient-reported outcome measures (quantifying comfort and capability). We systematically reviewed the use of measures used to evaluate satisfaction with hand surgery by comparing recent (2017–2019) and remote (2000–2002) publications to assess the use of satisfaction measures and areas for potential improvement.

      Methods

      An initial search yielded 6,159 studies, 278 of which met the eligibility criteria. We compared the 2 time periods and recorded the method of satisfaction assessment (dichotomous, categorical, and ordinal) and the results. Because they are measures of research usage potentially representative of rigor in instrument development, we evaluated aspects of score distribution, including discernment (the threshold set at >80% of top scores) and skewness, as well as the differentiation between the satisfaction with outcome and experience.

      Results

      Dichotomous ratings of satisfaction were the most common (171 [62%] of 278 studies), followed by categorical (83 [30%] of 278 studies) and ordinal ( 66 [24%] of 278 studies). All 3 score types had limited discernment (86% dichotomous, 77% categorical, and 64% ordinal ratings) and non-Gaussian distributions (negative skew near 1 or greater), with no differences between the remote and recent time periods. Ninety-seven percent of studies made no distinction between satisfaction with outcome and experience.

      Conclusions

      Measurements of satisfaction with hand surgery have remained unchanged over the last 20 years. They are associated with nonnormal distributions, a notable proportion of top scores, and routine failure to distinguish between experience and outcomes of care.

      Clinical relevance

      Patient-reported experience measures developed with the rigor comparable to the development of patient-reported outcome measures have the potential for either of the following: (1) specificity, variation, and responsiveness sufficient to guide experience improvement efforts or (2) verification of notable ceiling effects that may limit their use.

      Key words

      JHS Podcast

      January 2, 2023

      JHS Podcast Episode 82

      Dr. Graham interviews Dr. Charlie Wilson regarding his paper “A Systematic Review of Satisfaction Measures in Hand and Wrist Surgery”, which is the lead article in the January 2023 issue of the Journal of Hand Surgery.

      Loading ...
      To read this article in full you will need to make a payment

      Purchase one-time access:

      Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online access
      One-time access price info
      • For academic or personal research use, select 'Academic and Personal'
      • For corporate R&D use, select 'Corporate R&D Professionals'

      Subscribe:

      Subscribe to Journal of Hand Surgery
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect

      References

        • Siegrist R.B.
        Patient satisfaction: history, myths, and misperceptions.
        Virtual Mentor. 2013; 15: 982-987
        • Versluijs Y.
        • Lemmers M.
        • Brown L.E.
        • Gonzalez A.I.
        • Kortlever J.T.P.
        • Ring D.
        The correlation of communication effectiveness and patient satisfaction.
        J Patient Exp. 2021; 82374373521998839
        • Mintken P.E.
        • Glynn P.
        • Cleland J.A.
        Psychometric properties of the shortened Disabilities of the Arm, Shoulder, and Hand questionnaire (QuickDASH) and numeric pain rating scale in patients with shoulder pain.
        J Shoulder Elbow Surg. 2009; 18: 920-926
        • MacDermid J.C.
        • Richards R.S.
        • Donner A.
        • Bellamy N.
        • Roth J.H.
        Responsiveness of the short form-36, disability of the arm, shoulder, and hand questionnaire, patient-rated wrist evaluation, and physical impairment measurements in evaluating recovery after a distal radius fracture.
        J Hand Surg Am. 2000; 25: 330-340
        • Graham B.
        • Green A.
        • James M.
        • Katz J.
        • Swiontkowski M.
        Measuring patient satisfaction in orthopaedic surgery.
        J Bone Joint Surg Am. 2015; 97: 80-84
        • Graham B.
        Defining and measuring patient satisfaction.
        J Hand Surg Am. 2016; 41: 929-931
        • Ring D.
        • Leopold S.S.
        Editorial-measuring satisfaction: can it be done?.
        Clin Orthop Relat Res. 2015; 473: 3071-3073
        • Wartolowska K.
        • Judge A.
        • Hopewell S.
        • et al.
        Use of placebo controls in the evaluation of surgery: systematic review.
        BMJ. 2014; 348: g3253
        • Versluijs Y.
        • Brown L.E.
        • Rao M.
        • Gonzalez A.I.
        • Driscoll M.D.
        • Ring D.
        Factors associated with patient satisfaction measured using a Guttman-type scale.
        J Patient Exp. 2020; 7: 1211-1218
        • Salman A.A.
        • Kopp B.J.
        • Thomas J.E.
        • Ring D.
        • Fatehi A.
        What are the priming and ceiling effects of one experience measure on another?.
        J Patient Exp. 2020; 7: 1755-1759
        • Nguyen C.
        • Kortlever J.T.P.
        • Gonzalez A.I.
        • Ring D.
        • Brown L.E.
        • Somogyi J.R.
        Attempts to limit censoring in measures of patient satisfaction.
        J Patient Exp. 2020; 7: 1094-1100
        • Badejo M.A.
        • Ramtin S.
        • Rossano A.
        • Ring D.
        • Koenig K.
        • Crijns T.J.
        Does adjusting for social desirability reduce ceiling effects and increase variation of patient-reported experience measures?.
        J Patient Exp. 2022; 923743735221079144
        • Rajagopalan D.
        • Thomas J.
        • Ring D.
        • Fatehi A.
        Quantitative patient-reported experience measures derived from natural language processing have a normal distribution and no ceiling effect.
        Qual Manag Health Care. 2022; 31: 210-218
        • Presson A.P.
        • Zhang C.
        • Abtahi A.M.
        • Kean J.
        • Hung M.
        • Tyser A.R.
        Psychometric properties of the Press Ganey(R) Outpatient Medical Practice Survey.
        Health Qual Life Outcomes. 2017; 15: 32
        • Dunsch F.
        • Evans D.K.
        • Macis M.
        • Wang Q.
        Bias in patient satisfaction surveys: a threat to measuring healthcare quality.
        BMJ Glob Health. 2018; 3e000694