AVÐÇÇò

Using patient-reported data to better assess quality of care for hip and knee replacements

Using patient-reported data to better assess quality of care for hip and knee replacements kathschach

June 18, 2024 — For the first time, AVÐÇÇò has combined patient-reported data with clinical outcomes and costing data on hip and knee replacements. This provides a synergistic analysis across data sources for a holistic picture of outcomes and patient experiences related to hip and knee replacements in Canada. The inclusion of patient-reported measures is a way for health providers to understand how well health care systems deliver patient-centred care, namely by measuring outcomes that are meaningful to patients.

This report intends to demonstrate the feasibility and value of combining clinical outcomes, patient-reported experience measures (PREMs), patient-reported outcome measures (PROMs) and costing data.

Key findings

  • PREMs and PROMs data provides a more comprehensive view of patients’ in-hospital experiences and their outcomes related to health care interventions. Patient-reported data that is analyzed and reported on with clinical outcomes and costing data for hip and knee replacements demonstrates the potential to evaluate the effectiveness of health system performance against the Quintuple Aim.Reference1
  • Examining measures across patient socio-demographic groups helps identify inequities in outcomes and experiences and inform strategies to optimize care for all patients receiving hip and knee replacements. The results identified variations in the assessed outcomes, experiences and costs by age group, recorded sex or gender, neighbourhood income and geographic location. 
  • Linking routinely collected health data can be used to identify underlying factors that are driving performance or variations between measures and potential areas of focus for quality improvement. Though the correlations observed were not strong, there were statistically significant correlations between PREMs and clinical outcomes, PREMs and PROMs, and costs and PROMs. 

Introduction

Explore how PREMs and PROMs can be used with other data to assess the value of hip and knee replacements. 

Introduction

Download additional data and information 

Take a closer look at the methodology and supplementary data. 

Download additional data

Contact us

If you have any questions or would like to learn more, please email

proms@cihi.ca

References

1.

Back to Reference 1 in text

Public Health Agency of Canada. . 2022. 

Working toward achieving the Quintuple Aim

Working toward achieving the Quintuple Aim kathschach

June 18, 2024 — In a learning health system, health data is brought together to drive better patient-centred outcomes, improve overall system quality and support health equity.Reference1 Patient-reported experience measures (PREMs) and patient-reported outcome measures (PROMs) provide valuable information from the patient’s perspective that can help health care providers improve patient-centred care and support quality improvement.

AVÐÇÇò

Collecting health data, such as PREMs and PROMs, contributes to creating a healthier and more balanced health care system when the results from PREMs and PROMs are equally weighted with other factors such as costs-per-surgery. This may help evaluate health care funding allocations and patient access to services. — Susan, Hip and knee replacement recipient

Using different sources of heath data to assess the value of health care interventions aligns well with the Quintuple Aim — an essential framework for promoting value-based health care approaches.Reference2 This framework assesses the effectiveness of a health system’s performance and incorporates 5 elements:

  • Improved patient experience
  • Better patient outcomes
  • Lower costs
  • Improved provider experience
  • Overall health equity

The analysis in this report assesses the value of hip and knee replacements from the lens of 4 of the 5 elements of the Quintuple Aim. Provider experience data for hip and knee replacement procedures is not yet available at AVÐÇÇò, although health care organizations are working in this space to close the gap.

References

1.

Retour à la référence 1 dans le texte

Public Health Agency of Canada. . 2022.

2.

Retour à la référence 1 dans le texte

Nundy S, Cooper LA, Mate KS. . JAMA. 2022. 

Overview of measures and data for hip and knee replacements

Overview of measures and data for hip and knee replacements kathschach

June 18, 2024 — This report demonstrates the potential value of bringing together data on hip and knee replacement procedures from various sources, analyzed consistently and reported together to inform health care decisions and planning.

Joint replacements are performed to reduce pain, and to improve mobility and quality of life for patients, particularly after years of managing chronic and debilitating pain. Hip and knee replacements are among the top 3 highest-volume inpatient surgeries performed in Canada.Reference1 In 2021–2022, more than 107,000 hip and knee replacements were performed in Canada, leading to over $1.26 billion in hospital costs.Reference2 There is pressure on health care systems to address long wait times for hip and knee replacement surgeries across the provinces and territories.Reference3 By using patient-reported data with clinical outcomes and costing data, health administrators and planners can facilitate improved health outcomes and health care experiences for patients, and optimize the use of health care resources.

AVÐÇÇò has compiled data from several sources for adult patients diagnosed with osteoarthritis and admitted to hospital for a hip or knee replacement between 2017–2018 and 2021–2022.

Summary of patient population and measures, with available data and correlations

Patient population

The patient population for this report is adult patients age 18+ who were diagnosed with osteoarthritis and admitted to hospital for hip or knee replacement surgery between 2017–2018 and 2021–2022.

This report provides a demonstration of how hospitalization data, PREMs, PROMs and estimated patient-level inpatient costs can be linked together.

Clinical outcomes

Using data from the Discharge Abstract Database (DAD), Hospital Morbidity Database (HMDB) and National Ambulatory Care Reporting System (NACRS), the 3 clinical outcomes reported are Hospital Harm, 30-Day Readmission and 1-Year Revision. 30-Day Readmission and 1-Year Revision include data from all provinces and territories; Hospital Harm includes data from all provinces and territories except Quebec.

Patient-reported experience measures (PREMs)

Using data from the Canadian Patient Experiences Reporting System (CPERS), the 5 PREMs reported are as follows: Information and Understanding When Leaving the Hospital; Communication With Nurses; Communication With Doctors; Involvement in Decision-Making and Treatment Options; and Overall Hospital Experience. These measures include data from Nova Scotia, New Brunswick, Ontario, Manitoba and Alberta.

Patient-reported outcome measures (PROMs)

Using PROMs data, the 3 PROMs reported are 1-Year Change in Functional Status, 1-Year Change in Health-Related Quality of Life (HRQL) and 1-Year Satisfaction After Surgery. These measures  include data from Ontario and Manitoba.

Costs

Using data from the Canadian Patient Cost Database (CPCD), the cost measure reported is Estimated Patient-Level Inpatient Costs. This measure includes data from Nova Scotia, Ontario and Alberta.

This report also looked at the correlations between PREMs and clinical outcomes, PREMs and PROMs, and costs and PROMs.

Notes
PREMs are reported as Top Box results. A Top Box result is the percentage of survey respondents who chose the most positive response to a given survey question.
PROMs are reported as an average change in score (from pre-surgery to 1-year post surgery) for functional status and health-related quality of life, and as the patient’s level of satisfaction with the results of their joint replacement 1-year post surgery. 
Cost estimates are based on patient-level inpatient hospitalization costs; they include both direct and indirect costs, including nursing and staff complement costs, but exclude physician compensation unless paid by the hospital.

Limitations from data availability

The analysis used data available at AVÐÇÇò from relevant data sources, and the number of records differed across data type. Limitations on the availability of data are outlined in the methodology notes.

Analysis through the lens of equity

Analysis through the lens of equity kathschach

June 18, 2024 — Equity is a vital component of health care delivery and is a priority for health care systems in Canada. Exploring variations between patient subgroups can help inform strategies and monitor progress to support equitable outcomes and experiences for all patients.

For this analysis, we categorized hip and knee replacement patients by subgroups (i.e., age group, recorded sex or gender, neighbourhood income and geographic location) using AVÐÇÇò’s pan-Canadian guidance on equity stratifiers.Reference1

This work was completed in 2 parts:

  • Analysis of each data measure separately, examining results by patient socio-demographic factor and presenting the results together (see the data in brief) 
  • Analysis of linked data sets to examine correlations across the different measures: PREMs and clinical outcomes; PREMs and PROMs; and hospitalization costs and PROMs (see Table 1)

Supplementary data tables for this report provide counts by patient subgroups for all results, and additional PREMs-only results by education level and racialized group. 

A step-by-step methodology report and an analysis by joint type (hip or knee) are available upon request from AVÐÇÇò at proms@cihi.ca

How do patient-level socio-demographic factors influence outcomes, experiences and costs?

  • Compared with younger age groups, patients age 75 and older had higher rates of hospital harm and readmission to hospital; lower favourable patient experiences; lower change in functional status, quality of life and satisfaction with surgery; and higher inpatient hospitalization costs. 
  • Male patients had higher rates of readmission to hospital, revision surgery and favourable patient experiences; however, female patients had higher rates of hospital harm.
  • Compared with patients in higher-income neighbourhoods, patients in lower-income neighbourhoods had higher rates of hospital harm, readmission to hospital and revision surgery; lower satisfaction with surgery; and higher inpatient hospitalization costs.
  • Patients in rural/remote areas had higher rates of readmission to hospital compared with patients in urban areas, whereas patients in urban areas had higher rates of hospital harm compared with patients in rural/remote areas.

Clinical Outcomes, PREMs, PROMs and Costs by Equity Stratifiers — Data in Brief

The data in brief provides a summary of the results found in this report.

View the results (PDF)

The Hospital Harm results presented in the data in brief are consistent with AVÐÇÇò’s Hospital Harm Results, 2014–2015 to 2022–2023 (XLSX), which show higher crude rates of hospital harm for patients 65 and older, patients in the lowest neighbourhood income quintile and patients living in urban locations.Reference2 In addition, the results for Involvement in Decision-Making and Treatment Options are consistent with AVÐÇÇò’s Patient experience in Canadian hospitals, 2022 report, which found that older patients feel that they are less involved in decision-making and treatment options compared with younger patients.Reference3

References

1.

Back to Reference 1 in text

Canadian Institute for Health Information. Equity stratifiers. 2022.

2.

Back to Reference 2 in text

Canadian Institute for Health Information. Hospital Harm Results, 2014–2015 to 2022–2023 (XLSX). 2023.

3.

Back to Reference 3 in text

Canadian Institute for Health Information. Patient experience in Canadian hospitals, 2022. 2022. 

Demonstrating linked PREMs, PROMs, clinical and costing data

Demonstrating linked PREMs, PROMs, clinical and costing data kathschach

June 18, 2024 — This report highlights the feasibility of linking health care data that is routinely collected from multiple sources at AVÐÇÇò to facilitate the assessment of overall health system performance. 

Bringing together measures from different sources of data can provide insight into how to achieve the best outcomes for patients at lower costs. This includes the correlations between linked patient-reported data, clinical outcomes (measured by need for readmission and/or revision surgery, and/or hospital harm incurred) and costs.

AVÐÇÇò

It is important to collect patient-reported data to leverage the potential that this type of information can provide when linked with other health care data. This will ultimately improve patient-centred care and the patient experience. — Dr. Jason Werle, Orthopedic surgeon, Alberta

This analysis linked 

  • Patient-reported experience measures (PREMs) and clinical outcomes to see whether there is a relationship between patients’ hospital experience and positive clinical outcomes
  • PREMs and patient-reported outcome measures (PROMs) to see whether patient experiences and patient-reported outcomes are related (i.e., whether good experiences in hospital result in a positive outcome)
  • Costs and PROMs to see whether higher costs are correlated with better patient-reported outcomes

Correlations were explored to determine whether there is a relationship between the 2 measures of interest and the strength of this relationship. The top correlations from the analysis are presented in Table 1. A test of significance was used to determine whether the correlations found were statistically meaningful and not due to chance alone. 

Table 1 Top correlations between clinical outcomes, PREMs, PROMs and costs, 2017–2018 to 2021–2022

PREMsClinical outcomesCorrelation
Communication With DoctorsHospital Harm-0.22*
Involvement in Decision-Making and Treatment Options1-Year Revision-0.20
Overall Hospital Experience30-Day Readmission-0.19
Communication With Nurses30-Day Readmission-0.14
Communication With Doctors30-Day Readmission-0.13
PREMsPROMsCorrelation
Overall Hospital Experience1-Year Satisfaction0.32*
Communication With Nurses1-Year Satisfaction0.26*
Communication With Doctors1-Year Satisfaction0.26*
Involvement in Decision-Making and Treatment Options1-Year Satisfaction0.20*
Information and Understanding When Leaving the Hospital1-Year Satisfaction0.20
CostsPROMsCorrelation
Estimated Patient-Level Inpatient Costs1-Year Change in Functional Status0.08*
Estimated Patient-Level Inpatient Costs1-Year Change in Health-Related Quality of Life (HRQL)0.11*
Estimated Patient-Level Inpatient Costs1-Year Satisfaction0.03

Note
* Indicates an significant correlation (P<0.05).

Sources
Canadian Patient Cost Database, Canadian Patient Experiences Reporting System, Discharge Abstract Database, Hospital Morbidity Database, National Ambulatory Care Reporting System and patient-reported outcome measures data, Canadian Institute for Health Information.

PREMs and clinical outcomes

When examining the relationship between patient experience measures and clinical outcomes, Communication With Doctors was correlated with decreased hospital harm.

PREMs and PROMs

Satisfaction with hip and knee surgical results after 1 year had a positive correlation with favourable responses for the patient experience measures (Overall Hospital Experience, Communication With Nurses, Communication With Doctors, and Involvement in Decision-Making and Treatment Options).

Costs and PROMs

There was a correlation between inpatient hospitalization costs and PROMs, including patient-reported change in functional status and change in quality of life after 1 year.

These findings demonstrate the need to continue to collect patient-reported data to fully leverage the potential of linked health care data. Though some correlations were statistically significant, the correlations observed were classified as weak (less than 0.39).Reference1 This suggests that additional factors may influence the relationship between measures. With larger data sets, more advanced analysis can be pursued such as accounting for non-linear relationships and multiple factors to better understand focus areas that can both improve patient outcomes and experiences and lower costs.

References

1.

Back to Reference 1 in text

Schober P, Boer C, Schwarte LA. Correlation coefficients: Appropriate use and interpretation. Anesthesia and Analgesia. 2018.

Conclusion and future opportunities for comprehensive healthcare data

Conclusion and future opportunities for comprehensive healthcare data kathschach

June 18, 2024 — Comprehensive health care data is needed to better inform planning decisions to ensure equity of care for all patients and optimal outcomes of joint replacement care in Canada.

Conclusion

This product demonstrates that for patients receiving hip and knee replacements, separate data sources can be combined and linked at the patient level to provide a holistic assessment of their care, health care costs and outcomes. In addition, examining measures across patient subgroups helps to inform strategies to optimize experiences and outcomes for all patients.

As patient-reported data is increasingly collected in other health sectors and care pathways, comprehensive health data can be used to inform improvements toward more patient-centred care delivery. Ultimately, health care planning and decisions should take into account important aspects of quality of care, including clinical indicators of success and patient-reported measures. This approach will ensure that the patient’s perspective is included in individualized care plans and shared decision-making.

AVÐÇÇò

Hip and knee replacement surgery is undertaken to reduce pain and improve quality of life. Assessing patients’ perception of their outcome along with their experience of care is critically important for improving the quality of care that we deliver. — Dr. Eric Bohm, Orthopedic surgeon, Manitoba

Future opportunities

  • The use of patient-reported experience measures (PREMs) and patient-reported outcome measures (PROMs) in Canada is evolving and jurisdictions have expressed the desire to accelerate the collection and reporting of patient-reported data together. Expanding the collection of PREMs and PROMs to include more patients and more provinces and territories is needed to boost the utility of these measures for health care planners and clinicians. 
  • PREMs data is important not only for improving patient experiences in hospital but also for maximizing the potential for favourable hospital outcomes (e.g., reducing hospital harm and readmission to hospital after discharge).
  • More comprehensive digital collection of patient-reported data will benefit hospitals and registries such as the Canadian Joint Replacement Registry. 

AVÐÇÇò

Health care providers can use PROMs and PREMs to help the patient understand the best path for improving their quality of life. — Janet, Hip and knee replacement recipient

Download additional data and information

Download additional data and information kathschach

June 18, 2024 — Take a closer look at the methodology used for preparing the results presented in the report and additional data included in the supplementary tables. 

Featured material

Supplementary tables

These are supplementary tables for the report. They include the number of records and PREMs-only results for education level and racialized group.

Download the supplementary tables (XLSX)

Additional material

CJRR annual report

This latest annual report on the Canadian Joint Replacement Registry (CJRR) provides updated statistics on hip and knee replacements performed in Canada.

Read the report

Patient experience in Canadian hospitals, 2022

This report explores key findings from AVÐÇÇò’s patient-reported experience measures (PREMs) in Canadian acute care hospitals for 2017–2018 to 2020–2021.

Read the report