Client Login

How CMS Will Calculate Your 2021 Star Rating

CMS made significant changes to the way the Hospital Star Ratings are calculated. They finalized the calculation in the CY 2021 Medicare Hospital Outpatient Prospective Payment System and Ambulatory Surgical Center Payment System Final Rule.

Here’s a high-level summary of the major changes that came out of that final rule.

  • Usually, the Star Ratings are updated in January. They are not updating your Star Ratings in January. The next update will be July of 2021.
  • CMS overhauled the way they calculate your Star Rating. The new calculation is a simple average of the measures in the group. (Details below.)
  • There were seven measure groups that make up the Star Rating calculation. CMS has reduced the groupings to five groups. (Details below.)
  • CMS is placing hospitals in one of three peer groups based on the number of measure groups you submit. Your Star Rating is based on which peer group you are in. (Details below.)
  • Critical Access Hospitals and Veterans Association Hospitals are included in the Star Rating system (although they may still opt out).

Note: CMS did not choose to peer group readmission measure scores based on dual-eligibility.

Ok, let’s dive into what the heck that all means.

Background and basic concept of the Star Ratings

The Star Ratings system began in July of 2016. The results are now published annually. The Star Ratings are calculated based on a hospital’s performance on certain measures found on the Hospital Compare website.

Hospitals submit data to the Hospital IQR, OQR, Value-Based Purchasing, Readmission Reduction and HAC Reduction programs. That information is published on Hospital Compare. CMS then takes certain measures submitted in each of these programs and calculates a Star Rating which also appears on the Hospital Compare website. So, your individual measure performance is on the website and the Star Rating attempts to summarize your performance by stars, so the public gets a general feel for your quality of care - one star is the worst and five stars is the best.

Here’s what the public sees.

CMS Star Blog 1

How CMS Calculates your Star Rating in 2021

Star-Ratings-Calculation-2021-01

Download and print the calculation graphic.

 

Step 1: Hospitals submit data to CMS quality programs.

You, as a hospital, go about your business of submitting measures to the CMS quality programs: Hospital IQR, ORQ, HRRP, HAC Reduction and HVBP programs.

Step 2: CMS identifies which measures will be used to calculate the score.

CMS selects which measures they will use to make the Star Rating score. In 2021 they have identified 51 quality measures. You can find the measures on the QualityNet website.

Step 3: CMS standardizes the measure scores

CMS takes your hospital’s performance on those CMS-selected measures and standardizes the measure score so it makes sense in the overall equation. Think about an inverse measure where lower scores are better. You wouldn’t want that score to count against a total score, so they standardize all measure scores. This method of standardizing is called Z-scoring.

Understanding Z-scoring

A Z score is statistical technique. It’s a standard deviation score which shows the amount of variation in a dataset. For the Overall Star Rating, Z-scores were produced by subtracting the national mean score from each hospital’s measure score and dividing that by the standard deviation across hospitals. Standard deviation is a number that measures how far data values are from their average.

For Example:

Picture1 copy

In addition to that, CMS changed the direction of all inverse measures to reflect better performance for those lower scores.

Step 4: Measures are grouped

The measures are put into groups based on the category. In 2021, the categories were reduced to five groups. Because of the Meaningful Measures Initiative that CMS launched they cut out quite a few measures over time which means that some categories didn’t have a lot of measures in them. So, CMS combined Effectiveness of Care, Timeliness of Care and Efficient Use of Medical Imaging groups into one group called Timely and Effective Care.

The five measures groups for 2021 are:

  1. Mortality
  2. Safety of Care
  3. Readmissions
  4. Patient Experience
  5. Timely and Effective Care

Step 5: CMS calculates the measure group score using a simple average

In each measure group, CMS will calculate a simple average to determine a measure group score. This is where CMS made the biggest change. In previous years, CMS used something called a Latent Variable Model and a Winsorization strategy to come up with the group score.

Honestly, I never understood this calculation and turns out, I wasn’t the only one. In fact, the feedback to CMS was that the calculation was too difficult for hospitals to replicate and predict. How is a hospital supposed to know what to improve upon to adjust their star rating if the calculation is so complex?

This year they dropped the Latent Variable Model and the Winsorization strategy and went to a simple average.

A simple average takes the sum of measures with equal weights and divides by the number of measures a hospital reports.

For example:
If a hospital submits all eight measures in the Safety of Care measures group, the calculation would look like this.

100% / 8 reported measures = 12.5%

Measure group score =
[(-1.13*0.125) + (-0.75*0.125) + (0.09*0.125) + (1.21*0.125) + (0.97*0.125) + (0.98*0.125) + (0.46*0.125) + (0.02*0.125)] = 0.23

CMS Blog 3

Step 6: Group scores are applied a weight

A weight is applied to that measure group score. Your final score is calculated according to the weight of the category. The weights for the five categories are as follows:

  1. Mortality = 22% weight
  2. Safety of Care = 22% weight
  3. Readmissions = 22% weight
  4. Patient Experience = 22% weight
  5. Timely and Effective Care = 12% weight

For Example:
Summary score = [(-0.70*0.22) + (0.23*0.22) + (-0.76*0.22) + (-1.13*0.22) + (-0.25*0.12)] = -0.55

Example of Summary Score Calculation and Star Rating AssignmentCMS Blog 4

Step 7: Hospitals are excluded or score reweighted depending on the number of measures submitted.

A hospital must report at least three measure groups with at least three measures in each group, (must include groups Mortality or Safety of Care) in order to receive a star rating. Once the minimum measure and measure group thresholds are met, any additional measures a hospital reports would be included in the Overall Star Rating calculation.

Let’s say you met the minimum threshold, but you didn’t report any Timely and Effective Care measures, that measure group is subtracted from the total.

For Example:
100 (100-12=88)

Mortality weight: 22/88 = 25%

Safety of Care weight: 22/88 = 25%

Readmission weight: 22/88 = 25%

Patient Experience weight: 22/88 = 25%

Example of Reweighting for a Hospital Which Does Not Report Timely and Effective Care Measure Group

CMS BLog 5

Step 8: Hospitals are put into peer groups based on the number of measures submitted

Hospitals are put into one of three peer groups depending on how many measures they submit. CMS believes that by grouping hospitals by how many measure groups they report, this will help capture key differences between hospitals like size, patient volume, case mix and service mix. Larger hospitals, for example, generally submit the most measures and smaller hospitals submit the fewest.

The three peer groups for 2021 are:

  1. Five measure groups submitted
  2. Four measure groups submitted
  3. Three measure groups submitted

Step 9: Within the peer groups, scores are split into 5 groups using the k-means clustering method

Within the peer grouping, scores are split into five groups using the k-means clustering method. Essentially the k-means clustering is an algorithm method which aims to make hospital scores results within a cluster more similar to each other than to a different cluster.

Step 10: Whichever group your score puts you in becomes your star rating

Whichever k-means clustering group your score puts you in becomes your star rating.

Note: Since hospitals in a peer group are being compared only to each other that means hospitals with the same score, but a different peer group, could receive different star ratings.

What to do in 2021

Even with all the changes this year, your star rating is still be based on your performance across the quality measures that make up the program. And how many stars you have may influence the credibility, efficiency, culture and financial state of your organization.

It’s important to understand that Star Ratings are similar to other CMS Hospital Quality Initiative programs in the fact that performance is based on retrospective data from previous years, which means your current performance isn’t reflected on Hospital Compare. For instance, the 2020 readmission performance published on Hospital Compare right now is showing your hospital’s performance for patients discharged from July 1, 2015 – June 30, 2018.iv You are long past your ability to affect change to your 2021 Star Rating. Even as you read this you have less than a year to affect your performance in many measures for 2023!

Read more: Five Tactics to Improve Your Star Rating

Quality data is so important but unless you can harness the data it can be overwhelming. You must use your data to identify the factors that drive your hospital’s performance in these categories. You need a dashboard that helps you understand how your problem measures are trending over time. Most importantly your data must be actionable. You must be able to analyze the data and create strategies around improvement. By partnering with a strong analytics vendor like Medisolv, hospitals can focus on a quality improvement plan that will help them succeed with their value-based care initiatives, now and into the future.

With the window to influence Star Ratings closing, you must take action now. Don’t wait any longer to improve your performance. Start monitoring your performance now to protect your revenue and reputation two years down the road.

Sources:
ihttps://public-inspection.federalregister.gov/2020-26819.pdf
ii. https://www.aha.org/system/files/media/file/2020/12/cms-issues-hospital-outpatient-asc-final-rule-including-maintenance-340b-cuts-bulletin-12-3-20.pdf
iii. https://www.sheppardhealthlaw.com/2020/12/articles/centers-for-medicare-and-medicaid-services-cms/new-criteria-hospital-quality-star-rating/
iv. https://qualitynet.cms.gov/inpatient/public-reporting/overall-ratings/data-collection

 

Start the New Year by Improving Your Star Ratings
Medisolv Can Help 

This is a big year for Quality. Medisolv can help you along the way. Along with award-winning software you receive a consultant that helps you with all of your technical and clinical needs.
 
We consistently hear from our clients that the biggest differentiator between Medisolv and other vendors is the level of one-of-one support. Especially if you use an EHR vendor right now, you’ll notice a huge difference.

  • We help troubleshoot technical and clinical issues to improve your measures.
  • We keep you on track for your submission deadlines and ensure you don’t miss critical dates
  • We help you select and set up measures that make sense based on your hospital’s situation.
  • You receive one consultant that you can call anytime with questions or concerns.

Contact us today.

Check out this resource to get started:

Blog: "Five Tactics to Improve Your Star Ratings"

 
 
Erin Heilman

Erin Heilman is the Marketing Director for Medisolv, Inc.

Add a comment

Use your data to drive meaningful improvement.

See our quality management software in action.

Request a Demo