Methodology

Downloads

Dimensions and Indicators: The Scorecard measures LTSS system performance using 25 indicators, grouped into four dimensions:

Affordability and Access includes the relative affordability of private-pay LTSS, the proportion of individuals with private long-term care insurance, the reach of the Medicaid safety net and the Medicaid LTSS safety net to people with disabilities who have modest incomes, and the ease of navigating the LTSS system.

Choice of Setting and Provider includes the balance between institutional services and HCBS, the extent of participant direction, and the facilitation of consumer choice in publicly funded LTSS programs. It also measures the supply and availability of alternatives to nursing homes.

Quality of Life and Quality of Care includes level of support, life satisfaction, and employment of people with disabilities living in the community, and indicators of quality in nursing homes and in home health services.

Support for Family Caregivers includes level of support reported by caregivers, legal and system supports provided by the states, and the extent to which registered nurses are able to delegate health maintenance tasks to nonfamily members, which can significantly ease burdens on family caregivers.

For each of the four dimensions, the Scorecard uses specific indicators that are important, meaningful, conceptually valid, and unambiguous in regard to directionality; these are combined to obtain state rankings at the dimension level. In some cases, composite indicators have been formed from thematically related program and policy data. Indicators are based on data that are expected to be updated regularly so that change can be observed over time. (See Exhibit 2 in the executive summary, page 11 of the full report, for a complete list of the indicators.) Appendix B2, beginning on page 95 of the full report, describes the methodology for the development of each composite indicator.

The four measured dimensions of system performance approximately correspond to four of the five key characteristics of a high-performing LTSS system (see Exhibit 4). However, the correspondence is not complete, as data are not currently available to measure important aspects of some of the characteristics. Notable data gaps include coordination of LTSS with other services (medical, housing, transportation, and more), consumer reports of quality of HCBS, and consistent definition and measurement of respite for family caregivers.

All indicators are subject to definitional and measurement issues; these 25 were selected because they represented the best available measures at the state level. While no single indicator may fully capture state performance, taken together they provide a useful measure of how state LTSS systems compare across a range of important dimensions.

Ranking Methodology: The Scorecard ranks the states from highest to lowest performance on each of the 25 indicators. We averaged rankings for those indicators within each of the four dimensions to determine each state’s dimension rank, and then averaged the dimension rankings to arrive at an overall ranking. This approach gives each dimension equal weight in the overall rankings, and within dimensions gives equal weight to each indicator. In the case of missing data or ties in rank for an indicator, minor adjustments were made to values used in the average so that all indicators were given equal weight.

  • For ties: the average rank is given for the computation of the dimension or overall average (e.g., two states tied at third; both get a score of 3.5 for the calculation of the dimension average).
  • Missing data: a constant value is added to all ranks so that the average rank for the indicator is 26 (e.g., if there were 4 missing values, the scores would run from 3 to 49 instead of 1 to 47 for the calculation of the dimension average).

This approach was chosen for ease of understanding and interpreting the results, and for consistency with the 2007 and 2009 State Scorecards on Health System Performance.