| HOME | ARCHIVE | SEARCH | TABLE OF CONTENTS |
|---|
| ||||||||||||||||||||||||||||||||
Correspondence: Address correspondence to Catherine Hawes, PhD, Department of Health Policy and Management, School of Rural Public Health Mail Stop 1266, Texas A&M University System Health Science Center, College Station, TX 77843-1266. E-mail: hawes{at}srph.tamhsc.edu
| Abstract |
|---|
|
|
|---|
Key Words: Minimum Data Set MDS-HC Home health
This article focuses on the RAI-HC system, its potential applications, the likely challenges involved in using such a standardized assessment tool, and how the DVA might address these obstacles. However, our conclusions may well apply to other entities and governments considering implementation of the RAI-HC, including U.S. states and other countries.
| Rationale for Standardized Assessment and Genesis of the RAI-HC |
|---|
|
|
|---|
As a result of these factors, researchers and clinicians have developed several standardized tools that have been adopted by state and federal policy-makers to improve various aspects of home health and home care services (Tonner, LeBlanc, & Harrington, 2001). One was the Outcome and Assessment Information Set (OASIS), developed under a mandate from the what is now the Centers for Medicare & Medicaid Services (CMS) with cofunding from the Robert Wood Johnson Foundation (CMS, 2006; Hittle et al., 2003). The original purpose of OASIS was to develop a set of items that would form the basis for measuring outcomes of Medicare home health clients, and this grew into a set of outcome-based quality improvement indicators. OASIS data are used to report 41 home health quality measures, 30 of which are risk adjusted and 11 of which are descriptive (CMS, 2006). Thus, OASIS was developed as a group of data elements that represented a core set of sociodemographic, environmental, support, and functional status items rather than a comprehensive assessment tool to be used for clinical assessment and care planning. Since then, OASIS items have been adopted for use in case-mix adjustment of Medicare's prospective payment system for home health care. In addition, over the past decade, additional items were added to OASIS that a workgroup of home care experts deemed essential for clients, although the goal "was not to produce a comprehensive assessment instrument, but to provide a set of data items necessary for measuring patient outcomes and essential for assessmentwhich HHAs in turn could augment as they judge necessary" (CMS, 2006, background page; see also links to the main OASIS components and general application, http://www.cms.hhs.gov/OASIS/Downloads/maincomponentsandgeneralapplication.pdf). The OASIS assessment is performed on every patient who receives services from home health agencies that participate in the Medicare program.
Unlike OASIS, the RAI-HC was developed for a clinical purposeto form the basis of a comprehensive client assessment and to guide individualized client service planning for home health and home care services. As such, it mirrored the development and intent of the nursing home RAI, which was the first of what has become a family of instruments developed to improve long-term care for elderly and disabled individuals through better assessment and care planning. The Institute of Medicine (IOM) embraced the goal of improving care through geriatric assessment in its 1986 report on improving the quality of care in nursing homes. The IOM envisioned a uniform, comprehensive functional assessment of a person's strengths, preferences, and needs, systematically linked to an individualized plan of care, as a cornerstone of improved quality (IOM, 1986). CMS funded the development of the nursing home RAI pursuant to Congressional nursing home reforms in the Omnibus Budget Reconciliation Act of 1987. This development has been extensively discussed elsewhere (Hawes, Morris, Phillips, Mor, & Fries, 1995; Hawes et al., 1997; Mor et al., 1997; Morris et al., 1990; Phillips et al., 1997).
Seeing the benefits of the original RAI, its developers undertook the design of a similar assessment system for home care as part of a research consortium, interRAI, that has since created an integrated family of assessment instruments (www.interrai.org). The RAI-HC (Morris et al., 1997) was developed in 1994, and Version 2.0 was released in 1999 (Morris, Fries et al., 2000). As we discuss below, the RAI-HC is a more comprehensive assessment system, with boarder clinical and quality improvement intent and uses, than OASIS. Reflecting their different intents, OASIS and the RAI-HC are not equivalent. For example, a cross-walk of the two instruments in the mid-1990s found that only 15 of the 30 RAI-HC Clinical Assessment Protocols (CAPS; which are key mechanisms for linking assessment information to problem identification and care plan decisions; described below) could be replicated in OASIS, whereas there were no major OASIS areas lacking in the RAI-HC (Morris, 1997).
| Content of the RAI-HC |
|---|
|
|
|---|
The RAI-HC system comprises two parts. The first is an assessment instrument (the MDS-HC) designed to collect standardized information on a broad range of domains critical to caring for individuals in the community, as displayed in Table 1.
|
The second part of the RAI-HC system consists of 30 problem-focused CAPs (see Table 2). The CAPs cover conditions that are common risks for home care clients, such as risk for functional decline, nursing home placement, or abuse.
|
The RAI-HC is designed for use at a client's admission to a home health or home care program or prior to hospital discharge, but its utility is augmented by reassessment at some standard interval (e.g., 90 days), depending on the type of client being assessed, when it can identify changes, support revision of care plans, and provide outcome measures. In addition, the variability among home care clients, from those needing clinically complex care or intensive rehabilitation to those who need only ongoing assistance with ADLs affects the time needed to complete an assessment. However, on average, the RAI-HC assessment takes about 60 min to complete for a new client (Morris et al., 1997).
| Testing the RAI-HC for Reliability and Validity |
|---|
|
|
|---|
The RAI-HC has also been tested for validity. Content validity was studied using stakeholder opinions and expert clinicians as the gold standard for whether RAI-HC items were clinically relevant and focused on key issues for home care clients. In addition, a group of experts developed each CAP and validated it through clinical focus groups and ongoing empirical research, including research on the ability of the trigger to predict the risk of a change in that CAP area (Morris, Fries et al., 2000).
Convergent validity was established by determining whether items from the RAI-HC would detect levels of physical functioning and cognitive status as defined by analogous well-established instruments. Trained nurses assessed home care clients independently of and with nurses blinded to the results from the research rating scales. RAI-HC items and scales compared well with ratings from the Barthel ADL Index (Pearson's correlation of.74), the Lawton Instrumental Activities of Daily Living Scale (also.74), and the Mini-Mental State Examination (MMSE;.81; Landi et al., 2000).
These findings show that the RAI-HC is very reliable, with good item reliability across nursing home and home- and community-based service settings, types of clients, cultures, and assessor qualifications. The trials also demonstrate that RAI-HC scale scores represent valid measures of physical function and cognitive status among home care clients, and that clinicians and stakeholders see the RAI-HC as clinically relevant and useful (Kwan et al., 2000; Landi et al., 2001; Leung et al., 2001).
| Potential DVA Applications of the RAI-HC |
|---|
|
|
|---|
Although the DVA's initial goal may be to use the RAI-HC for assessment and service planning, there are other uses of the RAI-HC data that the DVA may find worthwhile. For example, the IOM cited the DVA as having a strong tradition of synthesizing empirical evidence and applying it to clinical care (Kohn, Corrigan, & Donaldson, 2000). Thus, the DVA may want to use RAI-HC client-level data to assess various aspects of process and outcome quality. Similarly, the DVA could use the data to generate profiles of its clients and make comparisons across different types of home care programs or long-term-care settings and services (e.g., to compare nursing home or assisted living residents to home care clients). The DVA could also use the data to examine the relative performance of different providers or the effect of different mixes of services on client outcomes. Such uses of the data could inform program and policy design for the DVA system. Furthermore, with common data elements across home care and nursing home populations, the DVA could examine factors that predict or explain why some veterans are referred for residential programs whereas others receive home care. In the remainder of this section, we discuss the multiple potential uses of RAI-HC data beyond its primary clinical uses.
Summary Scales
Embedded within the RAI-HC are scales that summarize functional status in the areas of ADLs, cognition, communication, pain, and mood. These scales generate validated summary measures of individual functioning in the specified areas and can be used for a variety of purposes, including to (a) summarize the status of individual clients or groups of clients, (b) identify change in an individual's clinical or functional status over time, (c) compare outcomes among different groups of clients over time, and (d) evaluate the effectiveness of different clinical interventions or various mixes of services.
Scales have been developed in the following areas:
Quality Indicators
Researchers have also developed and tested a set of quality indicatorsthe Home Care Quality Indicators (HCQIs)that can be used in a quality-monitoring system.
Researchers derived the initial 22 HCQIs and associated risk adjusters using data from Canada, the United States, and Italy (Dalby, Hirdes, & Fries, 2005; Hirdes et al., 2004). The development parallels the work done with the nursing home RAI for CMS's Nursing Home Compare program (Morris, Murphy, Mor, Berg, & Moore, 2002).
One obvious advantage of the HCQIs is that they require only RAI-HC data, without additional data collection or reporting. Furthermore, the quality indicators include measures of both process (e.g., inadequate meals) and outcomes (e.g., functional decline). Each HCQI excludes clients for whom computations are inappropriate (such as terminally ill clients for evaluating weight loss), and certain outcomes have client-level risk adjusters. Also, HCQI agency adjusters can address selection and ascertainment bias, protecting, for example, an agency that might be penalized because it is more adept at recognizing mood disturbances (Dalby et al., 2005).
Case-Mix Classification
Case-mix systems classify clients into distinct service-use intensity categories that can help to allocate resources more fairly among clients with different needs. The RAI-HC data support the Resource Utilization Groups for Home Care (RUG-III/HC) algorithms and provide a measure of the relative resources (i.e., wage-weighted formal and informal care time) that clients are likely to use. RUG-III/HC also enables comparisons with resources that a client would have used if he or she had been in a nursing home (Fries et al., 1994). RUG-III/HC uses 74 RAI-HC variables to create 21 homogeneous resource-use categories and explains about one third (33.7%) of the variance in estimated resource use (Björkgren et al., 2000). Case-mix data also have important applications for analyzing populations served for policy research (Shugarman, Fries, & James, 1999) or adjusting quality indicators (Dalby et al., 2005).
Screening
Selected RAI-HC items can also be used in screening systems intended to identify appropriate care pathways. This helps in the difficult tasks of prioritizing target populations and allocating increasingly scarce public resources in an equitable manner. The data contained in the RAI-HC can support systematic, standardized methods for such screening. One example, used in Michigan, is the MI Choice system, which uses 32 RAI-HC items to classify individuals into one of five levels: nursing home, home care, intermittent personal care, homemaker, and information and referral services. During the assessment process, MI Choice can also serve as a complement to the assessor's clinical insights and the individual's preferences about the most appropriate care setting (Fries, Shugarman, Morris, Simon, & James, 2002). A separate telephone screening instrument using selected items could potentially be used to identify individuals who are unlikely to meet health, cognitive, and functional criteria for community-based or nursing home care and to target expensive in-person assessments for individuals more likely to qualify as medically eligible for assistance (Fries, James, Hammer, Shugarman, & Morris, 2004)
As part of the Millennium Act, the DVA adopted an adapted MI Choice screenthe Geriatrics and Extended Care Referral toolas the standardized referral tool. DVA Direction 2004-059 mandated its use for identifying "the care needs of veterans and establishing a level of care prior to placement in all ... long-term care programs [paid, provided or coordinated by the DVA]" (U.S. Department of Veterans Affairs, 2004).
Other screeners can be derived from the RAI-HC. For Example, MAPLe classifies clients into five priority levels based on their risk for adverse outcomes (Hirdes, Poss, Curtin-Telegdi, & Chase, 2002). Michigan has recently adopted a system that makes selected light-care RUG-III/HC groups ineligible for a nursing home level of care. New Jersey and Louisiana have created state-specific medical eligibility screens from the RAI-HC, and similar efforts are underway in Georgia and Arkansas.
In addition to the above-mentioned uses, numerous studies have demonstrated the RAI-HC's applicability in identifying risk factors, describing the prevalence and outcomes of various health conditions, and identifying health service use patterns among home care clients (Fletcher & Hirdes, 2002; Landi, Cesari et al., 2004; Landi, Onder, Carpenter, Garms-Homolova, & Bernabei, 2005; Landi, Onder et al., 2004; Paddock & Hirdes, 2003; Sorbye, Finne-Soveri, Ljunggren, Topinkova, & Bernabei, 2005; Vik, Maxwell, & Hanley, 2005). Similarly, the Aged in Home Care study, funded by the 5th Framework project of the European Union, compared models of home care for elders across 11 European countries along with the clinical and functional characteristics of their clients. This led to the creation of a cross-national population-based data set containing information on organizational characteristics of the home care systems and baseline and 1-year follow-up data on 4,010 home care clients. The study found differences in clients and care needs among the participating countries and generated several papers that used common data elements and definitions to assess elder abuse, compliance with medication, pain, vaccination, and inappropriate medication prescribing patterns (Carpenter et al., 2004).
| Challenges to Using the RAI-HC: Lessons for the DVA From Other Settings |
|---|
|
|
|---|
|
Staff Turnover and Inadequate Training
In U.S. nursing homes, staff turnover and limited access to training and information have constituted major challenges to the accuracy of RAI assessment data. For instance, some facilities purchased a single copy of the RAI User's Manual and kept it under lock and key in an administrator's office (Harrington, Summers, Curtis, & Maynard, 1996). DVA administration can send a strong message about the importance of data quality by making RAI-HC training a priority. Ideally, this would include providing both initial and ongoing training to both clinical and administrative staff, developing a cadre of trained trainers, and ensuring that everyone who performs assessments has a user's manual. Other investments might include using computer-directed learning technology to facilitate flexible training for initial and ongoing training, establishing a Web-based "help desk" to respond to clinical questions, posting Frequently Asked Questions and updating them frequently, and ensuring that DVA contract agencies have parallel training requirements and access to the help desk.
RAI-HC as "Paperwork"
Some assessors will treat completion of the RAI-HC form strictly as paperwork, especially if they are not invested in the clinical utility of the data. The DVA can ameliorate this tendency by engaging staff in applying the data to everyday practice. Activities to evaluate intervention outcomes, to examine the costs of care among case-mix groups, or to measure caseload size and complexity may encourage staff to own the data and invest in good data quality. In addition, multiple applications provide countervailing incentives to over- or underreport a client's characteristics.
Burden From Duplicate Forms
Often the RAI-HC is implemented in a system in which other assessment tools are already in use. There is a tendency for staff to continue using these familiar tools. For example, staff may persist in employing the MMSE, even though the RAI-HC will yield a comparable cognitive status measurement. This practice increases staff workload, and continued use of duplicate instruments can lead to miscoding of items on one or both, which may affect measurement accuracy. Familiarizing staff with the validity of RAI-HC scales, making scale scores readily available to the assessor through software, and creating a process to identify and simplify duplicate assessment processes can help address this problem.
RAI Nurse
In U.S. nursing homes, many facilities assigned an MDS nurse to complete all assessments. This person often didnot work on the floor and thus lacked first-hand knowledge of the person being assessed. The MDS nurse was often not involved in care planning or other use of the assessment data. As a result, data accuracy was harmed. Engaging the same individuals to conduct the assessment and be part of the team developing the care plan is preferable and supports the collection of higher quality data.
Assessment in Another Care Environment
Some of the components of the RAI-HC require evaluation of the individual in his or her usual living environment. This can be a problem when assessment is part of hospital discharge planning or while the person resides in an assisted living facility. Program managers can encourage staff to identify such situations when the standard responses may not quite apply, always relying on the RAI-HC User's Manual. Ideally, the DVA will systematically compile any questions and develop uniform responses and interpretations at the national level, such as through the Office of Geriatrics and Extended Care, and ensure through trainings that they are known and applied in all sites.
Minimizing the Individual's Status
When a person's clinical condition triggers one of the CAPs, this should guide the care-planning team to consider an intervention. However, assessors may have incentives to overlook or not report a problem and thereby avoid expending additional fiscal or clinical resources on it or generating a negative quality indicator score (Schnelle, Bates-Jensen, Chu, & Simmons, 2004). This is an important and difficult problem to address. DVA training and continuing education can promote discussion of such incentives, including whether resource constraints are real and how else they might be addressed. Audit processes can identify underreporting and possibly minimize its occurrence.
Safeguarding the Clinical Utility of the RAI-HC
Implementation experiences in other venues have also identified common challenges to the clinical utility of RAI-HC data. We discuss possible strategies to address these below.
Missing the Forest for the Trees
When learning the RAI-HC system, most clinicians will necessarily focus on individual items and coding conventions. This may result in a preoccupation with the form itself rather than the links to service planning that represent the clinical power of the system. This tendency is directly addressed when users employ software that automatically calculates the CAP triggers. Training exercises in which staff assess clients regarded as difficult cases may demonstrate how CAP triggers and the additional assessment information called for in the guidelines can produce new clinical insights. Ensuring that care plans as well as assessment forms are included in the agency's audit and quality assurance activities may also help.
Cookie Cutter Service Plans
In the nursing home arena, the growth of RAIsoftware has been accompanied by the emergence of computer-generated standardized care plans. Such software features defeat the instrument's focus on individualized plans. The software selected or developed by the DVA should be designed to support rather than supplant clinical decision making, thus encouraging individualized service plans for each client.
Timely Access to Needed Data
Although software designers have created many innovative ways to organize and display RAI-HC data, these features may not be readily available to aid the staff who would most benefit from them because of factors such as insufficient access to computer hardware, low computer literacy among staff, budget woes, or inadequate system designs that provide such information only in management reports. Involving clinical staff and administrators alike in key software decisions and the plan for information flow within the organization is essential. Setting aside adequate funds for system rollout, including funds to create additional outputs identified by users as the system matures, will also help build broad ownership of the data.
Bolstering the RAI-HC Data System
It is also useful to consider possible issues regarding the data system at the policy level.
Lack of a Business Intelligence Plan
For a variety of reasons, nearly 7 years after nursing facilities began to submit RAI/MDS data, most states still lacked the capacity to analyze their own RAI data (Reinhard, Hendrickson, & Bemis, 2005), and little technical assistance has been forthcoming from CMS. The DVA can avoid this pitfall by investing in a thoughtful analysis of the desired uses of RAI-HC data. The national system can be designed to provide needed information to regional and local stakeholders, including contract providers, in a timely and coherent manner. Business information technology plans can address the differing needs of clinicians, administrators, and policy staff through identification of features and reports tailored to each group's needs.
Shifting Priorities at the Leadership Level
Creating a national data system is a multi-year endeavor with inevitable unforeseen problems. Unfortunately, the budget and staffing for such initiatives are often "low-balled" at the outset, so that by the time a crisis occurs that necessitates more resources, leadership interest and belief in the project has waned. The RAI-HC data system rollout will compete with other departmental priorities for leadership attention and funds, and a strategy is needed to maintain leadership support over the long run. This can include developing and ensuring an adequate multi-year budget when enthusiasm for the project is fresh; identifying issues that the leadership is particularly keen to know more about; creating reports that can keep key stakeholders interested; and widening support for the effort by educating other audiences, such as consumer advocates or legislators, about the "fruits" of the new system.
Investing in Future Analysis
Business intelligence planning should consider not only how data will be collected, but also who will analyze it. Although an initial set of standard reports is likely to be specified, decision makers will eventually need ad hoc reports, new standard reports, or studies requiring linked data sets, such as clinical assessment and cost data, as the system matures. Successful planning strategies include the following: identifying relevant staff who will need to be knowledgeable about the system's architecture and including them in the design and testing of the initial system, exposing such staff to the day-to-day clinical use of RAI-HC data so that they develop an appreciation for what the data mean, thinking through "make or buy" decisions regarding the extent to which internal versus contracted personnel will be used to carry out more complex analytic or research efforts, and updating data dictionaries frequently and making these accessible to internal and external users.
| Conclusions |
|---|
|
|
|---|
Although this article has focused on aspects of the RAI-HC, the same concepts apply to other interRAI assessment systems, including the assisted living tool (RAI-AL). The commonality of items and measurement approaches permits individuals to be followed across sectors of the long-term-care system over time. As an integrated health care system, the DVA provides an ideal environment in which to examine such integration.
| Footnotes |
|---|
1 Department of Health Policy and Management, Texas A&M University System Health Science Center, College Station. ![]()
2 Institute of Gerontology, University of Michigan, Ann Arbor. ![]()
3 Ann Arbor Veterans Affairs Medical Center Geriatric Research, Education, and Clinical Center, MI. ![]()
4 Center for Management of Complex Chronic Care (CMC3), Edward Hines, Jr., VA Hospital, Hines, IL. ![]()
5 Institute for Health Services Research and Policy Studies, Northwestern University, Chicago, IL. ![]()
Decision Editor: William D. Spector, PhD
Received for publication May 13, 2005. Accepted for publication February 6, 2007.
| References |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
D. Wieland and L. Ferrucci Multidimensional Geriatric Assessment: Back to the Future J. Gerontol. A Biol. Sci. Med. Sci., March 1, 2008; 63(3): 272 - 274. [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||
| HOME | ARCHIVE | SEARCH | TABLE OF CONTENTS |
|---|