| HOME | ARCHIVE | SEARCH | TABLE OF CONTENTS |
|---|
| ||||||||||||||||||||||||||||||||
Correspondence: Address correspondence to Myra Sabir, Cornell Institute for Translational Research on Aging, Bronfenbrenner Life Course Center, Beebe Hall, Cornell University, Ithaca, NY 14853. E-mail: mgs16{at}cornell.edu
| Abstract |
|---|
|
|
|---|
Key Words: Falls prevention Participatory research Practice-based evidence Researchpractice relationship Translational research
A second approach aims to strengthen evidence-based practice. Fundamental to the concept of evidence-based practice is the assumption that assistance to vulnerable or infirm individuals will be improved by practitioner application of scientific findings. Beginning with the field of medicine, the evidence-based practice movement has grown to encompass mental health, social work, education, and other areas of research and practice (Antes, 1998; Brownson, Baker, Leet, & Gillespie, 2002; Dunifon, Duttweiler, Pillemer, Tobias, & Trochim, 2004).
Despite the promise of these approaches for improving both research and services, a number of challenges arise in executing them. On the academic side, barriers to researcherpractitioner collaboration include an academic culture that does not value involvement with the practice community, researchers who have little training in community outreach, and the expense attached to collaborative activities. Obstacles to practitioner use of research include lack of time to follow research, difficulty interpreting complex statistical analyses, and belief that research may be irrelevant. Studies have shown that practitioners from diverse fields do not routinely use research findings; indeed, there remains a degree of indifference, and even occasional hostility, between the worlds of research and practice (Gillan & Schvaneveldt, 1999; Levy-Leboyer, 1988; Weisz, Donenberg, Han, & Weiss, 1995).
The field of gerontology has been spared some of this conflict, in part because it has involved both researchers and service providers since its inception. However, the connection between research and practice in gerontology still leaves much to be desired (Pillemer, Czaja, Schulz, & Stahl, 2003). To date, there have been limited efforts to develop effective strategies that help practitioners understand and apply research findings in their day-to-day work. Further, very few methods for providing practitioner input to researchers have been documented.
In this article, we describe a process for bridging the gap between research-based knowledge and practice-based insight through the use of a consensus-workshop model. This model was developed in the context of an Edward R. Roybal Center funded by the National Institute on Aging, the Cornell Institute for Translational Research on Aging (CITRA). CITRA's central mission is to develop more productive dialogue between the research and practice communities. The consensus workshop brings research to practitioners in a setting in which they can engage and critique academic research priorities, study design, and existing empirical findings, and it provides a forum for practice-based suggestions for new research directions.
| The CITRA Research-Practice Consensus-Workshop Model |
|---|
|
|
|---|
Third, an overemphasis on efficacy findings constitutes a barrier to practical applications. Glasgow and colleagues (Glasgow, McKay, Piette, and Reynolds, 2001; Glasgow, Vogt, & Boles, 1999) have clearly articulated this issue, noting that a single-minded emphasis on the efficacy of interventions fails to address how programs work in actual settings where people are served. In particular, efficacy studies tend to rely on nonrepresentative participants and settings (Glasgow et al., 1999). As Glasgow's RE-AIM model suggests, when transferred to real-world settings, efficacious interventions may have limited reach, that is, result in low rates of participation from eligible individuals; limited adoption by organizations; ineffective implementation; and low maintenance of effects over time (Glasgow et al., 2001).
These issues are typically not addressed in consensus workshops. We explicitly designed the CITRA consensus-workshop model to obtain practitioners' viewpoints on efficacy research. In an initial step, we presented efficacy research to a group of practitioners in a consensus-workshop setting. The workshop participants then created an agenda for further efficacy and effectiveness research that could increase the likelihood of greater adoption, implementation, and maintenance at the program-development level.
Model Overview
To achieve these goals, we modified an existing model popular in the scientific community. Many government agencies and scientific organizations organize consensus conferences or workshops (Black et al., 1999; Ferguson, 1993; Goven, 2003). These events take several different forms, but they involve a similar sequence of steps. Generally, a topic is selected that is both an important problem and one on which there is scientific evidence. A group of scientific experts on the topic is appointed and charged with the preparation of a preliminary report that summarizes available research findings. Meetings of the scientific panel are held, involving presentations and discussion of the report, and a final consensus document is produced.
Although such conferences are often successful in influencing the direction of a field of research, they focus on synthesizing empirical findings without significant input from frontline practitioners. Thus, the consensus findings may fail to reflect the practice wisdom of those who are involved in providing services on a day-to-day basis and thereby risk reduced effectiveness in addressing human problems. To address this weakness, we adapted the standard consensus-conference model by integrating practitioners throughout the process. As in conventional consensus conferences, we prepared a systematic review of the recent scientific literature on a particular question of interest. However, in an additional step, we rendered research findings in less technical language and presented the findings to practitioners, who then joined with researchers in a dialogue about the current research and future research priorities. Here we first describe the consensus-workshop process and then provide an example using the topic of falls prevention.
Steps in the Model
The major steps in the CITRA consensus-workshop model are as follows: (a) selecting a topic, (b) selecting a panel of expert researchers and expert practitioners, (c) producing an up-to-date, nontechnical translation of the literature, (d) convening a larger group of researchers and practitioners that arrives at an initial consensus statement of research and practice recommendations, (e) convening a follow-up meeting to create a final consensus document, and (f) developing a dissemination plan.
Selecting the Topic
A representative advisory group of aging-related service providers and advocates is charged with topic selection. Over the course of several meetings, this group selects topics based on criteria the group itself established, the most important of which are that (a) the topic is relevant to the day-to-day challenges of aging-related service practitioners and (b) sufficient research is available on the topic for a review. The set of topics is prioritized by the advisory committee. Perceived needs in the aging community drive the selection of topics. In the case of CITRA, at the beginning of the partnership we conducted a concept mapping study with over 300 providers and advocates, who identified and prioritized topics of importance to the aging community in New York City. These data assisted the advisory group in topic selection.
Selecting a Panel of Experts
Three scientific experts and three practice experts on the topic are selected. The research experts provide guidance in selecting the literature for the project and review drafts of the research summary. The practice experts review drafts of the document to ensure that the language is clear and understandable to nonscientists. It is important to note that the practice experts are viewed as equal partners with the researchers throughout the process of the research review and consensus workshop. Practice experts have extensive experience working in the specific area and can be recruited from agencies that serve older adults.
Producing a Nontechnical Research Review
After the topic is selected, one or more individuals review the available scientific literature and prepare a written research review that summarizes the relevant research in nontechnical language. It is important to note that the consensus-workshop model does not require the preparation of an original meta-analysis or data synthesis; indeed, it is assumed that such an effort will be beyond the resource capabilities of most sponsoring organizations.
Instead, the nontechnical research summary is based on the most recent literature reviews in the published literature and studies that have appeared since the literature reviews were published. This method is appropriate, given that the primary goal of the workshop is not to create a new synthesis of the scientific literature, but rather to create a reasonably thorough summary document that can serve as the springboard for dialogue.
Convening the Workshop
The consensus workshop is held to discuss the written research review. It is not expected that specific clinical or practice guidelines will emerge, as is the case in the traditional consensus model; rather, the group seeks to achieve consensus on recommendations for ways to make research more relevant to practice environments. An important concern, therefore, is the composition of the workshop. It is necessary that selection of participants be determined jointly by both researcher and practitioner organizers. Participants include researchers, practitioners, and advocates with special expertise or interest in the area. Individuals selected from the practice community generally hold executive positions in service agencies (and thus have the ability to evaluate or implement program ideas that may emerge from the consensus workshop). Experience suggests that a group size of not more than 30 captures relevant expertise while allowing for contributions from all participants. The workshop lasts approximately 3 hours, and it is tape-recorded and transcribed.
Follow-Up Roundtable
Because consensus may be difficult in a single meeting, the workshop transcript is used to produce a list of practitioner insights and suggestions and a list of potential recommendations to be discussed further at the follow-up roundtable. After approximately two weeks, participants gather again in the roundtable to concentrate on refining and narrowing the list of recommendations and the ways in which the recommendations may be disseminated. Following the roundtable, the document is revised once more. The final document is then made available to practitioners and researchers in the community.
Generating Dissemination Ideas
As a final step, workshop participants engage in a discussion of what findings are suitable for dissemination and ways they should be disseminated.
| Example of the Model in Use: Falls Prevention Among Community-Dwelling Older Adults |
|---|
|
|
|---|
Selecting a Panel of Experts
CITRA staff identified and solicited the assistance of three falls-prevention researchers who represented the areas of physical therapy, design and home modification for aging in place, and hip-fracture prevention. CITRA's advisory committee suggested three potential practitioners to serve as experts to the workshop. They included a social worker employed by an organization caring for 450 home-dwelling clients and who had served that agency in the roles of staff nurse, nursing supervisor, and associate director; a physical therapist providing direct care in the home and with responsibility for reviewing all falls among her home care agency's clients; and a bilingual social worker with 20 years of case management experience for community-dwelling older adults.
Producing a Nontechnical Research Review
Following criteria typically used in scientific research reviews, we gave emphasis to reviewing fall-prevention interventions that had been tested by using randomized controlled designs. CITRA staff summarized the major findings of existing research on falls prevention among community-dwelling older adults in nontechnical language and provided the report to the practitioners prior to the consensus workshop. It is not possible to provide the full research summary here (a complete report can be accessed at http://www.citra.org). The major findings conveyed to the practice members of the consensus workshop are summarized in Table 1 and cover the following areas: (a) exercise programs; (b) home hazard assessment and modification; (c) nutritional supplementation; (d) educational programs; and (e) multifactorial interventions. As we already noted, the review focused on findings from randomized controlled trials, but CITRA staff made it clear to the group that these efficacy findings were to be seen as the springboard for group discussion of additional research required to make these findings relevant to community program development.
|
Follow-Up Roundtable
CITRA staff recorded the consensus workshop for later transcription, and participants provided comments on the evolving document. Using the transcript and the evolving document, staff members prepared a list of insights, suggestions, and potential recommendations and distributed these in advance of a follow-up roundtable. The follow-up roundtable of approximately 15 individuals worked to refine and narrow the list of recommendations.
Generating Dissemination Ideas
Participants discussed ideas for disseminating the results of the consensus workshop. Recommendations included publication of the final report, posting the findings on the CITRA Web site, and seeking media coverage.
Establishing an Agenda for Future Research
Practitioner insight emphasized the relationship between research carried out in carefully controlled environments and its application in real-world settings. The following areas emerged as the future directions for research with the highest priority. These areas were deemed highly relevant by practitioners but perceived as missing from the scientific efficacy literature.
Movement Strategies and Location of Falls as Intervention Targets
Practitioners suggested that researchers need to consider real-world housing features and living environments. In particular, they called for additional research attention to precisely where in the home falls are most likely to occur. Their practice experience suggested that falls are more likely to occur while individuals are transferring out of chairs and beds and on and off toilets, while climbing stairs, and at door sills. Thus, research should examine the specific challenges each of these particular microenvironments poses. For example, research testing specific instructions in safe techniques for transferring, climbing or descending stairs, and crossing door sills, as well as incorporating assistive devices when appropriate, is warranted.
In addition, practitioners concurred that older adults tend to revert back to old movement patterns after a fall. Practitioners emphasized the need to encourage older adults to learn and practice new movement strategies during recovery, and to practice these on a variety of different terrains, rather than in one room or in a physical therapy office. Practitioners recommended that researchers design studies that identify relationships between real-world home locations, movement patterns (for example, shuffling the feet), and falls.
Refinement of Falls Risk Assessment
The research review showed that multifactorial interventions and home modifications are effective, and practitioners enthusiastically agreed with these findings. However, the practitioners were concerned that adequate assessment is fundamental to both of these interventions. They argued that the types of assessments available to them fail to emphasize the fit between the environment and the users of the environment. They asked for assessment instruments that are more detailed and sensitive to individual differences.
For example, a typical assessment tool might indicate that an elderly person has a visual impairment. Practitioners pointed out that there is a wide range of visual impairments, each requiring a different response. An elderly person who has difficulty detecting subtle differences in color may not be helped by a white or beige grab bar on a white wall. Thus, it is important to distinguish between types of visual impairment to arrive at a suitable intervention. A key recommendation for further research was development and testing of valid and reliable assessment instruments that take into consideration the day-to-day reality of the falls-prone individual.
Family Caregiver Cooperation
In response to researcher dismay regarding lack of client compliance with intervention protocols, practitioners suggested that gaining family and caregiver cooperation can be the determining factor in gaining client compliance. Practitioners also indicated that case managers may serve as a vital link between researchers and elderly clients, because case managers are frequently charged with follow-up in a variety of ways with elderly adults after a fall, including making sure the older person goes to a doctor, calling the visiting nurse as appropriate, arranging for an environmental assessment, following up adherence to the assessment, and speaking to doctors about medications.
Exercise as Lifestyle Change
Practitioners identified what they believe is a fatal flaw in exercise interventions: they come to an end. In their experience, maintaining an exercise regimen after the intervention period was very difficult for their clients. They recommended that exercise be presented as a lifestyle change, because treatment gains are not maintained over time. They further suggested that personalized exercise programs are more effective, not only because they can address specific physical needs, but also because a personalized program that is the right fit for the individual is more likely to be continued after the intervention is over.
Cultural Competency
Practitioners highlighted cultural competency as an essential quality for both researchers and practitioners, and one that is largely missing from the research literature. They pointed out that various cultural groups often hold differing perspectives regarding independence and dependency and the roles of younger family members in regard to older family members. Practitioners exhorted researchers to conduct studies that systematically test whether the effectiveness of falls-prevention interventions varies for different racial and ethnic groups, and the degree to which interventions can be adapted for greater effectiveness through compatibility with cultural norms and values.
Selected Outcomes
Clear positive outcomes of both a consensus-workshop process and the report emerging from it may be most evident at the local or regional level. As an immediate result, activities of individual participants and others in their organizations were affected by participation in the falls-prevention consensus conference. Selected examples include the following.
| Limitations of the Model |
|---|
|
|
|---|
A second limitation was in constraining the research review to randomized controlled efficacy studies. We made this decision to allow for a clear contrast between traditional scientific work and practice insights. However, it became clear to us that it would also have been useful to include findings from effectiveness studies that represent other dimensions of the RE-AIM model, such as the adoption, implementation, and maintenance of programs in real-world settings. Future CITRA consensus workshops will seek this type of expanded literature review, although there seems to be a paucity of published effectiveness studies.
Third, and somewhat surprisingly, issues of cost effectiveness and economic feasibility of recommendations developed by the consensus workshop did not emerge to a significant degree in the discussions. These issues will be raised more explicitly in future workshops.
| Implications and Conclusion |
|---|
|
|
|---|
This model is likely to be useful in many settings in which structured dialogue between researchers and practitioners is deemed important. We provide two examples of situations in which the consensus workshop model may be helpful. First, community-based research partnerships are increasingly being employed in aging-related research (Minkler & Wallerstein, 2002). A key task at the beginning of partnership formation is developing consensus on the specific problems to be addressed, and the way research should be conducted. Even in partnership efforts, the research agenda may tend to rely on the researchers, who are perceived as having greater expertise. The consensus workshop model can be used to create a more equal-status partnership and to inform and engage practitioners in the research process.
Second, the consensus-workshop model can be an appropriate way to frame and organize policy discussions in aging. This use is not without precedent: For example, Denmark has originated a variant of the consensus model for use in the assessment of policy toward new technologies (Goven, 2003). Groups of nonexpert, ordinary citizens are provided with access to scientific information and engaged in meetings with research experts, whom they interview. A set of recommendations are then provided to the authorities charged with making the policy decision. Similarly, the CITRA consensus-workshop model could be used in localities seeking to make aging-related policy decisions informed by research (e.g., changes in programs or benefits for older adults). The experience presented in this article suggests that further use and expansion of the consensus-workshop model can help bridge the gap between aging-related research and practice.
| Footnotes |
|---|
We are grateful to members of the Community Advisory Committee for the Cornell Institute for Translational Research on Aging (CITRA) for productive collaboration in developing and implementing this model; to Igal Jellinek of the Council of Senior Centers and Services in New York City for facilitating connections between CITRA and over 250 aging service organizations in New York City; to our research experts (Lisa Honkanen, Rosemary Bakker, and Kathleen Beissner) and practice experts (Sheila Karp, Verdele Felix, and Carmen Escobar) for their roles in the review and discussions; to Jackie Berman and the New York City Department for the Aging for assistance with and participation in the roundtable; to all invited guests to the consensus workshop and roundtable; to Leslie Schultz and Carrie Chalmers for invaluable recording and logistical support; and to Julia Lowd and Audrey Stewart for transcription assistance. ![]()
1 Cornell Institute for Translational Research on Aging, Cornell University, Ithaca, NY. ![]()
2 Weill Cornell Medical College, New York, NY. ![]()
Decision Editor: Nancy Morrow-Howell, PhD
Received for publication March 12, 2006. Accepted for publication June 13, 2006.
| References |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
E. Wethington, R. Breckman, R. Meador, M. C. Reid, M. Sabir, M. Lachs, and K. A. Pillemer The CITRA Pilot Studies Program: Mentoring Translational Research: Kathleen Walsh Piercy, PhD, Editor Gerontologist, December 1, 2007; 47(6): 845 - 850. [Abstract] [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||
| HOME | ARCHIVE | SEARCH | TABLE OF CONTENTS |
|---|