Empowerment evaluation continues to crystallize central issues for evaluators and the field of ev... more Empowerment evaluation continues to crystallize central issues for evaluators and the field of evaluation. A highly attended American Evaluation Association conference panel, titled "Empowerment Evaluation and Traditional Evaluation: 10 Years Later," provided an opportunity to reflect on the evolution of empowerment evaluation. Several of the presentations were expanded and published in the American Journal of Evaluation. In the spirit of dialogue, the authors respond to these and related comments. The authors structure their discussion in terms of empowerment evaluation's past, present, and future as follows: (a) Yesterday (critiques aimed at empowerment evaluation issues that arise from its early stages of development), (b) Today (current issues associated with empowerment evaluation theory and practice), and (c) Tomorrow (the future of empowerment evaluation in terms of recent critiques). This response is designed to enhance conceptual clarity, provide greater methodological specificity, and highlight empowerment evaluation's commitment to accountability and producing outcomes.
This study examines an intervention designed to enhance the ability of social service agencies to... more This study examines an intervention designed to enhance the ability of social service agencies to implement performance-based contracting using the Getting To Outcomes ® (GTO ®) accountability framework. The GTO approach to contracting focused specifically on outcomes, provided a comprehensive framework for contracts, and provided multi-component support to agencies. The following results were demonstrated after a nine-month intervention: (1) participants reported being more knowledgeable about 10 areas of outcome accountability; (2) the quality of contracts was rated as improved (especially in regard to measurable outcomes), but still needing improvement; and (3) increased collaboration was reported between funders and providers. Limitations, implications and future directions of the study are discussed.
American Journal of Community Psychology, Jun 19, 2012
Bringing evidence based programs to scale was a major initial impetus for the development of the ... more Bringing evidence based programs to scale was a major initial impetus for the development of the Interactive Systems Framework for Dissemination and Implementation (ISF). The ISF demonstrates the importance of the Support System in facilitating the uptake of innovations in the community (the Delivery System). Two strategies that members of the Support System commonly use are training-of-trainers (TOT) models and technical assistance (TA). In this article, we focus on the role of the Support System in bringing evidence-based programs (EBPs) to scale in the Delivery System using a case example, with special attention on two strategies employed by Support Systems-training-of-trainers (TOT) and proactive technical assistance. We then report on findings from a case example from the Promoting Science Based Approaches to Teen Pregnancy Prevention project that furthers our conceptualization of these strategies and the evidence base for them. We also report on the limitations in the literature regarding research on TOTs and proactive TA and provide suggestions for future research on TOTs and proactive TA that will enhance the science and practice of support in the ISF.
Organizational readiness is essential for high-quality implementation of innovations (programs, p... more Organizational readiness is essential for high-quality implementation of innovations (programs, policies, practices, or processes). The R = MC2 heuristic describes three readiness components necessary for implementation—the general functioning of the organization (general capacities), the ability to deliver a particular innovation (innovation-specific capacities), and the motivation to implement the innovation. In this article, we describe how we used the Readiness Building System (RBS) for assessing, prioritizing, and improving readiness and Implementation Mapping (IM), a systematic process for planning implementation strategies, to build organizational readiness for implementation of sexual assault prevention evidence-based interventions (EBIs). While RBS provides an overarching approach for assessing and prioritizing readiness constructs (according to the R = MC2 heuristic; Readiness = Motivation x general Capacity × innovation specific Capacity), it does not provide specific gui...
Background Many cancer survivors with anxiety and depression symptoms are treated in oncology car... more Background Many cancer survivors with anxiety and depression symptoms are treated in oncology care settings that lack systems to recognize such symptoms or offer behavioral interventions. Materials and methods Over the past four years we have fostered a collaboration with the administrators, providers, and patients at a 21-office community oncology care network to address this challenge. We initially targeted a network office site and provider team that championed external collaborations, to establish screening procedures and conduct a pilot study. Results We aligned our goal to implement a screener for anxiety and depression symptoms among cancer survivors with the site's goal to implement a distress screener at survivorship appointments (N > 200 screened to date). Upon establishing a successful screening system, we partnered with an onsite social worker champion (J.L.M.) to develop and evaluate a behavioral intervention for positively screened patients (N = 51), in a format and length adapted to the needs of the site, with content iteratively refined in response to patient feedback. The intervention showed large effects on anxiety and depression outcomes. We communicated these findings to much of the network, thus building support from network administrative, physician, and social work teams to identify anxious and depressed patients, implement the intervention, and recently, to conduct a funded clinical trial in the network, using patient screening and recruitment strategies tailored to the needs and capacities of each site. Conclusions Our work demonstrates one approach to partnering with a communitybased cancer care network to implement a behavioral intervention that addresses anxiety and depression among cancer survivors. A8 Tailoring a Cognitive Behavioral Therapy implementation protocol using mixed methods, conjoint analysis, and implementation teams
American Journal of Community Psychology, Jun 1, 2005
Research has shown that prevention programming can improve community health when implemented well... more Research has shown that prevention programming can improve community health when implemented well. There are examples of successful prevention in local communities, however many continue to face significant challenges, demonstrating a gap between science and practice. Common strategies within the United States to address this gap are available (e.g., trainings), but lack outcomes. Building community capacity to implement high quality prevention can help communities achieve positive health outcomes, thereby narrowing the gap. While there is ample research on the efficacy of evidence-based programs, there is little on how to improve community capacity to improve prevention quality. In order to narrow the gap, a new model of research-one based in Community Science-is suggested that improves the latest theoretical understanding of community capacity and evaluates technologies designed to enhance it. In this article, we describe this model and suggest a research agenda that can lead to improved outcomes at the local level.
In the field of teen pregnancy prevention many efficacious prevention programs are available but ... more In the field of teen pregnancy prevention many efficacious prevention programs are available but adoption of these programs is slow at the community level. In this article, we present a multi-site, capacity-building effort called the Promoting Science-based Approaches to Teen Pregnancy Prevention project (PSBA) as a case example of a proactive application of the Interactive System Framework (ISF) for dissemination and implementation. The ISF is a multi-system model leading to dissemination and implementation of science-based prevention programming through the work of three interactive systems: The "Prevention Delivery," "Prevention Support," and "Prevention Synthesis & Translation" Systems. This article describes the proactive use of the ISF to conceptualize and bolster the PSBA program's goal of assisting local prevention partners in the use of science-based approaches (SBA) to prevent teen pregnancy. PSBA uses all three systems of the ISF to facilitate practice improvements and offers valuable research opportunities to investigate factors related to dissemination and implementation processes across these systems. Describing our application of this framework highlights the feasibility of actively using the ISF to build prevention infrastructure and to guide large-scale prevention promotion strategies in the area of teen pregnancy prevention. The program's ongoing evaluation is presented as an example of early efforts to develop an evidence base around the ISF. Research implications are discussed.
In the field of teen pregnancy prevention many efficacious prevention programs are available but ... more In the field of teen pregnancy prevention many efficacious prevention programs are available but adoption of these programs is slow at the community level. In this article, we present a multi-site, capacity-building effort called the Promoting Science-based Approaches to Teen Pregnancy Prevention project (PSBA) as a case example of a proactive application of the Interactive System Framework (ISF) for dissemination and implementation. The ISF is a multi-system model leading to dissemination and implementation of science-based prevention programming through the work of three interactive systems: The "Prevention Delivery," "Prevention Support," and "Prevention Synthesis & Translation" Systems. This article describes the proactive use of the ISF to conceptualize and bolster the PSBA program's goal of assisting local prevention partners in the use of science-based approaches (SBA) to prevent teen pregnancy. PSBA uses all three systems of the ISF to facilitate practice improvements and offers valuable research opportunities to investigate factors related to dissemination and implementation processes across these systems. Describing our application of this framework highlights the feasibility of actively using the ISF to build prevention infrastructure and to guide large-scale prevention promotion strategies in the area of teen pregnancy prevention. The program's ongoing evaluation is presented as an example of early efforts to develop an evidence base around the ISF. Research implications are discussed.
International Journal of Translation & Community Medicine, 2015
Community psychology is concerned with person environment interactions and the ways society affec... more Community psychology is concerned with person environment interactions and the ways society affects individual and community functioning. It focuses on social issues, social institutions, and other settings that influence individuals, groups, and organizations. Community psychology as a science seeks to understand relationships between environmental conditions, the development of health and well being of all members of a community. Its practice is directed towards the design and evaluation of ways to facilitate psychological competence and empowerment, prevent disorder and promote constructive social change. The goal is to optimize the wellbeing of individuals and communities with innovative and alternative interventions designed in collaboration with affected community members and with other related disciplines inside and outside of psychology.
According to the Interactive Systems Framework for Dissemination and Implementation, implementati... more According to the Interactive Systems Framework for Dissemination and Implementation, implementation is a major mechanism and concern in bridging research and practice. The growing number of implementation frameworks need to be synthesized and translated so that the science and practice of quality implementation can be furthered. In this article, we: (1) use the synthesis of frameworks developed by Meyers et al. (Am J Commun Psychol, 2012) and translate the results into a practical implementation science tool to use for improving quality of implementation (i.e., the Quality Implementation Tool; QIT), and (2) present some of the benefits and limitations of the tool by describing how the QIT was implemented in two different pilot projects. We discuss how the QIT can be used to guide collaborative planning, monitoring, and evaluation of how an innovation is implemented.
This special topic edition of E&PP presents the insights of luminaries in the field who have help... more This special topic edition of E&PP presents the insights of luminaries in the field who have helped shape empowerment evaluation with their critiques, concerns, and congratulations. We celebrate their contributions to empowerment evaluation. This special topic edition of E&PP presents their comments about an evaluation approach that, according to president Stewart Donaldson, has "gone viral" across the globe (Donaldson, 2015). To set the stage for these critical friends' comments, additional context for their discussion is provided. In addition, this special topic edition concludes with a brief comment on their thoughts.
Sustainable community health improvement often requires the implementation of complex interventio... more Sustainable community health improvement often requires the implementation of complex interventions in complex systems. Drawing from the Four Keys to Success frame (theory, implementation, support, and evaluation), this article describes how we used a formative evaluation approach to foster a learning system capable of monitoring and addressing emerging community needs within the Spreading Community Accelerators Through Learning and Evaluation (SCALE) initiative—a national capacity-building effort to support 24 community coalitions’ progress toward a Culture of Health. The formative evaluation approach resulted in critical advancements to the theory, implementation, and nature of supports provided in SCALE. These improvements enabled the SCALE evaluation team to shift from the initial focus on program implementation issues to a greater emphasis on downstream factors (community-level outcomes). The ability of formative evaluation to grapple with the emerging challenges of implementin...
Background-Ethnic minorities and lower-income adults have among the highest rates of obesity and ... more Background-Ethnic minorities and lower-income adults have among the highest rates of obesity and lowest levels of regular physical activity (PA). The Positive Action for Today's Health (PATH) trial compares three communities that are randomly assigned to different levels of an environmental intervention to improve safety and access for walking in low income communities. Design and setting-Three communities matched on census tract information (crime, PA, ethnic minorities, and income) were randomized to receive either: an intervention that combines a police-patrolled-walking program with social marketing strategies to promote PA, a policepatrolled-walking only intervention, or no-walking intervention (general health education only). Measures include PA (7-day accelerometer estimates), body composition, blood pressure, psychosocial measures, and perceptions of safety and access for PA at baseline, 6, 12, 18, and 24 months. Intervention-The police-patrolled walking plus social marketing intervention targets increasing safety (training community leaders as walking captains, hiring off-duty police officers to patrol the walking trail, and containing stray dogs), increasing access for PA (marking a walking route), and
Empowerment evaluation continues to crystallize central issues for evaluators and the field of ev... more Empowerment evaluation continues to crystallize central issues for evaluators and the field of evaluation. A highly attended American Evaluation Association conference panel, titled “Empowerment Evaluation and Traditional Evaluation: 10 Years Later,” provided an opportunity to reflect on the evolution of empowerment evaluation. Several of the presentations were expanded and published in the American Journal of Evaluation. In the spirit of dialogue, the authors respond to these and related comments. The authors structure their discussion in terms of empowerment evaluation's past, present, and future as follows: (a) Yesterday (critiques aimed at empowerment evaluation issues that arise from its early stages of development), (b) Today (current issues associated with empowerment evaluation theory and practice), and (c) Tomorrow (the future of empowerment evaluation in terms of recent critiques). This response is designed to enhance conceptual clarity, provide greater methodological ...
Empowerment evaluation continues to crystallize central issues for evaluators and the field of ev... more Empowerment evaluation continues to crystallize central issues for evaluators and the field of evaluation. A highly attended American Evaluation Association conference panel, titled "Empowerment Evaluation and Traditional Evaluation: 10 Years Later," provided an opportunity to reflect on the evolution of empowerment evaluation. Several of the presentations were expanded and published in the American Journal of Evaluation. In the spirit of dialogue, the authors respond to these and related comments. The authors structure their discussion in terms of empowerment evaluation's past, present, and future as follows: (a) Yesterday (critiques aimed at empowerment evaluation issues that arise from its early stages of development), (b) Today (current issues associated with empowerment evaluation theory and practice), and (c) Tomorrow (the future of empowerment evaluation in terms of recent critiques). This response is designed to enhance conceptual clarity, provide greater methodological specificity, and highlight empowerment evaluation's commitment to accountability and producing outcomes.
This study examines an intervention designed to enhance the ability of social service agencies to... more This study examines an intervention designed to enhance the ability of social service agencies to implement performance-based contracting using the Getting To Outcomes ® (GTO ®) accountability framework. The GTO approach to contracting focused specifically on outcomes, provided a comprehensive framework for contracts, and provided multi-component support to agencies. The following results were demonstrated after a nine-month intervention: (1) participants reported being more knowledgeable about 10 areas of outcome accountability; (2) the quality of contracts was rated as improved (especially in regard to measurable outcomes), but still needing improvement; and (3) increased collaboration was reported between funders and providers. Limitations, implications and future directions of the study are discussed.
American Journal of Community Psychology, Jun 19, 2012
Bringing evidence based programs to scale was a major initial impetus for the development of the ... more Bringing evidence based programs to scale was a major initial impetus for the development of the Interactive Systems Framework for Dissemination and Implementation (ISF). The ISF demonstrates the importance of the Support System in facilitating the uptake of innovations in the community (the Delivery System). Two strategies that members of the Support System commonly use are training-of-trainers (TOT) models and technical assistance (TA). In this article, we focus on the role of the Support System in bringing evidence-based programs (EBPs) to scale in the Delivery System using a case example, with special attention on two strategies employed by Support Systems-training-of-trainers (TOT) and proactive technical assistance. We then report on findings from a case example from the Promoting Science Based Approaches to Teen Pregnancy Prevention project that furthers our conceptualization of these strategies and the evidence base for them. We also report on the limitations in the literature regarding research on TOTs and proactive TA and provide suggestions for future research on TOTs and proactive TA that will enhance the science and practice of support in the ISF.
Organizational readiness is essential for high-quality implementation of innovations (programs, p... more Organizational readiness is essential for high-quality implementation of innovations (programs, policies, practices, or processes). The R = MC2 heuristic describes three readiness components necessary for implementation—the general functioning of the organization (general capacities), the ability to deliver a particular innovation (innovation-specific capacities), and the motivation to implement the innovation. In this article, we describe how we used the Readiness Building System (RBS) for assessing, prioritizing, and improving readiness and Implementation Mapping (IM), a systematic process for planning implementation strategies, to build organizational readiness for implementation of sexual assault prevention evidence-based interventions (EBIs). While RBS provides an overarching approach for assessing and prioritizing readiness constructs (according to the R = MC2 heuristic; Readiness = Motivation x general Capacity × innovation specific Capacity), it does not provide specific gui...
Background Many cancer survivors with anxiety and depression symptoms are treated in oncology car... more Background Many cancer survivors with anxiety and depression symptoms are treated in oncology care settings that lack systems to recognize such symptoms or offer behavioral interventions. Materials and methods Over the past four years we have fostered a collaboration with the administrators, providers, and patients at a 21-office community oncology care network to address this challenge. We initially targeted a network office site and provider team that championed external collaborations, to establish screening procedures and conduct a pilot study. Results We aligned our goal to implement a screener for anxiety and depression symptoms among cancer survivors with the site's goal to implement a distress screener at survivorship appointments (N > 200 screened to date). Upon establishing a successful screening system, we partnered with an onsite social worker champion (J.L.M.) to develop and evaluate a behavioral intervention for positively screened patients (N = 51), in a format and length adapted to the needs of the site, with content iteratively refined in response to patient feedback. The intervention showed large effects on anxiety and depression outcomes. We communicated these findings to much of the network, thus building support from network administrative, physician, and social work teams to identify anxious and depressed patients, implement the intervention, and recently, to conduct a funded clinical trial in the network, using patient screening and recruitment strategies tailored to the needs and capacities of each site. Conclusions Our work demonstrates one approach to partnering with a communitybased cancer care network to implement a behavioral intervention that addresses anxiety and depression among cancer survivors. A8 Tailoring a Cognitive Behavioral Therapy implementation protocol using mixed methods, conjoint analysis, and implementation teams
American Journal of Community Psychology, Jun 1, 2005
Research has shown that prevention programming can improve community health when implemented well... more Research has shown that prevention programming can improve community health when implemented well. There are examples of successful prevention in local communities, however many continue to face significant challenges, demonstrating a gap between science and practice. Common strategies within the United States to address this gap are available (e.g., trainings), but lack outcomes. Building community capacity to implement high quality prevention can help communities achieve positive health outcomes, thereby narrowing the gap. While there is ample research on the efficacy of evidence-based programs, there is little on how to improve community capacity to improve prevention quality. In order to narrow the gap, a new model of research-one based in Community Science-is suggested that improves the latest theoretical understanding of community capacity and evaluates technologies designed to enhance it. In this article, we describe this model and suggest a research agenda that can lead to improved outcomes at the local level.
In the field of teen pregnancy prevention many efficacious prevention programs are available but ... more In the field of teen pregnancy prevention many efficacious prevention programs are available but adoption of these programs is slow at the community level. In this article, we present a multi-site, capacity-building effort called the Promoting Science-based Approaches to Teen Pregnancy Prevention project (PSBA) as a case example of a proactive application of the Interactive System Framework (ISF) for dissemination and implementation. The ISF is a multi-system model leading to dissemination and implementation of science-based prevention programming through the work of three interactive systems: The "Prevention Delivery," "Prevention Support," and "Prevention Synthesis & Translation" Systems. This article describes the proactive use of the ISF to conceptualize and bolster the PSBA program's goal of assisting local prevention partners in the use of science-based approaches (SBA) to prevent teen pregnancy. PSBA uses all three systems of the ISF to facilitate practice improvements and offers valuable research opportunities to investigate factors related to dissemination and implementation processes across these systems. Describing our application of this framework highlights the feasibility of actively using the ISF to build prevention infrastructure and to guide large-scale prevention promotion strategies in the area of teen pregnancy prevention. The program's ongoing evaluation is presented as an example of early efforts to develop an evidence base around the ISF. Research implications are discussed.
In the field of teen pregnancy prevention many efficacious prevention programs are available but ... more In the field of teen pregnancy prevention many efficacious prevention programs are available but adoption of these programs is slow at the community level. In this article, we present a multi-site, capacity-building effort called the Promoting Science-based Approaches to Teen Pregnancy Prevention project (PSBA) as a case example of a proactive application of the Interactive System Framework (ISF) for dissemination and implementation. The ISF is a multi-system model leading to dissemination and implementation of science-based prevention programming through the work of three interactive systems: The "Prevention Delivery," "Prevention Support," and "Prevention Synthesis & Translation" Systems. This article describes the proactive use of the ISF to conceptualize and bolster the PSBA program's goal of assisting local prevention partners in the use of science-based approaches (SBA) to prevent teen pregnancy. PSBA uses all three systems of the ISF to facilitate practice improvements and offers valuable research opportunities to investigate factors related to dissemination and implementation processes across these systems. Describing our application of this framework highlights the feasibility of actively using the ISF to build prevention infrastructure and to guide large-scale prevention promotion strategies in the area of teen pregnancy prevention. The program's ongoing evaluation is presented as an example of early efforts to develop an evidence base around the ISF. Research implications are discussed.
International Journal of Translation & Community Medicine, 2015
Community psychology is concerned with person environment interactions and the ways society affec... more Community psychology is concerned with person environment interactions and the ways society affects individual and community functioning. It focuses on social issues, social institutions, and other settings that influence individuals, groups, and organizations. Community psychology as a science seeks to understand relationships between environmental conditions, the development of health and well being of all members of a community. Its practice is directed towards the design and evaluation of ways to facilitate psychological competence and empowerment, prevent disorder and promote constructive social change. The goal is to optimize the wellbeing of individuals and communities with innovative and alternative interventions designed in collaboration with affected community members and with other related disciplines inside and outside of psychology.
According to the Interactive Systems Framework for Dissemination and Implementation, implementati... more According to the Interactive Systems Framework for Dissemination and Implementation, implementation is a major mechanism and concern in bridging research and practice. The growing number of implementation frameworks need to be synthesized and translated so that the science and practice of quality implementation can be furthered. In this article, we: (1) use the synthesis of frameworks developed by Meyers et al. (Am J Commun Psychol, 2012) and translate the results into a practical implementation science tool to use for improving quality of implementation (i.e., the Quality Implementation Tool; QIT), and (2) present some of the benefits and limitations of the tool by describing how the QIT was implemented in two different pilot projects. We discuss how the QIT can be used to guide collaborative planning, monitoring, and evaluation of how an innovation is implemented.
This special topic edition of E&PP presents the insights of luminaries in the field who have help... more This special topic edition of E&PP presents the insights of luminaries in the field who have helped shape empowerment evaluation with their critiques, concerns, and congratulations. We celebrate their contributions to empowerment evaluation. This special topic edition of E&PP presents their comments about an evaluation approach that, according to president Stewart Donaldson, has "gone viral" across the globe (Donaldson, 2015). To set the stage for these critical friends' comments, additional context for their discussion is provided. In addition, this special topic edition concludes with a brief comment on their thoughts.
Sustainable community health improvement often requires the implementation of complex interventio... more Sustainable community health improvement often requires the implementation of complex interventions in complex systems. Drawing from the Four Keys to Success frame (theory, implementation, support, and evaluation), this article describes how we used a formative evaluation approach to foster a learning system capable of monitoring and addressing emerging community needs within the Spreading Community Accelerators Through Learning and Evaluation (SCALE) initiative—a national capacity-building effort to support 24 community coalitions’ progress toward a Culture of Health. The formative evaluation approach resulted in critical advancements to the theory, implementation, and nature of supports provided in SCALE. These improvements enabled the SCALE evaluation team to shift from the initial focus on program implementation issues to a greater emphasis on downstream factors (community-level outcomes). The ability of formative evaluation to grapple with the emerging challenges of implementin...
Background-Ethnic minorities and lower-income adults have among the highest rates of obesity and ... more Background-Ethnic minorities and lower-income adults have among the highest rates of obesity and lowest levels of regular physical activity (PA). The Positive Action for Today's Health (PATH) trial compares three communities that are randomly assigned to different levels of an environmental intervention to improve safety and access for walking in low income communities. Design and setting-Three communities matched on census tract information (crime, PA, ethnic minorities, and income) were randomized to receive either: an intervention that combines a police-patrolled-walking program with social marketing strategies to promote PA, a policepatrolled-walking only intervention, or no-walking intervention (general health education only). Measures include PA (7-day accelerometer estimates), body composition, blood pressure, psychosocial measures, and perceptions of safety and access for PA at baseline, 6, 12, 18, and 24 months. Intervention-The police-patrolled walking plus social marketing intervention targets increasing safety (training community leaders as walking captains, hiring off-duty police officers to patrol the walking trail, and containing stray dogs), increasing access for PA (marking a walking route), and
Empowerment evaluation continues to crystallize central issues for evaluators and the field of ev... more Empowerment evaluation continues to crystallize central issues for evaluators and the field of evaluation. A highly attended American Evaluation Association conference panel, titled “Empowerment Evaluation and Traditional Evaluation: 10 Years Later,” provided an opportunity to reflect on the evolution of empowerment evaluation. Several of the presentations were expanded and published in the American Journal of Evaluation. In the spirit of dialogue, the authors respond to these and related comments. The authors structure their discussion in terms of empowerment evaluation's past, present, and future as follows: (a) Yesterday (critiques aimed at empowerment evaluation issues that arise from its early stages of development), (b) Today (current issues associated with empowerment evaluation theory and practice), and (c) Tomorrow (the future of empowerment evaluation in terms of recent critiques). This response is designed to enhance conceptual clarity, provide greater methodological ...
Uploads
Papers by Abe Wandersman