This is the 2008 annual report for The Institute for Health Policy in Houston, Texas.
Copyright:
Attribution Non-Commercial (BY-NC)
Available Formats
Download as PDF, TXT or read online from Scribd
Download as pdf or txt
You are on page 1of 58
annual report
A Knowledge Translaton Initatve
ACTION OUR PRIMARY MISSION: to translate public health research into evidence-based policies and programs to enhance the health of communites. A Knowledge Translation Initiative Copyright 2009 Research Into Action, Institute for Health Policy, The University of Texas School of Public Health. TABLE OF CONTENTS Execut i ve Summar y How I t Al l Began Devel opi ng a New Model Mappi ng t he Evi dence Act i ve Bodi es, Act i ve Mi nds SBI RT Exper t Anal ysi s Wor l d 2.0 I dent i f yi ng t he Heal t h of Houst on What Weve Accompl i shed What We Wi l l Accompl i sh Soci et al Benet s Appendi ces 5 8 10 14 17 20 23 26 29 32 35 39 4 Executive Summary 5 A Knowledge Translation Initiative Research Into Action Execut i ve Summar y How It All Began Through a gener- ous gif from the ExxonMobil Foun- daton, the Insttute for Health Policy at the University of Texas School of Public Health was able to formalize a commitment to its KT eorts via a new initatve, Research Into Acton (RIA). This project developed and launched an innovatve KT model, tested it with two research projects from the School of Public Health, and plans to serve as a catalyst for policy-relevant research and as a broker for faculty opportuni- tes to inform current policy debates. Developing a New Model Much of the existng literature on KT is spread widely across dierent disciplines and ofen lacks explicit directon on how to conduct successful translatons. The RIA team reviewed this literature and idented a set of best practces in the eld. RIA then developed a unique model for KT that prescribes dierent levels of eort and actvity based on the perceived gaps between research- er and user. This departure from the classic model is an advance in the con- ceptualizaton of the KT process. Mapping the Evidence To support KT, a broad array of directly relevant supportng evidence must be assem- bled. The RIA team used evidence mapping to accomplish this. Evi- dence maps can be created that display general results and clus- ters of evidence in a way that best summarize the ndings. The team weighs the evidence by mapping published study results to answer specic questons about the central topic under consideraton. Actve Bodies, Actve Minds One of the IHPs rst two research proj- ects was PASS & CATCH, which draws a correlaton between physi- cal actvity and improved academic achievement. Working with the principal investgator, the RIA team developed advocacy and presen- taton materials that explain the results to public audiences, and reached out to the U.S. Centers for Disease Control & Preventon (CDC) for support. The CDC expressed interest in collaboratng with us in the natonal distributon of these results, once the study is published. SBIRT-Expert Analysis SBIRT is a program mandated for use in all level I trauma centers. Doctors and other medical personnel are re- quired to screen accident patents for signs of substance abuse. If the patents are found to be under the his Research Into Acton (RIA) annual report summarizes the actvites of the RIA knowledge translaton (KT) initatve, based in the Insttute for Health Policy at The University of Texas School of Public Health. It is organized into 10 sectons with eight appendices. For your convenience, we provide a brief summary. T 6 A Knowledge Translation Initiative Research Into Action inuence, medical professionals will either con- duct a brief interventon or refer them to facilites where they can receive treatment. RIA focused on Harris Countys level III and level IV trauma centers (which are not required to provide SBIRT services), translatng the existng evidence on pro- gram eectveness and providing resource links and optons to assist in the adopton decision. World 2.0 As the IHP and the RIA team delved further into KT, it became clear that there was no central repository for KT informaton on the Inter- net. With that in mind, the RIA team launched a second major initatve developing a Web portal that would be a one-stop-shop for all KT-related public health informaton. What Weve Accomplished During its rst full year of actvity, RIA has: What We Will Accomplish In 2009, we will be evaluatng our rst two projects, as well as se- lectng two new projects for our second year. RIA also antcipates the completon of two major Web initatves by mid-summer the KT Web portal and the completely renovated IHP/RIA Web pages will be unveiled. These Internet initatves will substantally raise the public prole of the IHP and RIA. Benet to Society Our fore- most goal is to have eectve KT become the norm. We hope to set a standard that is adopted widely in public health research and practce. Our translaton of PASS & CATCH ndings con- nects us to natonal eorts on obesity preventon and the pressing need to address the obesity epidemic. Likewise, our eorts promotng the adopton of SBIRT, a program proven to reduce injury and substance abuse, can have an impact on thousands of lives a year. Developed the axial model of KT Developed the three-level project selecton matrix Conducted several user surveys to create a foundaton for current and future research Conducted its rst two KT projects PASS & CATCH and SBIRT Completed the specicaton of a comprehensive Web-based KT portal Met its matching requirements for next year through a gif to the IHP from the Houston Endowment 7 How It All Began The Institute for Health Policy Knowledge Translation 8 A Knowledge Translation Initiative Research Into Action How I t Al l Began With a generous gif from the ExxonMo- bil Foundaton, the IHP was able to ex- tend its commitment to KT with a new program initatve called Research Into Acton (RIA). The RIAs primary mission is to translate public health research into evidence-based policies and programs to enhance the health of communites. This concept of translatng research into useful acton can be traced to the agricultural extension services at the be- ginning of the 20th century. Applying this concept to medicine, nursing, and pub- lic health is relatvely new in the United States, but it is already an established practce in Europe and Canada. The IHP is devoted to raising awareness of KT in the United States, and using it to bring research from the pages of peer- reviewed journals to those who can use and benet from it the most. At the IHP, the practce of KT is carried out through the Research Into Acton (RIA) initatve. Using a KT model de- signed by the sta, the RIA is dedicated to sharing informaton and best practces to advance the eld of KT. Typically that is accomplished by choos- ing specic research projects and working with the principal invest- gators to share their ndings with targeted populatons. The RIA conducts systematc re- views and translatons of scientc content and disseminaton of re- sults through a number of com- municaton channels, including the media, scholarly artcles, and presentatons at conferences. The IHP also plans to serve as a catalyst for policy-relevant re- search and brokering opportuni- tes for faculty to apply their ex- pertse to inform current policy debates. In additon, specialized training and educaton in policy analysis, design and development is currently being oered as a part of the graduate-level curriculum here at the UT School of Public Health.
he Insttute for Health Policy (IHP) was established at The University of Texas School of Public Health to assist researchers throughout the UT Health Science Center in translatng their technical ndings into usable advice for program administrators and practcal recommendatons for health policymakers. This practce is commonly referred to as knowledge translaton, and is ofen referred to as simply KT. T 9 RIAs Latest Thinking Developing a New Model 10 A Knowledge Translation Initiative Research Into Action uch of the existng literature on KT is spread widely across dierent disciplines and ofen lacks explicit directon on how to conduct successful translatons. The RIA team reviewed this literature and idented a set of best practces in the eld. Success appears to depend upon what in- formaton gets exchanged, when, by whom, and through what kind of media. The RIA teams task was to think beyond the classic KT model, which is based on a simple communicaton cycle with feed- back. Many groups have devised KT mod- els which describe theoretcal processes, or which atempt to describe communicaton processes afer the fact. RIA developed a unique model for KT that allows for varying degrees of readiness on the part of the user, or gaps between the user and researcher of varying size and complexity. The RIA model prescribes dierent levels of eort and actvity based on the perceived gaps. This departure from the classic model represents an advance in the conceptual- izaton of the KT process. An abstract de- tailing this model has been submited to the third Natonal Conference on Health Communicatons, Marketng and Media, sponsored by the U.S. Centers for Disease Control and Preventon. We also partci- pated in last years conference, presentng material from our audit of KT Web sites and user survey. The graphic on the opposite page illustrates the RIA teams current thinking on this pro- actve model of KT. As demonstrated in the models spectrum of encounters, researchers and end-users (be they policy-makers, administrators, health professionals or the general public), depending on their placement on the spec- trum, will have varying degrees of conver- gence on the topic being disseminated. This represents RIAs latest thinking, and contn- ues to be rened. Devel opi ng a New Model M 11 A Knowledge Translation Initiative Research Into Action P-cols Advocates Decision Makers Service Providers P-cols Advocates Decision Makers Service Providers P-cols Linkage Models Decision Makers Decision Makers P-cols Service Providers Service Providers P-cols Exchange Models Promotion Models P-cols Decision Makers Service Providers (KT Circuit) Dissemination Models E 1 E 2 t 1 t 2 L 1 L 2 Brokerage Models P-cols Decision Makers Service Providers Advocates The Axial Model for KT Research and Development 12 A Knowledge Translation Initiative Research Into Action Analysis Review all material Meet with principal investigator and staf Second round of targeted evidence mapping Translation Develop broad expertise on potential users Translate scientifc fndings into actionable messages Frame key messages to meet users needs Specify Relevant Forms of Communication Inventory targets and tactics Match tactics to a media plan Review Model Elements Evaluate ef cacy of initial analysis, translation, and tactic selection Execution Create timeline Set budget Products/Reporting Develop communications materials Direct user interaction Interactions with media Interactions with intermediary organizations Evaluation Design evaluation measures Track implementation and user uptake Final report To simplify the process of planning for KT eorts, RIA sta created a comprehensive list of projects and actvites derived from the best practces compiled from all sources. This comprehensive list is intended to functon like a clinical algo- rithm, allowing sta to plug in the appropriate actvites based on the scenario idented by the model. This chart illustrates a sampling of the ac- tvites and the categories they fall under. 13 Mapping the Evidence A Systematic Approach 14 A Knowledge Translation Initiative Research Into Action he RIA project began in the fall of 2007. At the outset, sta produced a mission statement and logo, a revised logic model, and a set of operatonal objectves to guide implementaton. Sta also created a systematc screening process to guide the choice of research ndings for translaton. The projects focus was on research completed at the UT School of Public Health in the prior three years. An outline of our screening process is shown in Appendix A. To accomplish the selecton task, an exhaus- tve inventory of studies was completed, a custom database to organize the applica- ton of the screening criteria was designed, and a weight-of-evidence assessment from the published scientc literature was com- pleted on the nal set of candidate studies. The assessors used 15 criteria to screen 144 research studies over the course of three rounds. From this, a set of 10 candi- date studies were idented. Afer further investgaton, these 10 were then narrowed down to three. The sta then conducted a full weight-of-evidence assessment on these three studies. RIA sta found that no single study had signicant enough re- sults to stand alone. This is frequently the case; progress in pub- lic health is made in small increments. For the purpose of creat- ing a persuasive case for KT, a broad array of directly relevant supportng evidence must be assembled. How is this done? The IHP uses a tool called evidence mapping. An example of our evidence mapping appears in Appendix B. Evidence maps can be created that display general results and clusters of evidence in a way that best summarize the nd- ings. Evidence mapping begins with a search of the research literature for previous systematc reviews. If the literature has already been synthesized in a systematc review, it is then up- dated with more recent research or search terms are modied to widen the breadth of review. Next, the team weighs the evidence by mapping published study results to answer specic questons, for example: Descriptive questions What clinical contexts have been investigated? What are the diferent types of interventions studied in the population of interest? Outcome questions How efective was the interven- tion? What is the efectiveness of intervention on special populations? PICO Principle Population (who), Intervention (what), Compared to, and Outcome (consequences/efective- ness). For example, in [X] population, did [Y] treatment, compared to none or little [W] treatment, reduce/ increase [Z] outcome? Mappi ng t he Evi dence T Adopted from Evidence Mapping Systematc Review, and Meta- Analysis, Patricia Mullen, Dr. PH. 15 A Knowledge Translation Initiative Research Into Action Next, the group determines selecton criteria (both inclusion and exclusion) for studies; con- ducts a document search; and develops a strat- egy for capturing relevant study characteristcs, such as: Search strategy Report identifcation author, title, jour- nal or other pub. type, publication date Population Program or treatment Setting, time Study design/methods/quality rating Outcome measures Applicability to diferent populations and settings An example of our project selecton matrix can be found in Appendix B. Using this systematc approach, the IHP sta is able to take large amounts of data and turn it into practcal, useful informaton. Two of the studies that were subjected to evi- dence mapping were nally selected for trans- laton. One was a physical actvity supplement to the coordinated approach to child health (CATCH) program, and the other concerned screening and brief interventon during emer- gency care. The next months involved translatng content into actonable messages, building a network of collaborators for disseminaton, and engag- ing policymakers as potental users of these results. 16 Active Bodies, Active Minds Boosting Academic Achievement 17 A Knowledge Translation Initiative Research Into Action ne of the IHPs rst two research projects was PASS & CATCH, which draws a correla- ton between physical actvity and improved academic achievement. Dr. Nancy Murray, the principal investgator, has gone further than other researchers by focusing on how teachers can use physical actvity in the classroom as a teaching aid and demonstratng the benets of physical actvity for poorly adaptng students. The IHP sta, with input from Dr. Murray, developed a variety of collateral materials for PASS & CATCH. These were (and are) used at conferences, public meetngs, and other gatherings to spread the word about PASS & CATCH. As a rst step in the KT eorts on behalf of the PASS & CATCH pilot project, the IHP de- veloped and began distributon of an advo- cacy yer highlightng the positve results of the PASS & CATCH research. A copy of the yer is available in Appendix C. The yer is designed to transmit the rel- evant research to interested lay people like teachers, principals, school district adminis- trators, and parents. It features not only the PASS & CATCH research, but also related re- search on the benecial eects of increased physical actvity in the classroom. This ad- vocacy yer has already been used several tmes by Dr. Murray in her presentatons, and she reports a very positve response. A revised version of this advocacy yer, targeted to legislators and policymakers, is being developed. The revised yer more strongly emphasizes the cumulatve impact of research into the benecial eects of classroom physical actvity, and accentuates the relatonship between physical actvity and improved academic performance. This version of the yer clearly calls for ac- ton on the part of the intended audience, in the form of policy and funding changes. The RIA sta also worked with Dr. Murray to develop a PowerPoint presentaton suitable for use at various school district and School Health Advisory Council meetngs, as well as other educaton-focused audiences. Act i ve Bodi es, Act i ve Mi nds O 18 A Knowledge Translation Initiative Research Into Action RIA sta has reached out to interested par- tes at the Centers for Disease Control on behalf of PASS & CATCH. The CDC would support implementaton of a natonal dis- seminaton eort in support of PASS & CATCH, once the ndings are published. In additon, the RIA sta is currently com- pletng a stand-alone PowerPoint presen- taton that details the correlaton between physical actvity and academic achievement. Leading up to the conclusion of the PASS & CATCH project, the IHP plans to work with Dr. Murray to develop an evaluaton tool for the presentaton; schedule more presenta- tons to groups of decision makers and other inuental people in school curricula; and work with her on perfectng her presenta- ton skills. The goal is to complete all pending PASS & CATCH support actvites by June 2009, contngent on the U.S. Centers for Disease Control and Preventons collaboraton in a natonal media campaign. The implicatons of successful KT of this re- search are manifold. Dr. Murrays research indicates that poorly adaptng children, in partcular, benet from increased physical actvity. Her PASS & CATCH study, and the rapidly ac- cumulatng supportng evidence, all point to improved academic, social, classroom man- agement, and productvity outcomes from increased physical actvity. While this KT project focused on academic outcomes, the results have the side ben- et of lending further support to the batle against childhood obesity, which is a bur- geoning epidemic in the United States. An example of communicatons material developed for the disseminaton of PASS & CATCH ndings appears in Appendix C. 19 SBIRT - Expert Analysis 20 A Knowledge Translation Initiative Research Into Action SBI RT - Exper t Anal ysi s he second research project for RIAs inital year was Screening, Brief Interventon and Referral to Treatment (SBIRT). SBIRT is a program mandated for use in all level I trauma centers. Doctors and other medical personnel are required to screen accident patents for signs of substance abuse (level II trauma centers are required to have a screening component only). If the patents are found to be under the inu- ence, the issue is discussed with them and the medical professionals will either con- duct a brief interventon or refer them to facilites where they can receive treatment. RIA decided to focus its eorts on Houston- area level III and level IV trauma centers, which are not required to provide SBIRT services, to translate the existng evidence on program eectveness, provide resource links and optons to assist in the adopton decision. RIA, working with an external expert, Dr. Larry Gentlello, developed a survey for area trauma centers regarding the barriers to the adopton of SBIRT. Dr. Gentlello is one of the leaders in the SBIRT eld. The survey was administered online and was completed by either trauma program manag- ers or coordinators. Nine of the 11 level III and IV trauma centers in Harris County responded. The team soon found that the level III and level IV trauma centers in the Houston area did not have the comprehensive framework in place to support the SBIRT initatve, through no fault of their own. Resources are tght, and as a result many of the smaller hospitals do not have the tools necessary to run an eectve SBIRT pro- gram. Only three trauma centers reported providing patents with alcohol/drug abuse counseling. However, a majority of respondents thought that between 15-30 percent of their patents would be positve for alcohol and drug use if tested, and more than 10 percent would be re-admited for re-injury in the next ve years. With most centers admit ng between 500- 3,000 patents annually, 10 percent of patents would be a large number of re-admitances. Also, a majority of respondents believed that alcohol/drug abuse was a signicant burden, and that their patents would benet from T 21 A Knowledge Translation Initiative Research Into Action having an alcohol interventon. Six organi- zatons were interested in a presentaton of the eectveness and cost savings of the SBIRT program, providing the RIA an oppor- tunity to improve the care provided to pa- tents in level III and level IV trauma centers in Houston. Now that the survey is complete, the data is being analyzed by IHP personnel and shared with outside experts in the eld. Using the informaton gathered in the survey and its own environmental assessment, RIA sta will present the results to an upcoming meetng of the Harris County Regional Advi- sory Council on Trauma. The sta will also develop a portolio of communicatons materials identfying the most likely obstacles in developing an SBIRT program and how they can be over- come basically an expansive toolkit that will provide these hospitals with the informaton and strategies necessary to implement their own SBIRT protocol. This will be presented to level III and level IV trauma program managers/coordinators throughout the Houston area by the end of April, 2009. Additonally, the RIA plans to release the survey results to the media and actvely pursue media coverage of the issue. 22 World 2.0 Web Site Re-design 23 A Knowledge Translation Initiative Research Into Action Wor l d 2.0 s the IHP and the RIA team delved further into knowledge transfer, it became clear that there was no central repository for KT informaton no search engine, Web portal, or comprehensive Web site where KT pro- fessionals and others could go to nd out the latest news and informaton, and con- nect with other KT professionals. With that in mind, the RIA team launched a second major initatve developing a Web portal that would be a one-stop-shop for all KT public health informaton. To accomplish this, the team rst conducted an audit and in-depth assessment of all KT- related sites using multple keywords and three dierent search engines. Next, the team created and conducted a survey of potental users that would pin- point what features people are looking for in a KT Web portal, and how they currently use the Web to conduct research, establish networks, and disseminate scholarly and technical informaton. An example of the Web audit appears in Appendix D. As mentoned earlier, these results were analyzed and presented at last years CDC Health Communicatons Conference. Afer the conference, the IHP sta sent the survey to hundreds of conference atendees asking for their input, as well. The results were striking. More than 70 per- cent of all respondents indicated that they use the Internet regularly to track down KT informaton, but they also indicated dissat- isfacton with the amount of informaton available and the ease of locatng it. A 24 A Knowledge Translation Initiative Research Into Action The ndings of the user survey appear in Appendix E. Using the survey results and the teams own research, they developed a blueprint for a comprehensive Web portal dedicated to knowledge transfer. The IHP envisions the site as a central repository for all things KT related. It will include a glossary of terms, best practces, links to relevant insttutons and the latest KT artcles and research, a cal- endar of events, an electronic bibliography, current KT funding sources, and areas for user comments. An outline of the Web portal appears in Appendix F. The sta created a request for proposal, which was sent out to potental vendors. Bids were submited for consideraton by six companies interested in developing the Web portal. These bids are currently under- going a careful review, as this project will become a cornerstone of the IHPs contri- buton to the world of KT. The portal will launch mid-summer 2009. At the same tme, the IHP is undertaking a major redesign of its Web site (www.sph. uth.tmc.edu/ihp/). A graphic designer with extensive Web design experience was hired in March, and she is respon- sible for designing a site that takes into account the unique needs of the users. This user-friendly site, which will be main- tained in-house, will be implemented mid-summer 2009. The RIA is also exploring the new Web 2.0 communicatons technologies. An IHP Facebook page was established in Febru- ary, and the use of vehicles such as Twit- ter are also under consideraton. The IHP is dedicated to using the power of the World Wide Web to spread the word about KT, and to positon itself as a leader in the eld. 25 Health of Houston 2010 Survey Identifying the Health of Houston 26 A Knowledge Translation Initiative Research Into Action I dent i f yi ng t he Heal t h of Houst on s a conditon of our ExxonMobil Founda- ton funding, the IHP has pursued matching funds from other sources. One signicant initatve of ours currently being funded by the Houston Endowment is called the Health of Houston. One of the projects under this initatve is the Health of Houston 2010 survey. This survey, the rst of its kind in the greater Houston area, will assess the self-reported health of Houstonians and provide com- munity-level estmates of health status and health care needs. The survey will support the eorts of health agencies, service providers, and commu- nity organizatons with more accurate and up-to-date health informaton, and provide specialized analyses, topical reports, and training in the use of survey informaton. The IHP sta has been researching the vari- ous groups and organizatons dedicated to health in the Houston area, identfying a network of hundreds of potental users of the report, and securing their support. The sta is emphasizing governmental, community, and stakeholder involvement in the survey planning, implementaton, and disseminaton process. Driving the inital development of the sur- vey is the queston: What do these orga- nizatons want to know about the health needs of the people they serve? Working directly with the groups to develop the survey will enable the IHP to custom-de- sign a survey that will be the most useful to its audience. The IHP is using this informaton to de- velop a comprehensive health needs survey of the Houston area. Results will be provided to the organizatons so that they can use it to apply for grants, target care based on areas of need, and develop policy recommendatons. The Health of Houston 2010 survey will involve 3,000-4,000 Houston households. It will queston the members of these households regarding their access to health care, their general health, their ex- periences with chronic diseases, and their primary health care needs. A 27 A Knowledge Translation Initiative Research Into Action Up to this point, health organizatons have had to cobble together informa- ton from a variety of sources, said Jessica Tullar, Ph.D., an epidemiologist on the survey team. We want to connect the unknown to the known we want to provide people with the informaton they need about the health topics specic to their neighborhoods, something thats never been done before in a systematc way. The survey results are expected to be released at the beginning of 2011. 28 What Weve Accomplished 29 A Knowledge Translation Initiative Research Into Action What Weve Accompl i shed uring its rst full year of actvity, RIA has moved from research, review, and planning, to the executon of a variety of signicant projects. For an overview of the RIA process, see Appendix G. First, the team developed the axial model as a new way of conceptualizing the KT task and as a contributon to the state of the art. The axial model describes various poten- tal scenarios from simple to complex, and then prescribes appropriate tactcs for ac- complishing the appropriate KT goals. The methods (tactcs) are drawn from current practces in social marketng, public rela- tons, and advertsing. An exhaustve list of these methods and their potental targets was compiled for future eorts, thus reduc- ing planning tme. Second, the team introduced a three-level tool for analyzing the suitability of research projects for KT the project selecton ma- trix. This was used to narrow down the more than 140 eligible research projects from the UT School of Public Health. Evidence map- ping could then be applied in a targeted way to establish the state of the science for each of the priority areas idented. To create a foundaton for current and fu- ture projects, the RIA team conducted three online surveys. The rst was a survey of KT professionals on their use of the Internet for KT research. A revised version of this survey was con- ducted with the atendees at the 2008 Cen- ters for Disease Control (CDC) health mar- ketng conference, adding several questons on their use of social networking (Web 2.0). Finally, a county-wide survey of all level III and level IV trauma centers idented im- portant informaton about emergency room admissions, substance abuse, and the use of interventons. As the rst two projects (PASS & CATCH and SBIRT) moved forward, sta began a broad outreach program to create strategic link- ages not only for the two inital projects, but for future projects as well. Among the more than 30 organizatons contacted so far are the CDC, the Canadian Insttutes for Health Research, and the Southwest Educatonal Development Laboratory. For the PASS & CATCH project, RIA created an advocacy yer and PowerPoint presenta- ton suitable for lay audiences, and assisted the principal investgator (PI) in tailoring her presentaton to lay audiences consistng of D 30 A Knowledge Translation Initiative Research Into Action teachers, principals, school health profes- sionals, and parent volunteers. Using our KT model, we idented the PI as a product champion, and built the KT program around her uency with the research. We are now identfying and booking more presentatons with area independent school districts and School Health Advisory Councils. For the SBIRT project, RIA sta is now in the process of developing a communicatons portolio that will identfy likely obstacles to SBIRT implementaton and potental so- lutons. This is a direct outcome of our sur- vey of level III and level IV trauma centers, which pinpointed the issues and obstacles emergency room directors and trauma coordinators had with SBIRT. The RIA project has met its matching re- quirements for next year via a gif to the IHP from the Houston Endowment for the Health of Houston Project. 31 The Future of the RIA What We Will Accomplish 32 A Knowledge Translation Initiative Research Into Action he Research Into Acton group antcipates an extremely busy 2009. We will be wrapping up our two inital research projects, as well as choosing two new projects to focus on. To determine what public health topics are currently at the forefront of research, the sta conducted an audit of dozens of prominent public health organizatons such as the Centers for Disease Control, the Texas Public Health Associaton, and the Natonal Insttutes of Health. Based on that research, the group has narrowed down the re- search paradigm to the following: The sta is contnuing to evaluate these topics, and will, within the next several weeks, identfy two research topics to focus on in the coming months. What We Wi l l Accompl i sh Insurance issues Environmental health Obesity prevention initiatives, policies, etc. Diabetes management Aging and disability issues Alcohol abuse and proposals to lower the drinking age HPV vaccinations Access to mental health care Language barriers to accessing health care The fate and impact of evidence-based guidelines Meanwhile, the group antcipates the com- pleton of two major initatves mid-sum- mer. Both the KT Web portal, the rst of its kind, and the completely renovated IHP/ RIA Web pages will be unveiled. These two T 33 A Knowledge Translation Initiative Research Into Action projects are the cornerstones of the RIAs communicatons outreach and represent a huge amount of tme and eort. Each of these Internet initatves will substantally raise the prole of the IHP and RIA, both in the United States and globally. 34 Societal Benefts 35 A Knowledge Translation Initiative Research Into Action Soci et al Benet s he RIA initatve is built on the assumpton that the publics health can be improved with beter KT. This belief, supported by cur- rent ndings in the KT literature, promotes the idea that research will improve health practces and policy decision-making, and that evidence-based decision-making about health is superior to current practce. Through our research and assessments of KT organizatons, the RIA has idented gaps between the optmal KT practce and what is currently being done. The RIA proposes a beter way of conductng KT and is dedi- cated to sharing this model through a Web portal that will also create an environment for contnued advances in the KT process. By engaging in KT in public health priority areas, we are able to address large-scale problems with evidence-based programs and policies that have proven eectve. Our translaton of the PASS & CATCH research connects us to larger eorts on obesity pre- venton and the great need to address the obesity epidemic. Likewise, our eorts promotng the adop- ton of SBIRT, a program proven to reduce injury and substance abuse, can have an impact on thousands of lives in a single year. Our foremost goal is to have eectve KT become the norm. We hope to set the standard in public health research and practce our natons quality of life and economic future depend on it. T Dr. Stephen Linder Interim Director RAS E1023 [email protected] Of ce: 713/500-9494 Oluwafolakemi (Folake) Adedeji Graduate Assistant RAS E1003M [email protected] Desk: 713/500-9498 Richard (Rick) Austin Senior Communications Specialist RIA RAS E1015 [email protected] Of ce: 713/500-9486 Amy Beaven Research Associate RAS E1021 [email protected] Of ce: 713/500-9409 Larissa Estes Graduate Assistant RAS E1003N [email protected] Dr. Dritana Marko Faculty Associate San Antonio campus [email protected] Of ce: 210/562-5541 Syed Noor Graduate Assistant RAS E1003L [email protected] Desk: 713/500-9497 Patricia (Patty) Poole Executive Assistant RAS E1025 [email protected] Of ce: 713/500-9318 Shannon Rasp Senior Communications Specialist RIA RAS E1013 [email protected] Of ce: 713/500-9490 Thomas (Tom) Reynolds Research Associate RAS E931 [email protected] Of ce: 713/500-9387 Nickalos (Nick) Rocha Program Manager RIA RAS E1019 [email protected] Of ce: 713/500-9488 Denise Truong Graduate Assistant RAS 1003J [email protected] Desk: 713/500-9480 Dr. Jessica Tullar Faculty Associate RAS E1007 [email protected] Of ce: 713/500-9481 Li Yu Graphic Designer RAS E1003S [email protected] Desk: 713/500-9484 The Institute for Health Policy The University of Texas School of Public Health 1200 Herman Pressler Houston, Texas 77030 713/500-9318 37 A Knowledge Translation Initiative Research Into Action Institute Director Executive Assistant Fellowship Program Health of Houston Research Into Action Program Manager Program Manager Faculty Afliates Faculty Afliates Sr. Comm. Specialist Sr. Comm. Specialist Research Associate Research Associate Research Associate Research Associate Research Associate Faculty Associate Graphic Designer Graduate Assistants Graduate Assistants Graduate Assistants Interns Clean Air Project Decision Support Appendices Three-Level Project Screening Criteria Appendix A
Three-Level Project Screening Criteria
Introduction
For the first two knowledge translation (KT) projects undertaken by Research Into Action A Knowledge Translation Initiative, the staff used a three-level, 15-step screening process to evaluate and select suitable projects. All current UT SPH research projects were loaded into a Microsoft Access database, which allowed easy rating, recording, organization, and analysis of the screening results.
The level one review contained five screening criteria; the level two review contained four screening criteria; and the level three review contained six criteria. For each screening round, the database presented reviewers with each screening criterion and an accompanying checkbox. Checking the box indicated that the reviewer found the proposed project acceptable under that criterion. Leaving the box unchecked indicated that the reviewer found the proposed project unacceptable under that criterion.
During the level one review, generally speaking, a project needed to be acceptable under all five criteria. Levels two and three were subject to discussion and negotiation among the reviewers if there was a substantial amount of disagreement as to whether a project was acceptable.
Level One Screening Criteria
Criteria Description 1.1 Is the project a UT SPH project? In the first year of the RIA project, staff reviewers only considered research that was based in the UT School of Public Health 1.2 Are the research sites in-state? For ease of access and logistics, staff reviewers only considered research where the primary sites were within the state of Texas 1.3 What is the political index for the project? Political index refers to the political and public sensitivity of the research under consideration. Research that was considered to be highly sensitive was ruled out. As a hypothetical example, a well- designed, well-supported study on birth control among sexually active teenagers; with significant results, would still be screened out because of the sensitivity of the subject in a highly conservative state like Texas 1.4 What is the market/user/media receptivity to the project? Reviewers considered how mass media and the general public would view the importance of the research project under consideration. For example, a study on genetic markers for a pre-disposition to Type II diabetes would only be of interest to other geneticists; there would be little chance of successful knowledge translation to a broad audience 1.5 What is the potential health impact of the project? Reviewers considered the breadth of impact of the research results. For example, a study of HIV-positive Hispanic teenagers in economically depressed areas along the Texas-Mexico border is worthwhile, but the audience is self-limiting. The broader the potential user audience, the more likely that the project would be kept in
Three-Level Project Screening Criteria
Level Two Screening Criteria
Criteria Description 2.1 What is the cost of this project to our office? Based on the principal investigators description of the research project and its results, reviewers considered which modalities might be most appropriate for KT, and what their potential cost might be. No actual estimate of costs was entered; the reviewers indicated whether they thought the potential cost was acceptable 2.2 What is the level of effort required? Reviewers considered the level of work impact on staff if the project under deliberation was accepted 2.3 How simply can the issue be translated? This criterion relates to the complexity of the issues raised by the research and how easily they might be translated to the intended audience. Research featuring complicated, difficult-to-comprehend results would be screened out 2.4 What is the likelihood of KT success? This criterion asked the reviewer to consider the cost, level of effort, complexity of the issue, and the potential audiences likely acceptance or rejection of the research, and make a subjective judgment about the potential for success
Level Three Screening Criteria
Criteria Description 3.1 What is the quantity and quality of the published evidence supporting this project? By this stage, a preliminary evidence map has been created for all of the research projects still under consideration, and reviewers are asked to judge whether or not the supporting evidence is sufficient to warrant further consideration 3.2 How generalizable is the project? This criterion asks the reviewer to judge how broad an audience is affected by the project under consideration; the broader the audience, the more likely the project will be kept in for consideration 3.3 How personalizable is the project? For this criterion, the reviewer considers whether the project can be positioned as having a personal impact on the health and well-being of the end-user. If its easy for the end-user to say this doesnt affect me, or I would never have that problem, then the project is likely to be screened out 3.4 How easy will it be to evaluate our progress/success/failure on this project? The reviewer considers how and when milestones for progress might be assessed, and whether there are easily definable measures of success or failure. If the project does not lend itself to concrete measurement in this regard, it is likely to be screened out 3.5 Are there potential advocates/ promoters/champions for this project? This criterion asks the reviewer to consider what, and how many, ancillary audiences might be supportive of the project, and whether they could be recruited to help support KT efforts 3.6 What is the cost effectiveness implication for the user on this project? For this criterion, the reviewer assesses the pocketbook impact of the project on the end-user. The more cost-effective the project can be demonstrated to be, the more likely it is to be kept in for consideration
Appendix B SBIRT Evidence Map
We synthesized the results of many individual studies conducted on SBIRT and childhood physical activity to apply the best research evidence to our two projects. We also reviewed databases of peer- reviewed literature for our two topics. We then sorted articles according to established criteria and integrated the findings. From this, we generated a map of clustered ideas representing the multiple dimensions of each research question. Our maps are visual diagrams showing related concepts, as well as differences in study populations or settings, and serve as a guide for an interventions applicability and effectiveness. In the case of SBIRT, we reviewed over 100 articles and categorized 98 of them into four primary categories and 15 secondary categories. Fewer studies have been conducted around childrens physical activity and academic achievement, but a majority of the 27 relevant articles we reviewed reported positive impacts on school performance. Topical Dimensions of 98 Articles Assessment Tools 15 Articles Sub-Populations 20 Articles Implementation or Barriers 51 Articles Economic Evaluation 14 Articles SBI Effect Size 48 Articles Who delivers? Nurses or GPs Screening Instruments Web & Electronic Screening Elderly Youth, Adolescent, College-Age, 18-24 Ethnicity and Cultural Sensitivity Physician and Patient Attitudes Motivational Interviewing Training Requirements and Quality Guides Women and Pregnant Women Long-term and short-term In EDs, Trauma Centers and Primary Care Cost of SBIRT Programs Cost/Benefit Analysis for States Reduced Drinking and Reduced Visits to ED Classroom Physical Activity and Academic Achievement Making the Healthy Choice an Easy Choice Both reading and math scores improve for poorly adapting physical activity. (Murray, et. al., and Fourth Grade Students in Texas With Adaptive Skills Problems, American Public Health Association, October 29, 2008, San Diego, CA [Funded through Prevention Research Center Program of Centers for Disease Control and Prevention]
All students improve their math scores when they increase their physical activity. PASS & CATCH Fitness and Academic Achievement Among Third an of Sports Medicine, May 30, 2008, Indianapolis, IN Disease Control and Prevention])
Increased classroom activity leads to significant (Mahar, et. al., Effects of a Classroom Sports and Exercise, 2006)
Increased physical activity al., Coordinated School Health Programs and Academic Achievement: A Systematic Review of the Literature Health, 2007)
The evidence is clear:
Increased classroom physical activity help teachers improve classroom management, math and reading scores, concentration and time on task, and help their students make healthy choices and develop healthy habits.
(Fitness + Focus) (Fitness + Focus) (Fitness + Focus) (Fitness + Focus) x x x x Time on Task Time on Task Time on Task Time on Task = == = Better Prepared Better Prepared Better Prepared Better Prepared 22 22 22 22 x 8 x 8 x 8 x 8 176 176 176 176 5(x + 2) = 25 5(x + 2) = 25 5(x + 2) = 25 5(x + 2) = 25 [ [[ [5(x + 2 5(x + 2 5(x + 2 5(x + 2]/5 ]/5 ]/5 ]/5 = 25 = 25 = 25 = 25/5 /5 /5 /5 x + 2 = 5 x + 2 x + 2 = 5 x + 2 x + 2 = 5 x + 2 x + 2 = 5 x + 2 - -- -2 22 2 = 5 = 5 = 5 = 5 - -- -2 22 2 x = 3 x = 3 x = 3 x = 3 *Classroom activities such as those used in the PASS & CATCH study are low TAKE 10 program, www.take10.net. Physical Activity Adds Up Children and adolescents should do 60 minutes or more of aerobic physical activity every day to receive substantial health benefits, according to the 2008 Physical Activity Guidelines for Americans published by the U.S. Department of Health and Human Servi The good news is that basically any activity counts, as long as it's done at a moderate or vigorous intensity for at least 10 minutes at a time. When combined with PE or structured recess minutes, simple 10-, 20-, or 30-minute classroom physical activ closer to the daily goal. Adding physical activities that kids enjoy and that match their abilities will help ensure that you and the class stick with them to see both health and academic rewards. Appendix C Classroom Physical Activity and Academic Achievement Making the Healthy Choice an Easy Choice
There is growing scientific evidence that shows the link between physical activity and student success. Being active stimulates the mind and we function better throughout the day. This is true for administrators, teachers, and students. Teachers have known for years that students are more attentive, less fidgety, behave better, and some can improve scholastically after physical activity like recess, or after physical education. So why not and fun physical activity into your educational curriculum?
reading and math scores improve for poorly adapting** students when they increase their Murray, et. al., PASS & CATCH Classroom Physical Activity and Stanford 10 Scores Among Third and Fourth Grade Students in Texas With Adaptive Skills Problems, American Public Health Association, October 29, 2008, through Prevention Research Center Program of Centers for Disease Control and Prevention] students improve their math scores when they increase their physical activity. Fitness and Academic Achievement Among Third and Fourth Grade Students in Texas, 08, Indianapolis, IN [Funded through the Prevention Research Center Program of Centers for classroom activity leads to significant, systematic improvement in on Effects of a Classroom-Based Program on Physical Activity and On-Task Behavior, Medicine and Science in activity does not take away from classroom academic outcomes. Coordinated School Health Programs and Academic Achievement: A Systematic Review of the Literature Increased classroom physical activity can management, math and reading scores, concentration and time on task, and help their students make healthy choices and A Knowledge T Institute for Health Policy P.O. Box 20186 Houston, TX 7 **Poorly adapting students are those who score below average on measures skills, coping skills, and adaptation to school.
Classroom activities such as those used in the PASS & CATCH study are low-cost, easy to use, and immediately available through the Children and adolescents should do 60 minutes or more of aerobic physical activity every day to receive substantial health benefits, 2008 Physical Activity Guidelines for Americans published by the U.S. Department of Health and Human Services. The good news is that basically any activity counts, as long as it's done at a moderate or vigorous intensity for at least 10 minutes at a time. When combined with PE or structured recess minutes, simple minute classroom physical activities get students closer to the daily goal. Adding physical activities that kids enjoy and that match their abilities will help ensure that you and the class stick with them to see both health and academic rewards. Classroom Physical Activity and Academic Achievement Making the Healthy Choice an Easy Choice evidence that shows the link between eing active stimulates the mind and we function better throughout the day. This is true for administrators, teachers, and students. Teachers have known for years that students are more attentive, less fidgety, behave better, ally after physical activity like recess, or after physical education. So why not build movement and fun physical activity into your educational curriculum?* students when they increase their Classroom Physical Activity and Stanford 10 Scores Among Third and Fourth Grade Students in Texas With Adaptive Skills Problems, American Public Health Association, October 29, 2008, through Prevention Research Center Program of Centers for Disease Control and Prevention]) students improve their math scores when they increase their physical activity. (Murray, et al., d Fourth Grade Students in Texas, American College Prevention Research Center Program of Centers for , systematic improvement in on-task behavior. , Medicine and Science in classroom academic outcomes. (Murray, et. Coordinated School Health Programs and Academic Achievement: A Systematic Review of the Literature, Journal of School Translation Initiative 77225 713.500.9318 Poorly adapting students are those who score below average on measures of social cost, easy to use, and immediately available through the This program lets my mind wake up because you always have to concentrate on doing your best. PASS & CATCH student
I also liked the game where we would pass the ball multiplication tables. This game we would play before math in the morning to get our heart pumping. PASS & CATCH student I really enjoyed the activities positive energy from the activities. PASS & CATCH teacher
My students were able to get out their the different activities. PASS & CATCH teacher My students were more focused and when students were getting off task, I would use PASS & CATCH activities. PASS & CATCH teacher
PASS & CATCH Reading Scores PASS & This program lets my mind wake up because you always have to concentrate on doing I also liked the game where we would pass the ball around the room and give each other This game we would play before math in the morning to get our heart really enjoyed the activities the kids enjoyed them also. We were able to get a lot of positive energy from the activities. were able to get out their pent-up energy in a positive way. They really enjoyed My students were more focused and when students were getting off task, I would use PASS PASS & CATCH Reading Scores PASS & CATCH Math Scores This program lets my mind wake up because you always have to concentrate on doing around the room and give each other This game we would play before math in the morning to get our heart the kids enjoyed them also. We were able to get a lot of up energy in a positive way. They really enjoyed
My students were more focused and when students were getting off task, I would use PASS Lear ni ng about k now l edge t r ansl at i on vi a t he Wor l d Wi de Web: Ar e we as di ssemi nat or s usi ng t he Web t o di ssemi nat e? Amy T. Beaven, Al i c i a Samuel s, St ephen H. Li nder, Ph.D, Ri char d A. Aust i n, Fol ake Ol ani r an, Ni ck al os A. Rocha, Syed W. Noor Appendix D A composite score was calculated for each site by summing up the graders assigned scores (possible score range is from 30 to 102). Higher scores indicate that the site contains relevant KT information, is easy to navigate, has understandable content, has an enhancing overall design, incorporates examples of best practice, gets updated regularly, encourages visitors to engage in KT, and has interactive features, a search function, a feedback tool and external links to KT information. Back gr ound Knowledge translation (KT) is a dynamic process that includes the synthesis, dissemination, exchange and application of knowledge to improve the outcomes of professional practice. The current climate of transparent governance and accountability in health research has generated renewed interest in KT. This newfound emphasis What do KT Pr of essi onal s Want ? In a recently conducted international survey of KT professionals, respondents indicated a clear need for a comprehensive KT Website, and noted a number of features that they would like to see in such a site. Met hods On a single day in May 2008, graders conducted two internet searches (first with keyword Knowledge Translation and secondly Knowledge Transfer) on three different search engines (Google, Ask and Scirus) and recorded the first 10 sites generated. After removing duplicates and non-working sites, graders each rated the same 45 sites with the following measures: Rat i ng t he Top KT Websi t es 14 16 Q3: How do you rate the need for a comprehensive healthcare-related KT Website? (42 of 43 responded, average rating: 3.88) 16 18 Q4: How likely would you be to use a comprehensive healthcare-related KT Website? (42 of 43 responded, average rating: 3.95) I nst i t ut e f or Heal t h Pol i cy, Resear ch I nt o Ac t i on I ni t i at i ve (RI A) p in healthcare and public health-related KT (sometimes termed evidence-based medicine) has spurred new research and practice, with novel KT models and best practices. No research study to date has examined the extent to which KT is being utilized to disseminate information. Has the field utilized the fastest method of spreading information: moving information from the KT research community to those charged with disseminating and implementing research outcomes? To answer this question we had three Likert Scale (1=low to 5=high) Relevance of content/Degree of KT information; Ease of navigation; Readability/Content understandable; Overall design (are the colors/graphics appropriate for the site/audience, do they serve to enhance the user's experience), Yes/No items Top Websi t es Know l edge Tr ansl at i on 0 2 4 6 8 10 12 2.4% 7.1% 23.8% 33.3% 33.3% 0 2 4 6 8 10 12 14 2.4% 2.4% 31.0% 26.2% 38.1% Hosting Organization Composite Score 1 Atlantic Health Promotion Research Center (www.ahprc.dal.ca) 88 2 Australian Indigenous HealthInfoNet (www.healthinfonet.ecu.edu.au) 86 3 World Health Organization (www.who.int/kms/en/) 85 4 Canadian Institutes of Health (www.cihr-irsc.gc.ca) 83 5 Joint KT Program of St. Michael's Hospital and The University of Toronto 83 ou co es? o swe s ques o we d ee independent graders systematically identify and review the same websites using a set of measures determined valuable in a survey of KT professionals. Yes/No items Presence of best practices/Examples of how KT is done; Presence of tool to solicit feedback/contact for more information; Does site get updated frequently; Presence of interactive features; Does the site contain verbiage to intrigue, educate and motivate visitors to engage in KT; Is there a search function; and Are there links to other KT-related sites Hosting Organization Composite Score 1 Scottish Agricultural College (www.sac.ac.uk/knowledge/) 83 2 Knowledge Transfer Partnership (www.ktponline.org.uk) 83 3 University of Leeds: Enterprise and Knowledge Transfer Program (wwwcampus leeds ac uk/kt/) 82 Top Websi t es Know l edge Tr ansf er 1 - Not at all important 2 3 - Somewhat important 4 5 - Very important 1 - Not at all likely 2 3 - Somewhat likely 4 5 - Very likely Q7: What feature or features would motivate you to visit a KT Website regularly? (27 of 43 responded) Listserv for current KT research and resources such as analysis tools and effective practices (12) Applicability/usability/accessibility for example to those with disabilities (11) Searchable database of KT research and related papers with summaries (7) Calendar of events for workshops and conferences (2) Interactive tools such as public commenting, user-generated tagging, and individual document ranking (1) RSS f t (1) COUNTRYOF ORIGIN OF WEBSITES FREQUENCY PERCENT Australia 1 2.2 Canada 9 20.0 Multinational 1 2.2 5 g p y (www.stmichaelshospital.com/research/kt.php) Di sc ussi on A majority of the knowledge translation and knowledge transfer sites were easy to navigate had a satisfactory appearance contained common search and Inter-rater agreement of the 12 items was calculated using Cronbachs Alpha (=.732) and the 4 criteria assessed with a Likert scale ranking were found to be normally distributed around a mean value of approximately 3 with a standard deviation close to 1. (www.campus.leeds.ac.uk/kt/) 4 Institute for Work and Health (www.iwh.on.ca/kte/kte.php) 81 5 National Physical Laboratorys Knowledge Transfer (www.npl.co.uk) 79 RSS format (1) Audio/video clips (1) Links to funding agencies (1) No need for searchable database (1) Suggestion to describe how technology can improve/hinder KT (1) *Some responses fell into multiple categories therefore sum of category frequencies will total to more than 27. Switzerland 1 2.2 United Kingdom 10 22.2 USA 23 51.1 Total 45 100.0 AUDITSUMMARYSTATISTICS MEAN STD. DEV. N* Relevance and Degree of KT information (1=low, 5=high) 3.13 1.202 135 Ease of Navigation ( d ff l ) 3.42 1.129 135 NUMBER OFAUDITED SITES WITH KNOWLEDGE TRANSLATION FEATURES RATERS RESPONSE FREQUENCY PERCENT Relevance of KT Information Satisfactory 29 64.4 Not Satisfactory 16 35 6 NUMBER OFAUDITED SITES WITH USEFULINTERNET FEATURES RATERS RESPONSE FREQUENCY PERCENT Ease of Navigation Satisfactory 36 80.0 Not Satisfactory 9 20.0 A majority of the knowledge translation and knowledge transfer sites were easy to navigate, had a satisfactory appearance, contained common search and feedback features, and importantly contained relevant and comprehensible KT information. This suggests that organizations with a KT mission, whether as a primary endeavor or as an enhancement of others efforts, are capable of communicating with their intended audiences (which was more often a practitioner group rather than a researcher or KT professional). However, a majority of KT sites identified in our search lack KT best practices, links to other KT sites, frequent updating and interactive features. This absence may reduce KT professionals ability to form a more integrated community of practice that is capable of synthesizing and sharing information about the field of knowledge translation in a timely and innovative manner. *45 sites by 3 raters (1= difficult, 5=easy) Readability/Content Understandable (1=difficult to understand, 5= highly understandable) 3.36 1.104 135 Colors/Graphics Appropriate for Site/Audience (1=not at all, 5=very much) 3.08 1.100 135 Not Satisfactory 16 35.6 Readability/Understandable Satisfactory 32 71.1 Not Satisfactory 13 28.9 Presence of verbiage to intrigue, educate and motivate visitors to engage in KT Yes 27 60.0 No 18 40.0 Presence of Best Practices Yes 15 33.3 No 30 66.7 Presence of links to other KT-related sites Yes 25 55.6 No 20 44.4 Appearance Satisfactory 31 68.9 Not Satisfactory 14 31.1 Presence of Feedback/Contact Tool Yes 39 86.7 No 6 13.3 Updated Regularly (<2 wks) Yes 8 17.8 No 37 82.2 Presence of Interactive Features (e.g. Blogs, ability to post comment, surveys) Yes 4 8.9 No 41 91.1 Presence of Search Function Yes 35 77.8 No 10 22.2
Appendix E
Survey of Social Marketers Knowledge Translation and Social Networking Survey Results January 2009
Institute for Health Policy
Copyright 2009 Research Into Action A Knowledge Translation Initiative
A Research Into Action Survey of Social Marketers Knowledge Translation and Social Networking Page 2 of 9
Overview In December 2008, Research Into Action A Knowledge Translation Initiative (RIA), an Institute for Health Policy project at the University of Texas School of Public Health, surveyed all of the attendees from the 2008 CDC social marketing conference, Engage and Deliver. Attendees were invited to respond to our online survey via CDCs Health Communication, Marketing, and Media (HCMM) listserv. Of the 914 conference attendees contacted, 167 (18%) responded. Following is a snapshot of the results. The majority of respondents: Are from the United States Use the Internet often for work
Over 90 percent of respondents: Are satisfied with the Internet as a source of information about KT Feel the need for a comprehensive, healthcare-related KT Web site Would be likely to use a comprehensive, healthcare-related KT Web site
Respondents ranked a list of features to incorporate into a comprehensive healthcare- related KT Web site in the following order, from most desirable to least desirable: Searchable database Bibliography Glossary Listserv Calendar of events Audio/video clips Audio/text chats Blog
The most frequently cited features that would motivate respondents to visit a KT Web site regularly are: Listserv Searchable database Web sites usability, accessibility, and applicability
The most frequently cited other tools or features respondents would like to see in a comprehensive KT Web site are: A current database containing KT players/contact information and KT projects/funders Analysis tools, such as case studies, to assess KTs impact and show how to replicate/adapt strategies
Please feel free to share this report with others. If you have any comments and/or are interested in being notified of future RIA projects, please contact Nickalos Rocha, RIA Program Manager, at 713-500-9488.
A Research Into Action Survey of Social Marketers Knowledge Translation and Social Networking Page 3 of 9
The Survey
0% 1% 8% 15% 76% Q1: How often do you use the Internet to help accomplish your daily tasks at work? (167 of 167 responded, all use Internet at least once a week) Less than once a week 1-2 times a week 3-10 times a week 11-20 times a week More than 20 times a week 2.4% 5.4% 22.2% 39.5% 28.7% 3.6% 0% 10% 20% 30% 40% 50% 1- Not at all satisfactory 2 3- Somewhat satisfactory 4 5- Very satisfactory Not applicable Q2: On a scale of 1-5, how do you rate your satisfaction with the Internet as a source of information about KT? (167 of 167 responded, average rating: 3.96) A Research Into Action Survey of Social Marketers Knowledge Translation and Social Networking Page 4 of 9
0.6% 4.3% 22.7% 36.2% 37.4% 0% 5% 10% 15% 20% 25% 30% 35% 40% 1- Not at all important 2 3- Somewhat important 4 5- Very important Q3: How do you rate the need for a comprehensive healthcare-related KT Website? (163 of 167 responded, average rating: 4.09) 0.6% 4.3% 22.7% 36.2% 37.4% 0% 5% 10% 15% 20% 25% 30% 35% 40% 1- Not at all important 2 3- Somewhat important 4 5- Very important Q4: How likely would you be to use a comprehensive healthcare-related KT Website? (165 of 167 responded, average rating: 4.07) A Research Into Action Survey of Social Marketers Knowledge Translation and Social Networking Page 5 of 9
Q6: What feature or features would motivate you to visit a KT Website regularly? (148 of 167 responded) Searchable database of relevant KT research (64) Bibliography of journals, papers, and related research (32) Audio/video clips of related seminars and workshops (22) Listserv for distribution of new KT research and information (18) Regularly updated calendar of events in the field (14) KT blog written by someone actively engaged in KT (14) Live, scheduled audio or text chat on related KT topics (9) Glossary of terms used in KT (5) Feature not suggested by survey: Twitter, RSS feed, and searchable database of audio material (3) Only if pertinent to own specific field of work or cannot find information elsewhere (3) Only if it is truly comprehensive, regularly updated and has working search capability (3) Only if it is user-friendly and uses simple language (3) Only if access is free (2) Still not sure what KT is (2) No need for site at this time (1) *Some responses fell into multiple categories therefore sum of category frequencies will total to more than 148.
0.00 0.50 1.00 1.50 2.00 2.50 3.00 3.50 4.00 4.50 Q5: Following are some of the tools and features we are considering incorporating. Please rate how likely you would be to use each tool or feature. (167 of 167 responded, average rating for each tool below) Blog Live, scheduled audio/text chat Audio/video clips of seminars/workshops Regularly updated calendar of events Listserv Glossary Bibliography Searchable database A Research Into Action Survey of Social Marketers Knowledge Translation and Social Networking Page 6 of 9
Question 8: Do you currently use any social networking Internet sites for any purpose, personal or professional? (167 of 167 responded) Yes No 73.8% 26.2%
Q7: Apart from those listed in question 6, are there any other tools or features you would like to see in a comprehensive KT Website? (84 of 167 responded) No (30) Case studies whether they are successful or not (14) Best practices or How to KT guides for different types of users and target audiences (10) Ability to tailor or breakdown sites resources for different users and audiences (4) Ability to read about and network with others in the field including industry experts (6) Ability to share or link KT Websites resources to other websites (4) Interactive Wiki-like tools: list of other KT sites with user ratings to determine usefulness, allow users to add tools to KT Website and discuss issues in forums (4) Interactive prevention page/site for public groups such as teens and parents (1) Area for ancillary resources such as actual translated documents in plain language for public use, information on health communication campaigns, information containing rigorous or theoretically-based decisions about KT, opinion pieces, news articles (10) Alert systems: RSS feed, email prompt when new info available, progress tracker for previous queries (3) Career, mentoring, educational, and training opportunities (3) Ability to download full reports and papers (1) Summaries of papers in bibliography (1) Plain language throughout site (3) Consensus definitions of KT and include all synonyms such as T3 or T4 research and diffusion (1) Suggestion to make sites objectives clear, one size fits all usually fits none (3) Repeated features surveyed: searchable database, listserv (3) *Some responses fell into multiple categories therefore sum of category frequencies will total to more than 84.
A Research Into Action Survey of Social Marketers Knowledge Translation and Social Networking Page 7 of 9
Q9: If you answered yes to the previous question, please describe what social networking site you use, and what you use it for. (120 of 167 responded) Facebook (95 unique users): networking, business, engage in and monitor dialogue with different audiences about different issues, build public awareness of key issues in communities, other professional use (31); keeping in touch with family and friends, social networking, music, videos, other personal use (70); not specified (21) LinkedIn (59 unique users): professional (39); personal (7); not specified (17) MySpace (19 unique users): professional (3); personal (14); not specified (4) Twitter (11 unique users): internal agency communication (6); personal use (1); not specified (5) YouTube (4 unique users): disease outbreaks, health promotion initiatives and other news (3); not specified (1) Other: Flickr to share public health images or not specified (2); Orkut to keep personal and professional contacts in order (1); Care2 - social activism for healthy and green living (1); WetPaint - wiki/collaborative document sharing tool used in past (1); Ning - professional and personal use (1); BOP Source personal use (1); BlogSpot (1); GovCoop (1); internal and external blogs (1) Professional use confirmed but did not specify specific sites (4) Personal use confirmed but did not specify specific sites (2) Future professional use planned (1) Funding issues prevent professional use (1) No time to use, not matter of interest (1) *Some responses fell into multiple categories therefore sum of category frequencies will total to more than 120.
Q10: If you answered yes to question 8, would you find social networking useful in the pursuit of your work? If so, describe how. (113 of 167 responded) Maintain, expand and/or use network to find others with similar professional interests/work (26) Receive fast feedback from a big network (5) Share resources and best practices, prevent reinventing the wheel (14) Create partnerships, coalition building, interdisciplinary team development, lead to action and change (9) As an intervention or awareness campaign vehicle to target hard to reach or unexposed audiences (7) Probably only to keep up with campaigns and other events (2) Probably only if in specific formats: LinkedIn, Twitter, blog (5) Interest in a KT/health communications/social marketers social networking group (2) Comment about probable importance of social networking in KT (1) Comment about high importance of social networking in public health (5) Yes but concerned about disconnect between generations if used (1) Yes but concerned about limited access in workplace (5) Probably only for job searching (5) Probably only to maintain personal or informal connections (3) Yes but no reason given (7) Unsure (23): open to idea but not sure how, only if utilizes existing application or depends on format/usage No (15): time-consuming, unnecessary, limited utility, not very reliable, not yet or no reason given *Some responses fell into multiple categories therefore sum of category frequencies will total to more than 113.
A Research Into Action Survey of Social Marketers Knowledge Translation and Social Networking Page 8 of 9
49% 18% 20% 10% 3% Q11: What setting do you currently work in? (166 of 167 responded) Government University Nonprofit Private/Commercial Other (please specify) 96% 2% 1% 1% Q12. Where is your organization located? (166 of 167 responded) United States Canada Europe Asia Question 13: Do you currently work in knowledge translation? (164 of 167 responded) Yes No 52.1% 47.9% A Research Into Action Survey of Social Marketers Knowledge Translation and Social Networking Page 9 of 9
Q15: Do you have any other comments or questions about the survey or the Institute for Health Policy's knowledge translation activities? (45 of 167 responded) Defined terms, disagreed with given terms and suggested different term usage (6) Confusion about how knowledge translation (i.e., the survey) relates to their work even given the explanation (4) Pointed out errors in the survey design (2) Suggested defining the focus/purpose because dangerous to get too broad (2) Provide only best information to prevent information overload (2) Make information pertinent and available to groups that need it most (community groups, non-profit and university described) (3) Some work computer systems limit access to networking sites (2) Suggested another website for knowledge transfer, etc. information (1) Interest in Survey Results (3) Interest in Site once created (2) Interest in working together (2) Generic support of IHP efforts (5) *Some responses fell into multiple categories therefore sum of category frequencies will total to more than 35.
Summary This survey represents a preliminary attempt to gather information about knowledge translation, social marketing, social networking, and the use of Web 2.0 technologies for the dissemination of knowledge translation information. It should be considered a general descriptive report, rather than a rigorous investigation. The Institute for Health Policy at the University of Texas School of Public Health, through its Research Into Action program, is committed to expanding the conversation among knowledge translation professionals and social marketers about our models, tools, experiences, and best practices. 6% 45% 24% 8% 17% Q14: How many years have you been working in knowledge translation? (84 of 167 reponded) Less than one year 1 to 5 years 6 to 10 years 11 to 15 years More than 15 years Appendix F
KT Web Portal Features
1. Home page and other content pages 1.1. Editable text for Knowledge Translation (KT) history/definition/organizational context/glossary of terms 1.2. Links to other pages such as About Us page and specific RIA and KT community project pages 1.3. Graphics 1.3.1. Clean layout with current color schemes and extremely user-friendly features 1.3.2. Example sites: http://www.who.int/kms/en/, http://www.ncddr.org/kt/products/focus/focus10/
2. Searchable literature database (programming) 2.1. Ability for web administrator to upload citations in AP format, including title, author, publication date, journal details, abstract, and optional rating text box (see example) 2.1.1. Example site: http://www.ncddr.org/ktinfocenter/articles.html Site is not ideal as a list but the rating boxes and the information provided in the citations is user-friendly
2.2. Users can keyword search and advance search by author, publication date, or journal 2.2.1. Example site: http://www.ahprc.dal.ca/kt/library.cfm Database is searchable by topic area but we prefer keyword and advanced search capabilities like http://www.healthinfonet.ecu.edu.au/html/html_search/search_bib.php
2.3. Users can click to upload new citations in the same format above, which will go through the web administrator for approval and final uploading
2.4. Users can rate citations and post comments and add to threads either anonymously or with a username 2.4.1. Example site: http://www.implementationscience.com/content/4/1/1/comments Also like the bookmark feature of this site allowing users to post citations to other tracking and networking sites
3. Searchable contact database (programming) 3.1. Users can upload a picture, name, contact info, areas of research interest, CV file 3.1.1. Example site: http://www.ginnn.com/
4. Project funders information database (programming) 4.1. Users can upload funding information, including funding organization name and contact information, brief description of opportunity, and link to application 4.1.1. Example site: http://www.researchnet- recherchenet.ca/rnr16/search.do?view=search&fodAgency=CIHR&fodLanguage=E
4.1.2. Example site: http://philanthropy.com/giving/
5. Listserve and E-alert subscription (programming) 5.1. Users have the ability to select items they will receive such as newsletters, funding alerts, citation alerts 5.1.1. Example sites: http://www.galen.org/, http://www.iwh.on.ca/knowledge-transfer-exchange
6. Searchable calendar of events (programming) 6.1. Users have the ability to search by US or International events 6.2. Users have the ability to search by date, location, and theme and post events, final approval being from our identified Webmaster. 6.2.1. Example sites: http://www.library.nhs.uk/knowledgemanagement/ Click on KM events on right panel to see full appeal of this feature, http://www.auril.org.uk/pages/home.php This is an alternative display of the event calendar
7. Formatted pages 7.1. E-Newsletter (text) 7.2. KT community project specific pages. This pages will consist of members existing KT Projects
8. Login to site and social networking (programming) 8.1. Possibility of a My Portal features with sign in that allows users to save searches, bookmark or tag favorite articles, manage listserve and e-alert subscriptions (users can choose what type of information they receive through e-mail), be added to contact list (and be visible to other users), and other social networking features. 8.1.1. Example sites: http://www.brookings.edu/, http://www.idealist.org/, http://www.auril.org.uk/pages/home.php
9. Other features 9.1. Survey on the site that is preferably not a pop-up but one that remains on the side of a page 9.1.1. Example site: http://www.sac.ac.uk/knowledge/ 9.2. RSS feeds (upload and software) 9.3. Podcast capabilities 9.4. Google Analytics services incorporated Appendix G Research into Action Process Timeline Short Term: Model Development and Testing
Long Term: Build Infrastructure and Formally Establish KT Role Review KT Literature Establish Criteria and Select Projects 1. Screening, Brief Intervention and Referral to Treatment (SBIRT) 2. PASS-CATCH Classroom Physical Activity Messaging and Translation Derive Master Protocol from Best KT Practices and Fit with Model Develop Model Evidence Mapping Apply Protocols to Each Project (Promotion and Linkage for our selected projects) Derive Implementation Plan Evaluation Plan Report on Measures of Project Success or Failure and Feedback to Our Model Survey of KT Professionals Web Audit of KT Sites Branding Research into Action Developing a KT Web Portal Appendix H
Research Into Action Operating Budget (from project inception to March 2009)
Budget Expense Encumbrance Pre-Encumbrance Balance Salaries and Benefits