To enable an existing survey on primary care so that it can be used to assess the healthcare expe... more To enable an existing survey on primary care so that it can be used to assess the healthcare experiences reported by adults living with disabilities, and to evaluate its properties. Mixed-methods study. We first identified content areas for measurement as compared to the items in the existing instrument and then developed new candidate items. Cognitive testing was conducted in English and Spanish. After revisions to the primary care instrument based on the cognitive testing results, the draft-enabled instrument was field-tested by mail with telephone follow-up, in English and Spanish. Consumer focus groups and a technical expert panel identified eight content areas in primary care that are particularly important to maximise function and well-being of people of with disabilities. Cognitive testing also revealed serious problems with several items in the existing survey when answered by or about people with disabilities. Field testing yielded 1086 surveys, of which 40% were completed by a proxy respondent. Learning disabilities were reported by 38% of respondents. Item non-response for revised and new questions was less than 4%. It is feasible to enable a survey of primary care and its administration. Survey administration instructions should be modified to accommodate proxy respondents. The screener item to identify people with mobility impairments on walking a distance should be replaced with walking for 6 min. Adding questions from the American Community Survey about functional ability will allow survey sponsors to identify respondents with various limitations, and to compare their experiences to those of people with no limitations. Careful development and testing of the items with input from interested parties throughout the design and testing stages yielded a survey with good psychometric properties and content validity in multiple languages. Health delivery systems can use the survey data to identify clinical processes needing improvement to provide high quality care for people with disabilities.
Many institutions with the interest and desire to conduct health research fail to obtain the fund... more Many institutions with the interest and desire to conduct health research fail to obtain the funding to do this because of a perceived lack of capacity. To ameliorate this problem and reap the benefits that can only be provided by a diverse cadre of researchers, the United States federal government supported the development of research capacity in geographically diverse institutions and in institutions substantially serving minority racial and ethnic minority populations. The purpose of the present paper is to describe an evaluation of two federally funded programs to build health-care related research capacity and the sustainability of the funded projects. To do so, we examined (a) infrastructure capacitybuilding strategies, (b) project barriers and facilitators, and (c) process and success outcomes, including sustainability. Through this examination, we found significant differences between institutions that had little or no existing research infrastructure (''seed projects'') and those with well-developed research infrastructure (''fertilizer projects''). Although this evaluation effort focuses on federally funded programs, the results hold implications for health services research and non-research organizations. 1. BRIC and MRISP programs In FY 2001, the Agency for Health Research and Quality (AHRQ) initiated two health services research infrastructure development programs-the Minority Research Infrastructure Support Program (MRISP) and the Building Research Infrastructure and Capacity (BRIC) Program. These programs focus on improving the research capacity and competitiveness of institutions that predominantly serve racial/ethnic minorities or are located in geographic areas receiving historically low levels of AHRQ funding. Although somewhat similar in intent, the programs differ in their target institutions and their funding structures. Table 1 provides a comparison of the two programs. MRISP and BRIC grantees generally received 4-5 years of funding; but the MRISP grantees received higher levels of total funding on average ($1.7
A study of magnet schools revealed that they have become a significant part of the nation's effor... more A study of magnet schools revealed that they have become a significant part of the nation's efforts to desegregate schools. Most magnet schools are in urban areas and offer a distinctive curriculum. School districts began employing mag-at schools in the 1970s to help desegregate schools. The federal government has assisted magnet schools with funding. This report is designed to study magnet schools, their role in desegregation, and their impact on educational achievement. Telephone interviews were conducted with educators at 600 school districts nationwide. The study revealed that magnet schools are increasing in number and attracting more students, including minority students and students from outside the school's immediate area. They offer a wide range of distinctive programs. Many magnet schools use money from the federal Magnet Schools Assistance Program to help set up and maintain their programs. This report contains six sections: an introduction, the growth of magnet school programs, implementation of magnet schools and magnet programs, federal support for magnet programs, nonmagnet schools and programs of choice, summary of findings and directions for further research. Appendices A-C include study samples, data, and detailed tables as well as the survey instruments. A glossary is also included. (Contains 15 rezerences.) (JPT)
The objective of this study was to identify the factors that influence adherence to antiretrovira... more The objective of this study was to identify the factors that influence adherence to antiretroviral medication regimens in culturally diverse populations with human immunodeficiency virus/acquired immune deficiency syndrome (HIV/AIDS) related to age, ethnicity, and intravenous drug use. The critical incident technique was used to identify factors determining adherence. Through a series of brief, focused interviews, patients were asked to recall specific incidents that affected their adherence to HIV medications. Patients' responses were grouped into categories using Ethnograph software. Two nurse experts, with 94% agreement, determined the reliability of the category listings. A chi(2) analysis compared the proportion of patients reporting each factor across age, ethnicity, and intravenous drug use categories. The total sample of 52 participants included 46 male outpatients with HIV/AIDS receiving care through a Veteran's Administration Hospital in northern California and 6 health care providers. The interviews yielded a total of 294 incidents. Six major categories were identified, and a taxonomy of critical factors determining highly active antiretroviral therapies (HAART) adherence was developed. The categories included reminders and cues (30%), planning (18%), response to HIV/AIDS (17%), HIV medication characteristics (14%), interactions with others (12%), and patient characteristics (10%). The two largest categories representing patient-related factors accounted for nearly half of the incidents. Patients most influenced by positive support from others included non-Caucasians, those under the age of 50 years, and those with fewer years of education. The taxonomy of adherence behaviors provides important information for developing culturally relevant patient adherence education programs and an essential foundation for developing future studies.
Objectives-Research-derived evidence about the impact of sickle cell disease (SCD) on the lives o... more Objectives-Research-derived evidence about the impact of sickle cell disease (SCD) on the lives of affected adults is lacking. We conducted formative research to provide the basis for a comprehensive description of how SCD affects the lives of adults, with the goal of developing a SCD-specific quality-of-life measurement system. Methods-We conducted a comprehensive literature review of patient-reported outcomes, followed by a series of focus groups and structured individual interviews with adults with SCD (n = 122) and their health care providers (n = 15). Results-We reviewed 473 abstracts and included 86 articles in the final review. The literature revealed broad categories of the impact of SCD and its treatment on the lives of adults-pain; emotional distress; social-role functioning; overall quality-of-life; and quality of care. We classified 1213 incidents from the focus groups and interviews into a taxonomy (16 domains) that met the criterion for saturation and was demonstrated to be reliable for the classification of incidents. The final conceptual model was built upon the taxonomy. Discussion-Our conceptual model was similar to previous models with the effects of pain predominating, interwoven with emotional distress, quality of care, and stigmatization. We found a broad range of emotions reflected, including positive effects of SCD. Items for the quality-of-life measure were derived from the taxonomy and the conceptual model may be of use in generating hypotheses for clinical research and improving understanding for clinicians of the lived experience of adults with SCD.
The Rural Alaska Honors Institute (RAHI) is an intensive, six-week residential high school-to-col... more The Rural Alaska Honors Institute (RAHI) is an intensive, six-week residential high school-to-college bridging program aimed at preparing talented rural Alaska youth for the social and academic challenges of college. Since its inception in 1983, RAHI has demonstrated that it is an effective means of encouraging Alaska Native students to attend college and finish a post-secondary degree. Since 2003, a four credit, college-level, field-intensive, introductory geoscience course has been part of the RAHI curriculum. While it is difficult to evaluate what effect this specific course is having on the long term goal of recruiting more minority geoscientists, short term indicators suggest that the course is very effective in increasing the visibility of geology as a desirable career option amongst college-bound Alaska Native youth.
Summer programs are a common strategy for increasing interest in STEM (Science, Technology, Engin... more Summer programs are a common strategy for increasing interest in STEM (Science, Technology, Engineering, and Math) careers among K-12 students. Here we report four years of results from a two-week program designed to expose Hispanic-American high school students in El Paso, Texas to content and careers in the geosciences. The goal of the program was to grow interest in geoscience among a group of students already interested in STEM careers in order to spur a long-term increase in the number of students entering the geosciences from a demographic group that is now greatly underrepresented in the geoscience workforce. Short-term indicators, in the form of data from pre-and post-participation surveys, show statistically significant positive changes in participants' attitudes towards geoscience. Longer-term indicators, in the form of survey results designed to track participants' college careers, show that 55% are still in the geoscience pipeline, as measured by a choice of a STEM discipline as a college major and 10% are geology majors. This high retention rate compares very favorably with national data that show that in 2001, 32% of all bachelor's degrees were awarded in science and engineering disciplines of which 1% were in geosciences.
NOAA education projects serve individuals across the life span, and exist within a wide range of ... more NOAA education projects serve individuals across the life span, and exist within a wide range of venues including K-12 classrooms, Higher Education Institutions, and Informal Education Environments (e.g., museums, science centers, nature reserves). These projects focus on NOAA science education in scientific fields related to the agency ’ s mission (e.g., Ocean, Atmospheric, Climate, and Environmental Science). The population of scientists within these fields has been noted as having acute lack (of) individuals from minority populations and women. However, women have recently begun to be recruited and retained at higher rates in all educational levels. Still post-graduate and early career attrition remains an issue.
Documented deficiencies in adult sickle cell disease (SCD) care include poor access to knowledgea... more Documented deficiencies in adult sickle cell disease (SCD) care include poor access to knowledgeable providers and inadequate treatment in emergency departments (EDs). The aim of this study was to create patient-reported outcome measures of the quality of ambulatory and ED care for adults with SCD. We developed and pilot tested SCD quality of care questions consistent with Consumer Assessments of Healthcare Providers and Systems surveys. We applied psychometric methods to develop scores and evaluate reliability and validity. The participants of this study were adults with SCD (n = 556)-63% aged 18 to 34 years; 64% female; 64% SCD-SS-at 7 US sites. The measure used was Adult Sickle Cell Quality of Life Measurement information system Quality of Care survey. Most participants (90%) reported at least 1 severe pain episode (pain intensity 7.8 ± 2.3, 0-10 scale) in the past year. Most (81%) chose to manage pain at home rather than the ED, citing negative ED experiences (83%). Using factor analysis, we identified Access, Provider Interaction, and ED Care composites with reliable scores (Cronbach a 0.70-0.83) and construct validity (r = 0.32-0.83 correlations with global care ratings). Compared to general adult Consumer Assessments of Healthcare Providers and Systems scores, adults with SCD had worse care, adjusted for age, education, and general health. Results were consistent with other research reflecting deficiencies in ED care for adults with SCD. The Adult Sickle Cell Quality of Life Measurement Quality of Care measure is a useful self-report measure for documenting and tracking disparities in quality of SCD care.
The SEEP reports are based on analyses of extensive data for the 1999-2000 school year. The SEEP ... more The SEEP reports are based on analyses of extensive data for the 1999-2000 school year. The SEEP includes 23 different surveys to collect data at the state, district, and school levels. Survey respondents included state directors of special education, district directors of special education, district directors of transportation services, school principals, special education teachers and related service providers, regular education teachers, and special education aides. Survey responses were combined with other requested documents and data sets from states, schools, and districts to create databases that represented a sample of approximately 10,000 students with disabilities, more than 5,000 special education teachers and related service providers, approximately 5,000 regular education teachers, more than 1,000 schools, and well over 300 local education agencies. The series of SEEP reports will provide descriptive information on the following issues: • What are we spending on special...
Challenges and Opportunities for Transforming From STEM to STEAM Education, 2020
The 21st century offers many technological advancements resulting from cutting-edge research bein... more The 21st century offers many technological advancements resulting from cutting-edge research being conducted by scientists and engineers at higher education institutions, industries, and national labs. As exciting scientific research is being conducted, the need to address the challenges of inspiring and engaging new learners in science, technology, engineering, and mathematics (STEM) fields continues to grow. The authors present the Science Cartoons (SciToons) program as a model for making science more accessible through the integration of the arts with STEM (STEAM). The SciToons model is based on a Multimedia Learning Theoretical Framework (MLTF), which facilitates co-creation of knowledge and takes into account the contributions of STEM and non-STEM experts. The SciToons model combines this knowledge and expertise with art, animation, high-quality multimedia, and storytelling in the development of science videos that are engaging to a broad audience.
Performance measurement systems (PMSs) are developed and implemented to support the accomplishmen... more Performance measurement systems (PMSs) are developed and implemented to support the accomplishment of objectives of an organization or organizational initiative. PMSs are structured to enable monitoring of performance. This monitoring is accomplished through the identification of areas of concern and success, with the ultimate goals of developing organizational capabilities and enhancing organizational learning. This article reviews the literature on performance measurement and its implementation, and proposes a model to guide the development and implementation of PMSs. The article concludes with a consideration of the broader implications of PMSs and provides recommendations for future research in PMSs with regard to human resource development.
Crowe RP , Bentley MA , Levine R . The Longitudinal Emergency Medical Technician (EMT) Attributes... more Crowe RP , Bentley MA , Levine R . The Longitudinal Emergency Medical Technician (EMT) Attributes and Demographics Study (LEADS): the first 10 years and a look at public perception of Emergency Medical Services (EMS). Prehosp Disaster Med. 2016;31(Suppl. 1):s1-s6.
The objectives were to assess changes in (1) health and physical fitness, (2) the prevalence of s... more The objectives were to assess changes in (1) health and physical fitness, (2) the prevalence of selected health problems, (3) risk behaviors, (4) ambulance safety issues, and (5) the preparedness of Emergency Medical Services (EMS) professionals. In addition, the incidence of patient-initiated violence directed toward EMS personnel and associated factors were assessed. Data were obtained from a sample of nationally certified EMS professionals via annual questionnaires between 1999 and 2008. Stratification was based upon national certification level, self-reported race, and experience level. Weighted percentages, averages for continuous variables, and 95% confidence intervals (CIs) were calculated. Significant changes over time were noted by lack of CI overlap. The proportion reporting "excellent" health declined significantly from 1999 (38.5%) to 2008 (32.2%). High rates of sleeping problems (20%-27%), back problems (20%-24%), and hearing problems (7%-10%) were reported as...
Objective The objective of this paper was to compare demographics, employment variables, satisfac... more Objective The objective of this paper was to compare demographics, employment variables, satisfaction, and motivation for entering the field of Emergency Medical Services (EMS) between members of under-represented races/ethnicities and members of the majority group. Methods A cohort of nationally certified EMS professionals was followed for 10 years through annual surveys; however, race/ethnicity was only available for 9 years (2000-2008). Descriptive statistics and 95% confidence intervals (CIs) were calculated and significance was determined by lack of CI overlap. Results From 2000 through 2008, the range of proportions of nationally certified EMS professionals by race/ethnicity was as follows: whites: 83.5%-86.0%, Hispanics: 4.2%-5.9%, and African-Americans: 2.5%-4.6%. There were no significant changes in the proportion of minority EMS professionals over the study period. Hispanics and African-Americans combined increased slightly from 6.7% of the population in 2000 to 9.9% in 20...
Objectives The objectives of this study were to assess longitudinal and cross-sectional changes i... more Objectives The objectives of this study were to assess longitudinal and cross-sectional changes in Emergency Medical Technician (EMT)-Basics and Paramedics: (1) demographics, (2) employment characteristics, and (3) initial Emergency Medical Services (EMS) education. Methods These data were collected between 1999 and 2008 employing survey techniques aimed at collecting valid data. A random, stratified sample was utilized to allow results to be generalizable to the nationally certified EMS population. Survey weights that were adjusted for each stratum’s response were estimated. Weighted percentages, averages for continuous variables, and 95% confidence intervals (CIs) were calculated. Significant changes over time were noted when the CIs did not overlap. Results In all 10 years of data collection, the proportion of EMT-Paramedics who were male was greater than the proportion of EMT-Basics who were male. A substantial proportion of respondents performed EMS services for more than one a...
Objective The objective of this study was to assess the public’s experience, expectations, and pe... more Objective The objective of this study was to assess the public’s experience, expectations, and perceptions related to Emergency Medical Services (EMS). Methods A population-based telephone interview of adults in the United States was conducted. The survey instrument consisted of 112 items. Demographic variables including age, race, political beliefs, and household income were collected. Data collection was performed by trained interviewers from Kent State University’s (Kent, Ohio USA)Social Research Laboratory. Descriptive statistics were calculated. Comparative analyses were conducted between those who used EMS at least once in the past five years and those who did not use EMS using χ2 and t tests. Results A total of 2,443 phone calls were made and 1,348 individuals agreed to complete the survey (55.2%). There were 297 individuals who requested to drop out of the survey during the phone interview, leaving a total of 1,051 (43.0%) full responses. Participants ranged in age from 18 t...
This study examines the relationship between certification examination test results and Emergency... more This study examines the relationship between certification examination test results and Emergency Medical Technician (EMT) career success. The sample was drawn from the Longitudinal Emergency Medical Technician Attributes and Demographics Study (LEADS). LEADS participants were matched with National Registry of Emergency Medical Technician (NREMT) certification testing data: (1) exam scores for each attempt until passing the exam, and (2) total number of attempts to pass the exam. Career success was measured both objectively and subjectively.
To enable an existing survey on primary care so that it can be used to assess the healthcare expe... more To enable an existing survey on primary care so that it can be used to assess the healthcare experiences reported by adults living with disabilities, and to evaluate its properties. Mixed-methods study. We first identified content areas for measurement as compared to the items in the existing instrument and then developed new candidate items. Cognitive testing was conducted in English and Spanish. After revisions to the primary care instrument based on the cognitive testing results, the draft-enabled instrument was field-tested by mail with telephone follow-up, in English and Spanish. Consumer focus groups and a technical expert panel identified eight content areas in primary care that are particularly important to maximise function and well-being of people of with disabilities. Cognitive testing also revealed serious problems with several items in the existing survey when answered by or about people with disabilities. Field testing yielded 1086 surveys, of which 40% were completed by a proxy respondent. Learning disabilities were reported by 38% of respondents. Item non-response for revised and new questions was less than 4%. It is feasible to enable a survey of primary care and its administration. Survey administration instructions should be modified to accommodate proxy respondents. The screener item to identify people with mobility impairments on walking a distance should be replaced with walking for 6 min. Adding questions from the American Community Survey about functional ability will allow survey sponsors to identify respondents with various limitations, and to compare their experiences to those of people with no limitations. Careful development and testing of the items with input from interested parties throughout the design and testing stages yielded a survey with good psychometric properties and content validity in multiple languages. Health delivery systems can use the survey data to identify clinical processes needing improvement to provide high quality care for people with disabilities.
Many institutions with the interest and desire to conduct health research fail to obtain the fund... more Many institutions with the interest and desire to conduct health research fail to obtain the funding to do this because of a perceived lack of capacity. To ameliorate this problem and reap the benefits that can only be provided by a diverse cadre of researchers, the United States federal government supported the development of research capacity in geographically diverse institutions and in institutions substantially serving minority racial and ethnic minority populations. The purpose of the present paper is to describe an evaluation of two federally funded programs to build health-care related research capacity and the sustainability of the funded projects. To do so, we examined (a) infrastructure capacitybuilding strategies, (b) project barriers and facilitators, and (c) process and success outcomes, including sustainability. Through this examination, we found significant differences between institutions that had little or no existing research infrastructure (''seed projects'') and those with well-developed research infrastructure (''fertilizer projects''). Although this evaluation effort focuses on federally funded programs, the results hold implications for health services research and non-research organizations. 1. BRIC and MRISP programs In FY 2001, the Agency for Health Research and Quality (AHRQ) initiated two health services research infrastructure development programs-the Minority Research Infrastructure Support Program (MRISP) and the Building Research Infrastructure and Capacity (BRIC) Program. These programs focus on improving the research capacity and competitiveness of institutions that predominantly serve racial/ethnic minorities or are located in geographic areas receiving historically low levels of AHRQ funding. Although somewhat similar in intent, the programs differ in their target institutions and their funding structures. Table 1 provides a comparison of the two programs. MRISP and BRIC grantees generally received 4-5 years of funding; but the MRISP grantees received higher levels of total funding on average ($1.7
A study of magnet schools revealed that they have become a significant part of the nation's effor... more A study of magnet schools revealed that they have become a significant part of the nation's efforts to desegregate schools. Most magnet schools are in urban areas and offer a distinctive curriculum. School districts began employing mag-at schools in the 1970s to help desegregate schools. The federal government has assisted magnet schools with funding. This report is designed to study magnet schools, their role in desegregation, and their impact on educational achievement. Telephone interviews were conducted with educators at 600 school districts nationwide. The study revealed that magnet schools are increasing in number and attracting more students, including minority students and students from outside the school's immediate area. They offer a wide range of distinctive programs. Many magnet schools use money from the federal Magnet Schools Assistance Program to help set up and maintain their programs. This report contains six sections: an introduction, the growth of magnet school programs, implementation of magnet schools and magnet programs, federal support for magnet programs, nonmagnet schools and programs of choice, summary of findings and directions for further research. Appendices A-C include study samples, data, and detailed tables as well as the survey instruments. A glossary is also included. (Contains 15 rezerences.) (JPT)
The objective of this study was to identify the factors that influence adherence to antiretrovira... more The objective of this study was to identify the factors that influence adherence to antiretroviral medication regimens in culturally diverse populations with human immunodeficiency virus/acquired immune deficiency syndrome (HIV/AIDS) related to age, ethnicity, and intravenous drug use. The critical incident technique was used to identify factors determining adherence. Through a series of brief, focused interviews, patients were asked to recall specific incidents that affected their adherence to HIV medications. Patients' responses were grouped into categories using Ethnograph software. Two nurse experts, with 94% agreement, determined the reliability of the category listings. A chi(2) analysis compared the proportion of patients reporting each factor across age, ethnicity, and intravenous drug use categories. The total sample of 52 participants included 46 male outpatients with HIV/AIDS receiving care through a Veteran's Administration Hospital in northern California and 6 health care providers. The interviews yielded a total of 294 incidents. Six major categories were identified, and a taxonomy of critical factors determining highly active antiretroviral therapies (HAART) adherence was developed. The categories included reminders and cues (30%), planning (18%), response to HIV/AIDS (17%), HIV medication characteristics (14%), interactions with others (12%), and patient characteristics (10%). The two largest categories representing patient-related factors accounted for nearly half of the incidents. Patients most influenced by positive support from others included non-Caucasians, those under the age of 50 years, and those with fewer years of education. The taxonomy of adherence behaviors provides important information for developing culturally relevant patient adherence education programs and an essential foundation for developing future studies.
Objectives-Research-derived evidence about the impact of sickle cell disease (SCD) on the lives o... more Objectives-Research-derived evidence about the impact of sickle cell disease (SCD) on the lives of affected adults is lacking. We conducted formative research to provide the basis for a comprehensive description of how SCD affects the lives of adults, with the goal of developing a SCD-specific quality-of-life measurement system. Methods-We conducted a comprehensive literature review of patient-reported outcomes, followed by a series of focus groups and structured individual interviews with adults with SCD (n = 122) and their health care providers (n = 15). Results-We reviewed 473 abstracts and included 86 articles in the final review. The literature revealed broad categories of the impact of SCD and its treatment on the lives of adults-pain; emotional distress; social-role functioning; overall quality-of-life; and quality of care. We classified 1213 incidents from the focus groups and interviews into a taxonomy (16 domains) that met the criterion for saturation and was demonstrated to be reliable for the classification of incidents. The final conceptual model was built upon the taxonomy. Discussion-Our conceptual model was similar to previous models with the effects of pain predominating, interwoven with emotional distress, quality of care, and stigmatization. We found a broad range of emotions reflected, including positive effects of SCD. Items for the quality-of-life measure were derived from the taxonomy and the conceptual model may be of use in generating hypotheses for clinical research and improving understanding for clinicians of the lived experience of adults with SCD.
The Rural Alaska Honors Institute (RAHI) is an intensive, six-week residential high school-to-col... more The Rural Alaska Honors Institute (RAHI) is an intensive, six-week residential high school-to-college bridging program aimed at preparing talented rural Alaska youth for the social and academic challenges of college. Since its inception in 1983, RAHI has demonstrated that it is an effective means of encouraging Alaska Native students to attend college and finish a post-secondary degree. Since 2003, a four credit, college-level, field-intensive, introductory geoscience course has been part of the RAHI curriculum. While it is difficult to evaluate what effect this specific course is having on the long term goal of recruiting more minority geoscientists, short term indicators suggest that the course is very effective in increasing the visibility of geology as a desirable career option amongst college-bound Alaska Native youth.
Summer programs are a common strategy for increasing interest in STEM (Science, Technology, Engin... more Summer programs are a common strategy for increasing interest in STEM (Science, Technology, Engineering, and Math) careers among K-12 students. Here we report four years of results from a two-week program designed to expose Hispanic-American high school students in El Paso, Texas to content and careers in the geosciences. The goal of the program was to grow interest in geoscience among a group of students already interested in STEM careers in order to spur a long-term increase in the number of students entering the geosciences from a demographic group that is now greatly underrepresented in the geoscience workforce. Short-term indicators, in the form of data from pre-and post-participation surveys, show statistically significant positive changes in participants' attitudes towards geoscience. Longer-term indicators, in the form of survey results designed to track participants' college careers, show that 55% are still in the geoscience pipeline, as measured by a choice of a STEM discipline as a college major and 10% are geology majors. This high retention rate compares very favorably with national data that show that in 2001, 32% of all bachelor's degrees were awarded in science and engineering disciplines of which 1% were in geosciences.
NOAA education projects serve individuals across the life span, and exist within a wide range of ... more NOAA education projects serve individuals across the life span, and exist within a wide range of venues including K-12 classrooms, Higher Education Institutions, and Informal Education Environments (e.g., museums, science centers, nature reserves). These projects focus on NOAA science education in scientific fields related to the agency ’ s mission (e.g., Ocean, Atmospheric, Climate, and Environmental Science). The population of scientists within these fields has been noted as having acute lack (of) individuals from minority populations and women. However, women have recently begun to be recruited and retained at higher rates in all educational levels. Still post-graduate and early career attrition remains an issue.
Documented deficiencies in adult sickle cell disease (SCD) care include poor access to knowledgea... more Documented deficiencies in adult sickle cell disease (SCD) care include poor access to knowledgeable providers and inadequate treatment in emergency departments (EDs). The aim of this study was to create patient-reported outcome measures of the quality of ambulatory and ED care for adults with SCD. We developed and pilot tested SCD quality of care questions consistent with Consumer Assessments of Healthcare Providers and Systems surveys. We applied psychometric methods to develop scores and evaluate reliability and validity. The participants of this study were adults with SCD (n = 556)-63% aged 18 to 34 years; 64% female; 64% SCD-SS-at 7 US sites. The measure used was Adult Sickle Cell Quality of Life Measurement information system Quality of Care survey. Most participants (90%) reported at least 1 severe pain episode (pain intensity 7.8 ± 2.3, 0-10 scale) in the past year. Most (81%) chose to manage pain at home rather than the ED, citing negative ED experiences (83%). Using factor analysis, we identified Access, Provider Interaction, and ED Care composites with reliable scores (Cronbach a 0.70-0.83) and construct validity (r = 0.32-0.83 correlations with global care ratings). Compared to general adult Consumer Assessments of Healthcare Providers and Systems scores, adults with SCD had worse care, adjusted for age, education, and general health. Results were consistent with other research reflecting deficiencies in ED care for adults with SCD. The Adult Sickle Cell Quality of Life Measurement Quality of Care measure is a useful self-report measure for documenting and tracking disparities in quality of SCD care.
The SEEP reports are based on analyses of extensive data for the 1999-2000 school year. The SEEP ... more The SEEP reports are based on analyses of extensive data for the 1999-2000 school year. The SEEP includes 23 different surveys to collect data at the state, district, and school levels. Survey respondents included state directors of special education, district directors of special education, district directors of transportation services, school principals, special education teachers and related service providers, regular education teachers, and special education aides. Survey responses were combined with other requested documents and data sets from states, schools, and districts to create databases that represented a sample of approximately 10,000 students with disabilities, more than 5,000 special education teachers and related service providers, approximately 5,000 regular education teachers, more than 1,000 schools, and well over 300 local education agencies. The series of SEEP reports will provide descriptive information on the following issues: • What are we spending on special...
Challenges and Opportunities for Transforming From STEM to STEAM Education, 2020
The 21st century offers many technological advancements resulting from cutting-edge research bein... more The 21st century offers many technological advancements resulting from cutting-edge research being conducted by scientists and engineers at higher education institutions, industries, and national labs. As exciting scientific research is being conducted, the need to address the challenges of inspiring and engaging new learners in science, technology, engineering, and mathematics (STEM) fields continues to grow. The authors present the Science Cartoons (SciToons) program as a model for making science more accessible through the integration of the arts with STEM (STEAM). The SciToons model is based on a Multimedia Learning Theoretical Framework (MLTF), which facilitates co-creation of knowledge and takes into account the contributions of STEM and non-STEM experts. The SciToons model combines this knowledge and expertise with art, animation, high-quality multimedia, and storytelling in the development of science videos that are engaging to a broad audience.
Performance measurement systems (PMSs) are developed and implemented to support the accomplishmen... more Performance measurement systems (PMSs) are developed and implemented to support the accomplishment of objectives of an organization or organizational initiative. PMSs are structured to enable monitoring of performance. This monitoring is accomplished through the identification of areas of concern and success, with the ultimate goals of developing organizational capabilities and enhancing organizational learning. This article reviews the literature on performance measurement and its implementation, and proposes a model to guide the development and implementation of PMSs. The article concludes with a consideration of the broader implications of PMSs and provides recommendations for future research in PMSs with regard to human resource development.
Crowe RP , Bentley MA , Levine R . The Longitudinal Emergency Medical Technician (EMT) Attributes... more Crowe RP , Bentley MA , Levine R . The Longitudinal Emergency Medical Technician (EMT) Attributes and Demographics Study (LEADS): the first 10 years and a look at public perception of Emergency Medical Services (EMS). Prehosp Disaster Med. 2016;31(Suppl. 1):s1-s6.
The objectives were to assess changes in (1) health and physical fitness, (2) the prevalence of s... more The objectives were to assess changes in (1) health and physical fitness, (2) the prevalence of selected health problems, (3) risk behaviors, (4) ambulance safety issues, and (5) the preparedness of Emergency Medical Services (EMS) professionals. In addition, the incidence of patient-initiated violence directed toward EMS personnel and associated factors were assessed. Data were obtained from a sample of nationally certified EMS professionals via annual questionnaires between 1999 and 2008. Stratification was based upon national certification level, self-reported race, and experience level. Weighted percentages, averages for continuous variables, and 95% confidence intervals (CIs) were calculated. Significant changes over time were noted by lack of CI overlap. The proportion reporting "excellent" health declined significantly from 1999 (38.5%) to 2008 (32.2%). High rates of sleeping problems (20%-27%), back problems (20%-24%), and hearing problems (7%-10%) were reported as...
Objective The objective of this paper was to compare demographics, employment variables, satisfac... more Objective The objective of this paper was to compare demographics, employment variables, satisfaction, and motivation for entering the field of Emergency Medical Services (EMS) between members of under-represented races/ethnicities and members of the majority group. Methods A cohort of nationally certified EMS professionals was followed for 10 years through annual surveys; however, race/ethnicity was only available for 9 years (2000-2008). Descriptive statistics and 95% confidence intervals (CIs) were calculated and significance was determined by lack of CI overlap. Results From 2000 through 2008, the range of proportions of nationally certified EMS professionals by race/ethnicity was as follows: whites: 83.5%-86.0%, Hispanics: 4.2%-5.9%, and African-Americans: 2.5%-4.6%. There were no significant changes in the proportion of minority EMS professionals over the study period. Hispanics and African-Americans combined increased slightly from 6.7% of the population in 2000 to 9.9% in 20...
Objectives The objectives of this study were to assess longitudinal and cross-sectional changes i... more Objectives The objectives of this study were to assess longitudinal and cross-sectional changes in Emergency Medical Technician (EMT)-Basics and Paramedics: (1) demographics, (2) employment characteristics, and (3) initial Emergency Medical Services (EMS) education. Methods These data were collected between 1999 and 2008 employing survey techniques aimed at collecting valid data. A random, stratified sample was utilized to allow results to be generalizable to the nationally certified EMS population. Survey weights that were adjusted for each stratum’s response were estimated. Weighted percentages, averages for continuous variables, and 95% confidence intervals (CIs) were calculated. Significant changes over time were noted when the CIs did not overlap. Results In all 10 years of data collection, the proportion of EMT-Paramedics who were male was greater than the proportion of EMT-Basics who were male. A substantial proportion of respondents performed EMS services for more than one a...
Objective The objective of this study was to assess the public’s experience, expectations, and pe... more Objective The objective of this study was to assess the public’s experience, expectations, and perceptions related to Emergency Medical Services (EMS). Methods A population-based telephone interview of adults in the United States was conducted. The survey instrument consisted of 112 items. Demographic variables including age, race, political beliefs, and household income were collected. Data collection was performed by trained interviewers from Kent State University’s (Kent, Ohio USA)Social Research Laboratory. Descriptive statistics were calculated. Comparative analyses were conducted between those who used EMS at least once in the past five years and those who did not use EMS using χ2 and t tests. Results A total of 2,443 phone calls were made and 1,348 individuals agreed to complete the survey (55.2%). There were 297 individuals who requested to drop out of the survey during the phone interview, leaving a total of 1,051 (43.0%) full responses. Participants ranged in age from 18 t...
This study examines the relationship between certification examination test results and Emergency... more This study examines the relationship between certification examination test results and Emergency Medical Technician (EMT) career success. The sample was drawn from the Longitudinal Emergency Medical Technician Attributes and Demographics Study (LEADS). LEADS participants were matched with National Registry of Emergency Medical Technician (NREMT) certification testing data: (1) exam scores for each attempt until passing the exam, and (2) total number of attempts to pass the exam. Career success was measured both objectively and subjectively.
Uploads
Papers by Roger Levine