| Conceptual Model of Comprehensive Research Metrics for Improved Human Health and Environment Jill A. Engel-Cox,1 Bennett Van Houten,2 Jerry Phelps,2 and Shyanika W. Rose3 1Battelle Memorial Institute, Arlington, Virginia, USA; 2Division of Extramural Research and Training, National Institute of Environmental Health Sciences, National Institutes of Health, Department of Health and Human Services, Research Triangle Park, North Carolina, USA; 3Battelle Memorial Institute, Durham, North Carolina, USA Abstract
Objective: Federal, state, and private research agencies and organizations have faced increasing administrative and public demand for performance measurement. Historically, performance measurement predominantly consisted of near-term outputs measured through bibliometrics. The recent focus is on accountability for investment based on long-term outcomes. Developing measurable outcome-based metrics for research programs has been particularly challenging, because of difficulty linking research results to spatially and temporally distant outcomes. Our objective in this review is to build a logic model and associated metrics through which to measure the contribution of environmental health research programs to improvements in human health, the environment, and the economy. Data sources: We used expert input and literature research on research impact assessment. Data extraction: With these sources, we developed a logic model that defines the components and linkages between extramural environmental health research grant programs and the outputs and outcomes related to health and social welfare, environmental quality and sustainability, economics, and quality of life. Data synthesis: The logic model focuses on the environmental health research portfolio of the National Institute of Environmental Health Sciences (NIEHS) Division of Extramural Research and Training. The model delineates pathways for contributions by five types of institutional partners in the research process: NIEHS, other government (federal, state, and local) agencies, grantee institutions, business and industry, and community partners. Conclusions: The model is being applied to specific NIEHS research applications and the broader research community. We briefly discuss two examples and discuss the strengths and limits of outcome-based evaluation of research programs. Key words: conceptual model development, environmental health research, metrics development, performance measurement, research impact evaluation. Environ Health Perspect 116: 583–592 (2008) . doi:10.1289/ehp.10925 available via http://dx.doi.org/ [Online 12 February 2008]
Address correspondence to J.A. Engel-Cox, Battelle Memorial Institute, 2101 Wilson Blvd., Suite 800, Arlington, VA 22201 USA. Telephone: 703-875-2144. Fax: 703-527-5640. E-mail: engelcoxj@battelle.org We acknowledge A. Powers for her extensive work at the beginning of this project. We gratefully acknowledge the assistance of T. Bernichon, M. Sill, K. Versendaal, and M. Wooton, all of Battelle. This work was conducted under contract HHSP23320045006XI, Task Order HHSP233000015T, "Program Assessments and Evaluations for NIEHS." The authors declare they have no competing financial interests. Received 26 September 2007 ; accepted 11 February 2008.
The full version of this article is available for free in HTML or PDF formats. |
