The Xavier University RCMI evaluation process is carried out by the independent external evaluator, Dr. Rose Shaw. Dr. Shaw is a professional evaluator who has externally evaluated over 75 projects in 17 (EPSCoR and non-EPSCoR) states with extensive expertise assessing and evaluating demonstrable impacts and achievements both qualitatively and quantitatively. She has a Ph.D. in Applied Statistics and an M.S. in Mathematics. Her interest in math and science was solidified during an undergraduate NSF research experience in which she studied effects of hypervitaminosis A.
Dr. Shaw has evaluated a variety of implementation, development and research projects funded by the NIH, NSF, USDA, NASA and USDE. These are some of the topics of projects she has evaluated: social ecological systems, climate change, modeling and simulation, ecology, reading, learning progressions, plant pathology, bioenergy, visualization, workforce development, English as a second language, systems change, cancer, astronomy, juvenile judicial systems, criminal justice, leadership, health curriculum, logical thinking, distance learning, and bionanotechnology. Her work has also conducted job task analyses and systems efficiency studies as well as consulting in statistics, psychometrics and research design.
The Xavier University evaluation assesses how the RCMI program is performing in terms of achieving its goals. The Administrative Core systematically utilizes evaluation processes and findings in its ongoing strategic planning to improve how university-wide research programs and planning processes are implemented and refined. Each key activity of the RCMI program is evaluated both formatively (process) and summatively (outcome) using qualitative and quantitative data. The Xavier University RCMI evaluation questions are:
- How effectively has Xavier’s RCMI program administration been in developing and enhancing sustainable biomedical research infrastructure through pilot projects, seed grants and professional development activities?
- How successful has Xavier’s RCMI been in publishing and presenting scholarly work, as well as in obtaining competitive extramural support for sustainable cancer research that includes intra- and inter-Xavier research collaborations and in translating research to the benefit of the public?
- How has sharing Xavier’s RCMI core laboratory facilities, resources, expertise, data and technologies within the university and with its external partners enhanced and promoted biomedical research?
The evaluation program has established performance measures in the form of metrics and milestones for each activity and core lab with detailed timelines for achieving the milestones.
We utilize five evaluation mechanisms: (1) the Xavier strategic plan and the RCMI evaluation plan, (2) staff time dedicated to data collection, coordinating and reporting, (3) an Internal Advisory Committee of local experts, (4) an External Advisory Committee of independent experts to provide candid guidance and feedback, (5) an external independent evaluator and (6) a feedback loop to ensure appropriate and timely management responses. Evaluation is fully integrated into the project.