May 15, 2008 Sustainability and Evaluation - DMHA, Indianapolis
SPF-SIG Training: Videos and Powerpoints (September 25, 2007)
The
Guiding Principles for Evaluators serve as the cornerstone of good evaluation practice providing guidelines for sound, ethical practice.
Offers short-term professional development courses for practicing evaluators.
Prevention courses that are offered free to the public. Some courses are meant for professionals and have continuing education credits available. Other courses are designed to provide helpful information to members of the general public interested in prevention topics.
This document is a "how to" guide for planning and implementing evaluation activities. An accompanying narrated presentation and handout may be used for training coalition members.
In addition to onsite and telephone consultations, the IPRC evaluation team can provide video consultations via free video conferencing. Requirements include free downloaded software, a computer camera (provided in-kind to each cohort 1 community), and a high-speed internet connection. Set-up instructions are available.
The IPRC evaluation team will assist in collection of data for state and cross-site evaluations. This includes facilitation of the completion of the Community Level Instrument and collection of National Outcome Measures.
Instructions on how to navigate, view files, upload files, and access documents on dotProject.
Community Level Instrument Part I
Required cross-site evaluation document to monitor SPF process. Due to State evaluators (Dr. Eric Wright, www.healthpolicy.iupui.edu/SPFSIG_EVAL.htm) in January 2008.
Community Level Instrument Part II
Required cross-site evaluation document to monitor program implementation. Due to State evaluators (Dr. Eric Wright, www.healthpolicy.iupui.edu/SPFSIG_EVAL.htm) every six months beginning in year 2.
Summary of the CLI Part I that provides supplementary information to guide grantees through completion of the CLI. The aim of this document is to simplify the question format, describe question content, and provide guidance on responses to specific questions.
Companion document that provides useful definitions for all underlined words in the CLI document.
A manual to assist in completion of the web-based CLI.
A simple description of the purpose and importance of process evaluation.
Guidelines for balancing fidelity and adaptation and the importance of fidelity to process evaluation.
A sample document that provides major sections of an evaluation plan with descriptions of content of each section.
Another example of an evaluation plan that corresponds to the logic model.
Tools for developing an evaluation plan.
A useful source for determining realistic objectives for interventions.
Definitions, steps, checklists, and surveys for planning an evaluation.
Measures and Data Analysis
Measures and Data Analysis Section
National Outcome Measures (NOMs) Online Survey – Minimum required data to be collected at the local level. The survey is available in English (Adult / Youth) and Spanish (Coming soon). Surveys may be printed from the online source, distributed in hardcopy, and entered manually. Contact the IPRC to receive your results.
An optional survey that may be administered to workgroup members to evaluate satisfaction of the workgroup’s activities. The survey is available in WORD format with an accompanying
scoring guide for entry into SPSS or Excel. They survey is also available via
Survey Monkey for online administration. Contact the IPRC Evaluation Team to receive a report of your Survey Monkey responses.
Some communities may want to add questions to the NOMs or satisfaction surveys. These tip sheets provide advice for writing survey questions and gaining access to young adults for data collection purposes.
Excel Data Documents
Pre-formatted documents in Excel for entering
NOMs and Satisfaction Survey data. Also may be used to maintain data and perform basic operations or for uploading into SPSS.
Resource for performing basic statistical operations (e.g., frequencies, averages, percentages) using Excel.
A document designed by WESTAT to measure fidelity of each SPF step.
A survey available in
WORD and
Survey Monkey formats for evaluating trainings.
Focus Groups
Conducting Successful Focus Groups Tip Sheet – Summarizes The Wilder Nonprofit Field Guide to Conducting Successful Focus Groups highlighting special considerations for conducting focus groups with the 18-25 year old target population.
Surveys
Tips for Administering Surveys - Provides general verbal instructions for completing surveys to assure that respondents understand that participation is voluntary and their responses will be kept confidential. Also included are important points to remember such as how to assist respondents who have difficulty reading.
Useful website describing efforts to promote program evaluation in public health and highlights of a framework for program evaluation.
Useful resources for planning and implementing program evaluations and for developing and collecting program performance measures.
This document is a "how to" guide for planning and implementing evaluation activities.