Consulting Services

Evaluation

Menu of Services

Trainings | Staffing | Communication | Proccess Evaluation | Evaluation Plan | Measures and Data Analysis | Data Collection Methods | Reports

Evaluation Toolbox

Category	Deliverables
Trainings	SPF-SIG Training: Videos and Powerpoints (September 25, 2007) Cross-site Evaluation: Bob Levy Cross Site Video (17 min 49 sec) Cross Site Powerpoint State Evaluation: Harold Kooreman State Evaluation Video (14 min 20 sec) State Evaluation Powerpoint Local Evaluation: Jeanie Alter Local Evaluation Video (21 min 37 sec) Local Evaluation Powerpoint Introduction to Program Evaluation for Public Health Programs: A Self-Study Guide - This document is a "how to" guide for planning and implementing evaluation activities.
Staffing	Staffing – The IPRC evaluation team is managed by Dr. Jeanie Alter and consists of two evaluators – Dr. Randy Zaffuto (North sites) and Marcia Dias (South sites). Each community will have one field evaluator assigned to them to provide monthly onsite consultation and evaluation services. The role of the project manager is to oversee and coordinate evaluation services provided by field evaluators and assure that required data are being collected at the community level for the state and cross-site evaluations. The project manager provides monthly telephone consultations and is available for onsite consultations upon request.
Communication	Video Conferencing - In addition to onsite and telephone consultations, the IPRC evaluation team can provide video consultations via free video conferencing. Requirements include free downloaded software, a computer camera, and a high-speed internet connection. State and Cross-Site Evaluation Protocol–The IPRC evaluation team will assist in collection of data for state and cross-site evaluations. This includes facilitation of the completion of the Community Level Instrument and collection of National Outcome Measures. Website – Information, documents and resources are available via the IPRC website. Monthly updates are sent highlighting updates to this website. IPRC/DMHA Coordination – The IPRC evaluation team communicates topics of discussion at monthly onsite consultations with DMHA to prevent duplication of effort and assure consistency of message.
Process Evaluation	Monthly Benchmark Report – Required DMHA document to monitor progress toward benchmarks. Due to DMHA (North~ Marcia French marcia.french@fssa.in.gov, South~ Kim Manlove kim.manlove@fssa.in.gov) and IPRC (Mari Kermit-Canfield mkermitc@indiana.edu) by the 10th of each month. Community Level Instrument Part I DOC/PDF – Required cross-site evaluation document to monitor SPF process. Due to State evaluators (Dr. Eric Wright, www.healthpolicy.iupui.edu/SPFSIG_EVAL.htm) in January 2008. Community Level Instrument Part II DOC/PDF – Required cross-site evaluation document to monitor program implementation. Due to State evaluators (Dr. Eric Wright, www.healthpolicy.iupui.edu/SPFSIG_EVAL.htm) every six months beginning in year 2. Guidance for Completing the CLI Part I -Summary of the CLI Part I that provides supplementary information to guide grantees through completion of the CLI. The aim of this document is to simplify the question format, describe question content, and provide guidance on responses to specific questions. CLI Parts I and II Definitions - Companion document that provides useful definitions for all underlined words in the CLI document. CLI Training Manual - A manual to assist in completion of the web-based CLI. Keeping it Simple...Process Evaluation - A simple description of the purpose and importance of process evaluation.
Evaluation Plan	Sample Evaluation Plan – A sample document that provides major sections of an evaluation plan with descriptions of content of each section. Sample Evaluation Plan 2- Another example of an evaluation plan that corresponds to the logic model. CADCA Evaluation Website - Tools for developing an evaluation plan. Healthy People 2010 Substance Abuse Objectives - A useful source for determining realistic objectives for interventions. Year 1 Deliverables - IPRC Evaluation services in SPF-SIG Year 1 provided support by ensuring that state and cross-site evaluation data were collected, monitoring progress through SPF steps, assisting with the development of an evaluation plan, promoting the value and importance of evaluation, and generating reports related to SPF activities. Year 2 Letter of Agreement - The IPRC will provide continued assistance with process evaluation of the SPF process and implemented programs, policies, and/or practices in Year 2 and beyond.
Measures and Data Analysis	National Outcome Measures (NOMs) Survey – Minimum required data to be collected at the local level. The survey is available in English (WORD / Survey Monkey) or Spanish (WORD / SurveyMonkey). A scoring key and data template are available for data entry. Satisfaction Survey – An optional survey that may be administered to workgroup members to evaluate satisfaction of the workgroup’s activities. The survey is available in WORD format with an accompanying scoring guide for entry into SPSS or Excel. They survey is also available via Survey Monkey for online administration. Contact the IPRC Evaluation Team to receive a report of your Survey Monkey responses. The Ten Commandments of Question Writing and Reaching Youth and Young Adults Tip Sheets – Some communities may want to add questions to the NOMs or satisfaction surveys. These tip sheets provide advice for writing survey questions and gaining access to young adults for data collection purposes. SPSS Access – Grantees can access SPSS statistical analysis software and analyze NOMs and satisfaction survey data using provided syntax files. NOTE Proccess for access has changed. Please see instructions for further information. Excel Data Documents – Pre-formatted documents in Excel for entering NOMs and Satisfaction Survey data. Also may be used to maintain data and perform basic operations or for uploading into SPSS. Excel Statistics – Resource for performing basic statistical operations (e.g., frequencies, averages, percentages) using Excel. Measurements in Prevention: A Manual on Selecting and Using Instruments to Evaluate Prevention Programs – Provided to grantees courtesy of the IPRC Guide to Risk Factor and Outcome Instruments - Provided to grantees courtesy of the IPRC Fidelity Instruments - A document designed by WESTAT to measure fidelity of each SPF step.
Data Collection Methods	Focus Groups: Conducting Successful Focus Groups Tip Sheet – Summarizes The Wilder Nonprofit Field Guide to Conducting Successful Focus Groups highlighting special considerations for conducting focus groups with the 18-25 year old target population. Surveys: Tips for Administering Surveys - Provides general verbal instructions for completing surveys to assure that respondents understand that participation is voluntary and their responses will be kept confidential. Also included are important points to remember such as how to assist respondents who have difficulty reading.
Reports	Mid-year and End-of-Year Reports – Reports provided directly to each grantee highlighting the successes and challenges of SPF activities. Service Proposals – Proposed IPRC services including an evaluation plan for years 2-4 and a cost breakdown of services provided in year 1. Year 1 Deliverables - IPRC Evaluation services in SPF-SIG Year 1 provided support by ensuring that state and cross-site evaluation data were collected, monitoring progress through SPF steps, assisting with the development of an evaluation plan, promoting the value and importance of evaluation, and generating reports related to SPF activities. Year 2 Letter of Agreement - The IPRC will provide continued assistance with process evaluation of the SPF process and implemented programs, policies, and/or practices in Year 2 and beyond.

To send suggestions, concerns or feedback to the IPRC Evaluation Team, please click submit.