Dancing Your Way through Program Evaluation with the

Dancing Your Way through Program Evaluation with the

Dancing Your Way through Program Evaluation with the CDC 6-Step Evaluation Framework MaryCatherine Jones, MPH, Public Health Consultant, CVH Team Zarina Fershteyn, MPH, Director of Program Evaluation, NACDD Learning Objectives To identify the steps associated with the CDC

Framework for Evaluation To discuss the intersection between logic models and the framework To engage peers in discussing common roadblocks and solutions in evaluating chronic disease and health promotion programs Course Overview

What we will accomplish Getting Started with Evaluation Common types of evaluation in public health Implementation Effectiveness Efficiency Cost Effectiveness

Attribution Others What is the value in evaluation? What is the CDC 6 Step Evaluation Framework?

Your Evaluation Team An evaluation team ensures that you have a variety of skills and perspectives that will make your evaluation useable and ensure that your results drive action. Evaluation team members can include: Program staff Partners Funders

Policymakers Community members Subject matter experts Others Your Lead Evaluator Able to work with a variety of stakeholders Able to balance potentially competing needs of

stakeholders Able to prioritize and deliver in the face of limited resources Able to innovate Why Are Stakeholders Important? Stakeholder Roles

Evaluation Team (planning and implementing the evaluation) Dissemination of evaluation findings Contributing data Analyzing and drawing conclusions from data Considerations for Stakeholder Engagement

Standard Utility Feasibility Propriety Accuracy Questions

Who will use these results? How much time and effort can we expect from the stakeholders? How much time/effort do we have to engage them? Which stakeholders can help our evaluation to be ethical? How broadly do we need to engage stakeholders to paint an accurate picture of

the program? Describing the Program Considerations for Your Description

Need Target Population

Outcomes Activities Outputs Resources/Inputs Relationship of activities and outcomes Stage of development Context/environmental factors

Sample Logic Model Format Investment Inputs Activities Outcomes Outputs

Short-Term Intermediate Term Long Term

Considerations for Your Program Description Standard Questions Utility

Is the level of detail appropriate for the intended use? Are the activities and at least some of the outcomes within the programs control? Does the description include enough detail to examine strengths and weaknesses of the program?

Is the program description comprehensive? Are likely influences on the program identified? Feasibility Propriety Accuracy

Case Study and Small Group Activity ? Group Discussion Focusing the Evaluation Design

Types of Evaluation Implementation/Process Effectiveness/Outcome Focusing the Evaluation Design Considerations for Design WHO HOW

WHAT (we can reasonably evaluate) Big Details for Your Evaluation Plan Availability of data

Timing of data collection Data analysis (who, when, how) Types of conclusions we can make Case Study (Continued) ?

Overcoming Trouble Spots UmmSorry, this made sense until I started explaining it. Summary

Worksheets adapted from U.S. Department of Health and Human Services Centers for Disease Control and Prevention. Office of the Director, Office of Strategy and Innovation. Introduction to program evaluation for public health programs: A self-study guide. Atlanta, GA: Centers for Disease Control and Prevention, 2011. Visit the self-study guide for worksheets related to the other Steps! Our Challenge to You

Our contact information MaryCatherine Jones, [email protected] Zarina Fershteyn, [email protected]

Recently Viewed Presentations