COURSE: Public Health Program Evaluation
TOPIC: Program Evaluation
ยท Develop an evaluation plan for your PUBLIC HEALTH program of interest, using the following slightly modified CDC template.
ยท The template will walk you all of the required sections for your evaluation plan.
ยท Remember, this assignment is to develop a new evaluation plan,ย notย to share results that have already been evaluated.
ยท Tell us how you will do it, not just what analysis has already been completed.
Instructions
1. Must be 12-15 pages, excluding title and reference pages.
2. Must have 10 or more references (no .com
logs)
3. Make sure to follow the steps and answer the points outlined in the Final Evaluation Plan template (see attached).
4. Failure to follow the template will not get passing mark.
5. Remember to proofread paper for grammar, spelling, clarity, and graduate level academic English.
6. Make sure to cite references using APA citation for in-text citations and bibliography
eference section.
Individual Evaluation Plan Outline
{State Program Name}
Individual Evaluation Plan
{Name of evaluation candidate}
Prepared by:
{Names}
{Affiliation}
{Date}
COH Signature Assignment โ Week 4 Evaluation Plan
COH Signature Assignment โ Week 4 Evaluation Plan
Appendix F Page F-2
Page F-1 Individual Evaluation Plan Outline
1. Introduction
This section provides information about the purpose of the evaluation, and what stakeholders areโโor need to beโโinvolved in the evaluation.
Evaluation Purpose
ยท What does this evaluation strive to achieve?
ยท What is the purpose of this evaluation?
ยท How will findings from the evaluation be used?
ยท How will the findings contribute to CCARE goals?
ยท How does the evaluation align with the four overarching evaluation questions?
ยท How is this plan in alignment with Data Management Plan and the Workplan?
Stakeholders
ยท Who are the stakeholders for this evaluation?
ยท What role did they play in developing this individual evaluation plan?
ยท How do you plan to engage these stakeholders when implementing the individual evaluation plan (e.g., participate in collecting data, help to interpret findings)?
Table F.1. Stakeholder Assessment and Engagement Plan
Stakeholder Name
Stakeholder Category
Interest or Perspective
Role in the Evaluation
How and When to Engage
{Primary, secondary, tertiary}
2. Description of What is Being Evaluated
This section provides detailed information about what you are evaluating. In this section describe the need, context, target population, and stage of development of what is being evaluated. You will also provide information on inputs, activities, outputs, and outcomes and will develop a logic model (graphical depiction) of what you are evaluating.
Need
ยท What is the need for what you are evaluating?
Context
ยท What context/environment exists for what is being evaluated?
(i.e., what environmental factors may affect the performance of what is being evaluated)
ยท How does what is being evaluated align with EXHALE strategies?
Target Population
ยท Who is the target population? (if applicable)
Stage of Development
ยท How long has what is being evaluated been in place?
ยท Is it in the planning or implementation stage?
Resources/Inputs
ยท What resources are available to support what is being evaluated (e.g., staff, money, space, time, partnerships, technology, etc.)?
Activities
ยท What specific activities are undertaken (or planned) to achieve the outcomes?
Outputs
ยท What products (e.g., materials, units of services delivered) are produced by your staff as a result of the activities performed?
Outcomes
ยท What are the programโs intended outcomes (intended outcomes are short-term, intermediate, or long-term)?
ยท How will the intended outcomes contribute to CCARE goals?
ยท What do you ultimately want to change as a result of your activities (long-term outcomes)?
ยท What occurs between your activities and the point at which you see these ultimate outcomes (short-term and intermediate outcomes)?
Table F.2. Program Description Template
Resources/Inputs
Activities
Outputs
Outcomes
Initial
Subsequent
Short-Term/Intermediate
Long-Term
Logic Model
ยท Provide a logic model for what is being evaluated. For asthma interventions, describe how this project is organized under EXHALE strategies.
3. Evaluation Design
This section provides information on how you will design your evaluation. Provide information on evaluation questions, stakeholder information needs emerging from the evaluation, and the evaluation design.
Evaluation Questions
ยท What specific questions do you intend to answer through this evaluation?
Stakeholder Needs
ยท Who will use the evaluation findings?
ยท What do they need to learn from the evaluation?
ยท How will the findings be used?
ยท What do intended users view as credible information?
Evaluation Design
ยท What is the design for this evaluation? (e.g., experimental, pre-post with comparison group, time-series, case study, post-test only)
ยท Why was this design selected?
4. Data Collection
This section provides information on how you will collect/ compile data for your evaluation. Provide information on methods by which you will collect/compile data, and how those methods are related to the evaluation questions you identified.
Data Collection Methods
ยท Will new data be collected/compiled to answer the evaluation questions or will secondary data be used?
ยท How will the data align with relevant performance measures?
ยท What methods will be used to collect or acquire the data?
ยท Will a sample be used? If so, how will the sample be selected?
ยท How will data collection instruments be identified and tested?
ยท How will the quality and utility of existing data be determined?
ยท From whom or from what will data be collected (source of data)?
ยท How will the data be protected?
Data Collection Method โ Evaluation Question Link
ยท How does each data collection method relate to the evaluation questions proposed?
Table F.3: Evaluation Questions and Associated Data Collection Methods
Evaluation Question
Data Collection Method
Source of Data
1.
2.
5. Data Analysis and Interpretation
In this section provide information on what indicators and standards you will use to judge success, how you will analyze your evaluation findings, and how you will interpret and justify your conclusions.
Indicators and Standards
ยท What are some measurable or observable elements that can tell you about the performance of what is being evaluated?
ยท What constitutes โsuccessโ? (i.e., by what standards will you compare your evaluation findings?)
Table F.4. Indicators and Success
Evaluation Question
Criteria or Indicato
Standards
(What Constitutes โSuccessโ?)
1.
2.
Analysis
ยท What method will you use to analyze your data (e.g., descriptive statistics, inferential statistics, content analysis)?
ยท Provide example table shells, if applicable.
Interpretation
ยท Who will you involve in drawing, interpreting, and justifying conclusions?
ยท What are your plans to involve them in this process?
6. Communication and Reporting
This section provides information about how information from the individual evaluation plan process and results will be used and shared.
Use
ยท What actions will be taken to promote evaluation use?
ยท How will evaluation findings be used?
ยท Who is responsible for implementing evaluation recommendations?
Communication
ยท Which evaluation stakeholders will you communicate with and why (e.g., update on status of evaluation, invite to meetings, share interim or final findings)?
ยท What methods (e.g., in-person meetings, emails, written reports, presentations) will you use to communicate with evaluation stakeholders?
ยท Why are these methods appropriate for the specific evaluation stakeholder audience of interest?
7. Evaluation Management
This section provides information about how the individual evaluation will be managed and implemented and who will participate in what capacity. It will also provide a timeline for conducting activities related to this evaluation. You may find that some of the tables suggested here fit better in other sections of the plan. Regardless of how you structure your plan, it is important that you carefully think about each of these implementation steps and who is responsible for doing what by when.
ยท Develop several tables that summarize the major activities included in implementing the evaluation, the persons involved in this implementation, and associated
timelines.
Evaluation Team
ยท Who will implement this evaluation?
Table F.5. Roles and Responsibilities of the Evaluation Team Members
Individual
Title or Role
Responsibilities
Data Collection Management
ยท What data will be collected?
ยท How will the data collection align with collection of relevant performance measures?
ยท What activities are needed to ca
y out the data collection successfully? When should each of these activities be completed?
ยท Who is responsible for conducting each activity?
Table F.6. Data Collection Plan
Evaluation Questions
Data Collection Method
Activities Needed
Person(s) Responsible
Due Date
1.
2.
Data Analysis Management
ยท What data will be analyzed, how, and when?
ยท Who is responsible for conducting the analyses?
Table F.7. Data Analysis Plan
Analysis to Be Performed
Data to Be Analyzed
Person(s) Responsible
Due Date
Communicating and Reporting Management
ยท What are the target audiences for reporting the progress made on the evaluation and/or evaluation findings?
ยท What is the purpose of the communications with this audience?
ยท What is the most appropriate type of communication method to use with this audience, for this purpose?
ยท When will the communication take place?
Table F.8. Communication and Reporting Plan
Audience 1: {insert name of audience}
Applicable?
Purpose of Communication
Possible Formats
Timing/Dates
Notes
Yes/No
Include in decision making about evaluation design/activities
Inform about specific upcoming evaluation activities
Keep informed about progress of the evaluation
Present initial/interim findings
Present complete/final findings
Document the evaluation and its findings
Adapted from Russ-Eft and Preskill, 2001, pp. 354โ357.
Timeline
ยท When will planning and administrative tasks occur?
ยท When will any pilot testing occur?
ยท When will formal data collection and analysis tasks occur?
ยท When will information dissemination tasks occur?
ยท Upon mapping all of the above on a single timeline, are there any foreseeable bottlenecks or sequencing issues?
Evaluation Budget
ยท What is the cost for this evaluation?
ยท Where will the monetary resources come from to support the evaluation? Are any in-kind, volunteer, or partner resources being contributed?
POST EVALUATION
5. Action Planning
Evaluation does not stop at disseminating the findings. Revisit the purpose of the evaluation with stakeholders and document action steps to ca
y the findings forward, whether they be to improve the program, make critical decisions, expand a program, support funding, or ensure sustainability.
ACTION PLAN TEMPLATE.
Below is an example of a plan to