When you hear “Evaluation”, what immediately comes to mind? For many, it’s an Impact Evaluation. This is the evaluation method that is used for strategic decision making about the ultimate worth and value of a project, program or policy.
Impact Evaluation is often asked for by funders and accountability partners to determine whether a program has made the intended effect it set out to make, and whether to continue, modify or discontinue it.
Despite its popularity, Impact Evaluations do not often align with the actual needs of those seeking it. Worse yet, if done before a program is ready, the cost and efforts of an Impact Evaluation will result in findings that are a) incorrect and/or b) not useful.
For this reason, among many others, it’s essential to understand that Evaluation looks different at each stage of the program.
The role of Evaluation varies and holds unique importance at different stages of a program.
Program Evaluation is the strategic tool that helps us make sense of projects, policies, interventions, and programs alike, through systematic collection, analysis and interpretation of information to answer essential questions. Both the questions and tools look different according to the stage of the program/policy/intervention.
There are three overarching evaluation approaches I’m going to cover here: Developmental, Formative, and Summative.
Developmental Evaluation – Nurturing Innovation
Developmental Evaluation is like the innovation greenhouse, nurturing ideas in complex and ever-changing landscapes.
It can be applied when planning a new program or implementing innovative interventions within complex, dynamic environments.
It’s a hands-on experience, with evaluators becoming part of the project team, crafting a flexible evaluation plan as the innovation unfolds. This approach helps uncover unintended consequences and gain valuable program insights that are immediately fed back to the team.
Formative Evaluation – Shaping Success
As the program is being implemented, Formative Evaluation is your strategic compass, steering you to what’s working well, what needs refining, and ideas for improvement.
This approach is intended to enhance processes and program delivery to ensure the intended outcomes CAN be fully realized.
I’ve recommended that organizations revisit Formative Evaluation even in the later stages of their programming for a fresh perspective – it’s like giving your program a second look for hidden gems.
Heads Up: Don’t skip Formative Evaluation for the allure of Impact Evaluation – it’s your secret weapon for optimizing programs before the grand finale.
Summative Evaluation – Assessing Merit and Impact
Summative Evaluation, the big Outcome or Impact Assessment, takes center stage in the late stages of a program or after a program concludes. Outcome evaluation answers questions like “How successful were we in meeting our long-term outcomes?” and impact evaluation answers questions like, “How did the intervention impact the community?”
Summative Evaluation influences critical decisions: whether to continue, modify, or discontinue a program.
Because it has such an influential role, Summative (Outcome/Impact) Evaluation should only be done after confirming that a program functions effectively for its intended audience(s) and adequately meets their needs. This can be helpfully realized through Formative Evaluation methods.
In sum, Program Evaluation is not just a checkbox exercise; it’s your companion in continuous improvement.
It doesn’t start at showcasing impact, but informs innovation, program improvement and guiding success at every turn of your program.
