Use of Evaluation Findings

EXT 505 · Capacity Development · Block VI · Theory Topic 29

Not all "use" looks the same — and knowing the difference changes how you evaluate

Introduction

Topic 28's third stage — "Using the Evaluation" — covered the procedural mechanics: considering recommendations, drawing up an implementation plan, disseminating findings. This topic goes one level deeper, asking a more conceptual question: when evaluation findings genuinely get "used," what does that actually look like? The answer, drawn from one of the most influential frameworks in evaluation studies, is that use takes several distinct forms — and conflating them leads to unfair judgements about whether an evaluation "succeeded."

🎯 Learning Outcomes

• Explain Carol Weiss's three types of evaluation use: instrumental, conceptual, and symbolic/political.
• Explain Michael Quinn Patton's addition of "process use" as a fourth type.
• Recognise why an evaluation can be genuinely useful even without directly triggering an immediate decision.
• Identify symbolic use honestly, as a documented empirical reality rather than simply evaluation "failure."

🔍 Why This Matters

Carol Weiss's research on evaluation use found that policymakers rarely make a single, identifiable decision directly traceable to one evaluation report; more often, evaluation findings accumulate gradually alongside other information, subtly shaping how people understand a problem over time — a phenomenon she termed "enlightenment," which is very different from the simple picture of "evaluation report leads directly to decision."

1. Weiss's Three Types of Evaluation Use

Instrumental Use

Findings directly inform a specific, identifiable decision or action — for example, discontinuing a training method that evaluation showed to be ineffective, or revising next season's curriculum based on Topic 27's Results-level findings.

Conceptual Use

Findings shape how people understand a programme or problem more deeply, without necessarily triggering any immediate, identifiable action — contributing to the kind of "lessons learned" that Topic 28's evaluation report format explicitly makes space for.

Symbolic (Political) Use

Findings are marshalled to justify, legitimise, or defend a position or decision that was, in effect, already made — using evaluation as supporting evidence for an existing stance rather than as a genuinely open inquiry.

2. Patton's Addition: Process Use

Michael Quinn Patton (1997), building on Weiss's typology, identified a fourth type distinct from the findings themselves: process use — where simply going through the act of being evaluated changes how people think or behave, independent of what the final findings actually say. A KVK's Subject Matter Specialists reflecting carefully on their own training objectives while helping design an evaluation's questions may already shift their practice before a single piece of data is collected.

Type of Use	What Triggers It	When It's Recognisable
Instrumental	The findings themselves	A specific, traceable decision or action follows
Conceptual	The findings themselves	Understanding shifts, but no single action is directly traceable
Symbolic/Political	The findings themselves	Findings are cited to support a pre-existing position
Process	Participating in the evaluation itself	Changes appear before, or independent of, the findings being released

⚠️ Symbolic Use Is Not Automatically Dishonest

It is tempting to treat symbolic use as evaluation gone wrong — findings twisted to serve a predetermined agenda. Weiss's own research treats it more evenhandedly: symbolic use is a well-documented, common empirical pattern, not necessarily evidence of bad faith. An organisation genuinely committed to a programme may cite supportive evaluation findings to defend continued funding, which is a legitimate use of evidence even though it did not originate the decision.

3. Why This Matters for How You Design an Evaluation

If Topic 28's Terms of Reference clarifies upfront which kind of use is actually intended, the evaluation can be designed accordingly: an evaluation meant to drive instrumental use needs clear, decision-relevant recommendations delivered on a timeline that matches an actual decision point; one aimed primarily at conceptual use can afford to be more exploratory and reflective; and recognising the likelihood of symbolic use should push evaluators toward extra rigour, since findings may end up cited well beyond their original, narrower purpose.

🌾 Extension Angle

A KVK's mid-season evaluation of a farmer training programme might produce instrumental use (immediately dropping an underperforming training method), conceptual use (Subject Matter Specialists gaining a better general sense of which topics farmers find hardest to grasp, informing programming well beyond this one programme), and process use (the act of interviewing farmers for the evaluation itself prompting SMS staff to reconsider their own assumptions about farmer needs) — all from the very same evaluation exercise.

🇮🇳 Indian Institutional Context

ATMA's evaluation and reporting cycle (Topics 22 and 28) plausibly generates all four types of use at once: instrumental use when a district reallocates its budget toward better-performing activities; conceptual use as district officials build a broader understanding of farmer needs over successive reporting cycles; and symbolic use when positive evaluation findings are cited to justify continued state or central funding for the ATMA scheme itself.

🔄 Beyond Agriculture

Corporate training evaluation is a common site of symbolic use: positive Kirkpatrick-level findings (Topic 27) are frequently cited in budget review meetings to defend an L&D department's continued funding, regardless of whether those specific findings were what originally motivated the programme's design — a corporate parallel to the ATMA example above.

Frequently Asked Questions

If an evaluation doesn't lead to a clear decision, did it fail? +

Not necessarily. Conceptual use — shaping how people understand a programme or problem without triggering one traceable decision — is a legitimate, well-documented form of evaluation use in its own right, not a lesser or failed version of instrumental use.

How is process use different from the other three types? +

The other three types (instrumental, conceptual, symbolic) are triggered by the evaluation's findings once they're available. Process use is triggered by the act of participating in the evaluation itself — reflecting on objectives, being interviewed, helping design questions — and can occur even before findings are finalised.

Is it wrong for an organisation to use evaluation findings symbolically? +

Not inherently — Section 2's misconception box makes this point directly. Using genuine, accurate findings to support an existing, well-founded position is a legitimate use of evidence. It becomes problematic only when findings are selectively distorted or misrepresented to support a position the evidence doesn't actually back.

📚 References

• Weiss, C. H. (1998). Evaluation: Methods for Studying Programs and Policies (2nd ed.). Upper Saddle River, NJ: Prentice Hall.
• Weiss, C. H., & Bucuvalas, M. J. (1980). Social Science Research and Decision-Making. New York: Columbia University Press. [Origin of the "enlightenment" function of evaluation.]
• Patton, M. Q. (1997). Utilization-Focused Evaluation (3rd ed.). Thousand Oaks, CA: Sage Publications. [Source of "process use" as a distinct fourth type.]
• United Nations Office on Drugs and Crime (UNODC). Evaluation Policy and Guidelines. Vienna: UNODC. [Cross-referenced — see Topic 28.]

EXT 505 — Capacity Development · M.Sc. Extension Education, PAU Ludhiana
Instructor: Dr. Davinder Singh · Theory Topic 29 of 35 · Previous: Topic 28 (Process of Evaluation) · Next: Topic 30 (Statistical Tools for Evaluation)