The Importance of Policy Evaluation in Public Administration

Every year, governments roll out schemes worth crores of rupees promising transformation – better roads, healthier children, cleaner air, stronger farms. But how do we actually know whether these promises are being kept? How do we separate a policy that genuinely changes lives from one that merely looks good on paper? This is where policy evaluation steps in as one of the most underrated yet powerful tools in public administration. It is the reality check that keeps governance honest, evidence-based, and responsive to the people it serves.

What policy evaluation really means 🔗

Policy evaluation is the structured, evidence-based assessment of whether a public intervention is achieving what it set out to achieve. The OECD defines it as a structured and evidence-based assessment of the design, implementation, or results of a planned, ongoing, or completed public intervention. In simpler terms, it asks a deceptively difficult question: did this policy work, and for whom?

A useful way to understand evaluation is through Peter Drucker’s famous distinction – effectiveness analysis indicates whether we are doing the right thing, while efficiency reveals whether we are doing it right. Policy evaluation sits at the intersection of both questions.

How evaluation differs from monitoring 🔗

People often use monitoring and evaluation interchangeably, but they are distinct. Monitoring is a continuous, process-focused activity – tracking whether funds are being spent, whether schools are being built, whether vaccines are reaching villages on schedule. Evaluation, on the other hand, is about results and impact. Monitoring implementation of policies aims at checking the progress of planned outputs, while evaluating impact assesses the larger outcomes, goals, and results of the policy.

Think of it this way: monitoring checks whether a midday meal is being served in every school every day. Evaluation asks whether the midday meal scheme has actually reduced malnutrition, improved school attendance, and raised learning outcomes over time. One tracks the wheels turning; the other asks whether the journey is worth making.

Why policy evaluation matters so much 🔗

Public money is finite, and citizens’ patience is even more so. Every rupee spent on one scheme is a rupee not spent on another. Evaluation ensures that this trade-off is made with eyes wide open. Monitoring and evaluation help ensure that decisions are rooted in trustworthy evidence and deliver desired outcomes, and they are a critical element of good governance because they promote public accountability, transparency, and citizens’ trust in government.

Without evaluation, policies drift. Officials continue schemes out of habit, political patronage, or bureaucratic inertia. Flawed programmes get expanded. Successful ones get starved of resources. Evaluation breaks this cycle by forcing a disciplined, evidence-based conversation about what to continue, what to fix, and what to scrap.

Evaluation as a feedback loop 🔗

Evaluation is not the terminal station of the policy cycle – it is the start of the next journey. Findings from evaluation feed back into agenda setting, policy formulation, and redesign. A well-conducted evaluation of the Public Distribution System, for example, can reshape how ration shops are digitised, how entitlements are targeted, and how leakage is curbed in the next round of reforms.

The core criteria of policy evaluation 🔗

Evaluation is not a single measurement but a multi-lens assessment. The most widely recognised framework comes from the OECD Development Assistance Committee, which lays out six evaluation criteria – relevance, coherence, effectiveness, efficiency, impact, and sustainability. In the Indian context, NITI Aayog’s Development Monitoring and Evaluation Office has adapted this into the RCEESI+E framework – Relevance, Coherence, Efficiency, Effectiveness, Sustainability, Impact, and Equity. Textbook treatments of policy evaluation usually group these into a slightly different but overlapping set of criteria. Let’s unpack the most important ones.

Effectiveness 🔗

Effectiveness asks the simplest-sounding but hardest-to-answer question: did the policy achieve its stated objectives? If Swachh Bharat aimed to end open defecation, did it? If Ayushman Bharat promised to reduce catastrophic health expenditure for poor families, did household data show it happening? The gold standard for assessing effectiveness is the randomised controlled trial, where participants are exposed to the policy randomly and their outcomes are compared to those of a control group, though quasi-experimental methods are often more feasible for large-scale public policies.

Efficiency 🔗

Efficiency examines the relationship between inputs and outputs – are we getting maximum value for the resources deployed? A scheme may be effective in reaching beneficiaries but consume disproportionate administrative costs. Conversely, a programme may be cheap to run but achieve very little. Efficiency evaluation commonly uses cost-benefit and cost-effectiveness analysis to compare alternative ways of achieving the same goal.

Adequacy 🔗

Adequacy is subtle but crucial. A policy may be efficient and effective within its design, yet still be inadequate for the problem it was meant to solve. A scholarship covering 2,000 students when 2 lakh deserve support is a textbook example. The policy may work flawlessly for those it reaches, but the scale is simply too small to make a dent in the underlying issue.

Equity 🔗

Equity asks who benefits and who bears the costs. A policy that lifts average outcomes while leaving marginalised groups behind fails the equity test. Within public administration, scholars like George Frederickson have argued that equity should be given a greater value and be at least equal to the classic pillars of economy and efficiency. In a country as diverse and unequal as ours, equity is not a nice-to-have – it is a defining test of legitimacy.

Responsiveness 🔗

Responsiveness examines whether a policy actually matches what citizens need and want. A beautifully designed skill development programme is meaningless if it trains people for jobs that don’t exist in their region. Responsiveness evaluation often relies on citizen feedback, surveys, and participatory assessments to capture perceptions the official data misses.

Appropriateness 🔗

Appropriateness is the deepest, most philosophical criterion. It questions whether the policy goals themselves were worth pursuing in the first place. A policy might be effective, efficient, equitable, and responsive – and still be pursuing the wrong objective. Appropriateness forces us to look not just at the means but at the ends of public action.

The institutional landscape of evaluation in India 🔗

Evaluation in this country has evolved considerably over the decades. During the Planning Commission era, the Programme Evaluation Organisation conducted periodic assessments of flagship schemes. Today, the Development Monitoring and Evaluation Office (DMEO) under NITI Aayog has been tasked with the independent third-party evaluation of Centrally Sponsored Schemes in a time-bound manner, so that findings inform decisions about scheme rationalisation.

The Comptroller and Auditor General has also expanded beyond traditional financial audits into performance audits that assess whether government programmes deliver intended outcomes. Parliamentary committees – the Public Accounts Committee, the Estimates Committee, and various Standing Committees – provide legislative oversight. Together, these bodies form a multi-layered evaluation architecture, though its independence and capacity remain works in progress.

The challenges that make evaluation hard 🔗

For all its importance, policy evaluation is fraught with difficulties. Ignoring these challenges leads to evaluations that either mislead policymakers or get ignored by them.

Unclear or conflicting policy goals 🔗

Policies often emerge from messy political compromises that produce vague or even contradictory objectives. The Public Distribution System, for instance, simultaneously tries to provide food security to the poor and support farmers through minimum support prices – goals that can pull in opposite directions. When objectives are fuzzy, evaluators struggle to define what success even looks like.

Measuring impact is genuinely difficult 🔗

Attributing outcomes to a specific policy is one of the thorniest problems in social science. If child nutrition improves, was it because of the ICDS programme, rising household incomes, better sanitation, or all three? Disentangling these effects requires sophisticated methods, good baseline data, and patience – all of which are in short supply.

Data gaps and quality issues 🔗

Evaluation is only as good as the data it rests on. In a vast, decentralised system, data collection is uneven, administrative records can be unreliable, and the last-mile realities in districts and blocks often look very different from what reaches dashboards in Delhi.

Short timelines versus long-term impacts 🔗

Many policies – education reforms, public health interventions, environmental regulations – produce results over years or decades. But political cycles demand quick wins, and evaluations are often conducted too early to capture real impact. This creates a mismatch between the rhythm of evidence and the rhythm of politics.

Political pressure and independence 🔗

Evaluation findings can be uncomfortable. Agencies that depend on the same government they are evaluating may face pressure to soften criticism. This is why institutional independence – of the CAG, parliamentary committees, and third-party evaluators – is so crucial to credible evaluation.

Making evaluation count 🔗

The purpose of evaluation is not to produce fat reports that sit on shelves. It is to improve policy. For that to happen, evaluation findings must reach decision-makers at the right time, in a form they can use, and with enough political backing that action becomes likely. Building a culture of evaluation – where officials welcome scrutiny rather than fear it, where mistakes are treated as learning opportunities, and where evidence genuinely shapes budgets and designs – is the real unfinished work of public administration.

What do you think? When you look at a major government scheme that affects your life – whether it is public transport, healthcare, education, or welfare delivery – which evaluation criterion do you feel gets the least attention from policymakers, and why? If you had the power to commission one honest evaluation of any policy, which would you choose?

References

1. https://www.oecd.org/content/dam/oecd/en/publications/reports/2025/02/implementation-toolkit-for-the-oecd-recommendation-on-public-policy-evaluation_f24516be/77faa4fe-en.pdf
2. https://onlinelibrary.wiley.com/doi/10.1111/itor.13012
3. https://www.datatopolicy.org/navigator/evaluate-policy-impact
4. https://www.oecd.org/en/topics/sub-issues/public-policy-monitoring-and-evaluation.html
5. https://www.oecd.org/en/topics/sub-issues/development-co-operation-evaluation-and-effectiveness/evaluation-criteria.html
6. https://dmeo.gov.in/evaluation
7. https://www.sciotoanalysis.com/news/2023/1/11/effectiveness-efficiency-and-equity-the-three-es-of-policy-analysis
8. https://onlinelibrary.wiley.com/doi/10.1111/puar.13690