Policy Evaluation: Assessing the Effectiveness of Public Policies

Every public policy begins with a promise. A promise to reduce poverty, improve health, clean up cities, or deliver jobs. But how do we know if that promise has actually been kept? This is where policy evaluation steps in – the quiet but powerful final stage of the policy process that separates good intentions from real results. It is the moment when governments pause, look back, and ask the most honest question in governance: did it actually work?

What policy evaluation really means 🔗

Policy evaluation is the systematic assessment of a policy’s performance, outcomes, and overall impact. It is not about ticking boxes or collecting files for the record. It is a structured effort to find out whether a policy met its stated objectives, how efficiently it used public resources, and what unintended consequences it may have created along the way.

The United Nations Development Programme defines evaluation as a rigorous and independent assessment of either completed or ongoing activities to determine how well they are achieving their stated objectives and contributing to decision making. In simpler terms, if monitoring asks “are we doing things right?”, evaluation asks the bigger question: “did we do the right thing?”

Why evaluation matters in the policy cycle 🔗

The policy process in India is often described through six stages: agenda setting, formulation, adoption, implementation, monitoring, and evaluation. While each stage has its own importance, evaluation plays a distinctive role because it closes the loop. Without it, the entire cycle becomes a one-way street where policies are launched, run for years, and eventually fade without anyone truly knowing what they achieved.

Evaluation turns this linear process into a genuine cycle of learning. The findings from one policy feed directly into the design of the next one, making future interventions smarter and more evidence-based. The Indian School of Public Policy describes this as an iterative process where governments continuously review and revise policies to keep up with changing realities. A good example is the National Education Policy, which was updated in 2020 after decades of learning from its 1986 predecessor.

The core objectives of evaluation 🔗

Policy evaluation is not a one-dimensional exercise. It serves several interlocking goals that collectively improve governance:

Generating reliable information about policy performance. Evaluation produces evidence-based data on whether a policy is achieving what it set out to do. Consider the Direct Benefit Transfer scheme, where evaluation helps track not just how many beneficiaries received transfers, but also whether payments reached the right people and reduced leakages.

Clarifying values and assumptions. Sometimes evaluation reveals that the values underlying a policy were flawed or outdated. It forces policymakers to confront the assumptions they made when designing the intervention.

Suggesting restructuring or new goals. When a policy is not performing, evaluation does not just declare failure. It points toward how the policy can be redesigned, what new goals might be more realistic, or whether a completely different approach is needed.

Ensuring accountability. Evaluation provides the evidence needed to hold governments accountable to citizens and to Parliament. It allows the public to see whether tax money was used well and whether promises were kept.

Informing continuation or termination. Perhaps the most consequential role of evaluation is helping decision-makers decide whether to continue, expand, modify, or terminate a policy. The IGNOU unit on public policy notes that evaluation during implementation might even suggest termination of the policy altogether.

The main types of policy evaluation 🔗

Evaluation is not a single method. It comes in several forms, each suited to different questions and different stages of a policy’s life.

Formative evaluation 🔗

This type is carried out during the design or early implementation phase. It is essentially a diagnostic tool that helps policymakers refine a programme before it is scaled up. Formative evaluation asks how, why, and under what conditions a policy intervention works or does not work. It looks at contextual factors and implementation processes so that course corrections can be made early.

Process evaluation 🔗

Process evaluation examines how a policy is being implemented on the ground. Is it reaching the intended beneficiaries? Are the core components being delivered as designed? This type is particularly useful for identifying bottlenecks in service delivery. For instance, a process evaluation of a sanitation programme might reveal that toilets are being built but not maintained, pointing to a gap between infrastructure and behavioural change.

Summative or outcome evaluation 🔗

This is the big-picture assessment that takes place after a policy has been running long enough to produce measurable results. Summative evaluation looks at whether the stated objectives were achieved. It is most useful when decisions need to be made about continuing, expanding, or winding down a programme.

Impact evaluation 🔗

Impact evaluation goes deeper than outcomes. It tries to establish whether the observed changes can actually be attributed to the policy itself rather than to other factors in the environment. This often involves comparing beneficiaries with a control group or baseline data. Impact evaluation is technically demanding and time-consuming, but it produces the most definitive evidence of what a policy has actually caused.

Cost-benefit analysis 🔗

Here the focus shifts to economics. Cost-benefit analysis weighs the total costs of a policy against the value of its benefits, helping governments decide whether a programme is worth the investment compared to alternatives that could achieve similar goals.

Who conducts evaluation in India 🔗

A variety of institutions in India carry out policy evaluation, each bringing different perspectives, methods, and levels of independence.

The Development Monitoring and Evaluation Office 🔗

The most prominent evaluation body in the country today is the Development Monitoring and Evaluation Office (DMEO), an attached office of NITI Aayog. DMEO was established by the Government of India on 18th September, 2015 as an attached office of the NITI Aayog by merging the erstwhile Program Evaluation Office and Independent Evaluation Office. It is now considered the apex monitoring and evaluation office in the country.

Its mandate includes monitoring the progress and efficacy of long-term policy frameworks and actively evaluating the implementation of central government programmes. DMEO also conducts independent third-party evaluations of Centrally Sponsored Schemes, using internationally recognised frameworks such as RCEESI+E, which covers relevance, coherence, efficiency, effectiveness, sustainability, impact, and equity.

The Programme Evaluation Organisation 🔗

Long before DMEO existed, the Programme Evaluation Organisation pioneered systematic evaluation in India. It was established in October 1952 under the erstwhile Planning Commission with the specific task of evaluating community development programmes and area development schemes. Though it has since been merged into DMEO, it laid the groundwork for professional evaluation practice in the country.

Parliamentary committees 🔗

Parliament plays a significant evaluation role through committees such as the Public Accounts Committee, Estimates Committee, and various Standing Committees. These bodies examine whether policies were implemented in line with legislative intent and whether budgetary allocations produced the expected public value. They hold hearings, summon officials, and issue recommendations that often shape the course of policy.

Comptroller and Auditor General 🔗

The Comptroller and Auditor General of India conducts performance audits of government programmes, which serve as an important form of external evaluation. These audits examine whether schemes were implemented economically, efficiently, and effectively.

External evaluators and think tanks 🔗

Academic institutions, research organisations, and international bodies such as the World Bank and UNDP also conduct evaluations of Indian programmes. Their work often brings methodological rigour and an outsider’s perspective that complements government-led assessments.

Evaluation in action: real examples 🔗

To see how evaluation shapes public policy, consider a few well-known programmes.

The Mahatma Gandhi National Rural Employment Guarantee Act has been subject to continuous evaluation since its launch. Studies have examined wage payments, asset creation, leakages, and the scheme’s effect on rural distress migration. These evaluations have directly influenced reforms such as the shift to electronic fund management and Aadhaar-based payments.

The Swachh Bharat Mission offers another telling example. Regular evaluation helped the programme evolve from a narrow focus on toilet construction to a broader approach emphasising sustained behavioural change and long-term sanitation systems. Without ongoing assessment, the programme might have declared victory prematurely based on construction targets alone.

Similarly, evaluations of the Public Distribution System have repeatedly pushed reforms aimed at reducing diversion and improving targeting, including the introduction of end-to-end computerisation and the One Nation One Ration Card initiative.

Challenges in policy evaluation 🔗

Despite its importance, evaluation in India faces persistent obstacles.

Lack of baseline data. Many programmes are launched without robust baseline measurements, which makes it extremely difficult to later prove what the policy actually changed.

Difficulty establishing causation. Even when outcomes improve, proving that the policy caused the improvement, rather than economic growth, demographic shifts, or parallel interventions, is methodologically tough.

Political sensitivity. Evaluation findings can be uncomfortable for governments, especially when they reveal that flagship schemes are underperforming. This sometimes leads to reports being buried, diluted, or ignored.

Capacity constraints. Many ministries and state governments lack trained evaluators, data systems, and institutional incentives to take evaluation seriously as a discipline rather than a formality.

Timing mismatches. Social policies often produce results only over decades, while political and budgetary cycles demand answers within a few years. This creates pressure for premature conclusions.

Why evaluation is only growing in importance 🔗

As governance becomes more complex and citizens more demanding of accountability, evaluation is moving from the margins to the centre of public administration. Digital technologies, big data analytics, and real-time feedback systems are making it easier to track outcomes and diagnose problems while policies are still running. The shift toward outcome budgeting, where ministries must justify spending based on measurable results, has also raised the stakes.

Ultimately, evaluation is about humility and learning. It accepts that even well-designed policies can fail, that values and priorities change, and that the only way to keep public administration honest is to keep asking the hard questions – long after the press conferences are over.

What do you think? If a flagship welfare scheme is found through evaluation to be underperforming after five years, should the government prioritise redesigning it or terminating it to free up resources for new approaches? And how do you think India can balance political sensitivities with the need for truly independent, honest evaluation of public policies?

References

1. https://dmeo.gov.in/evaluation
2. https://www.ispp.org.in/the-formulation-and-development-of-public-policies-in-india/
3. https://www.egyankosh.ac.in/bitstream/123456789/76653/1/Unit-3.pdf
4. https://know.fife.scot/__data/assets/file/0027/18369/KnowHow-Policy-Evaluation.pdf
5. https://dmeo.gov.in/content/overview-0
6. https://cag.gov.in/en
7. https://nrega.nic.in/MGNREGA_new/Nrega_home.aspx