Importance of Policy Evaluation in Public Policy

Every year, governments design and implement dozens of policies – from welfare schemes and health programmes to infrastructure projects and education reforms. But how do we know if these policies are actually working? How do we find out whether public money is being spent wisely, whether the intended beneficiaries are being reached, and whether the problems these policies were meant to solve are actually getting better? The answer lies in policy evaluation – a systematic, evidence-driven process that sits at the heart of responsible governance. Far from being a bureaucratic afterthought, policy evaluation is what separates good governance from guesswork.

What is policy evaluation? 🔗

At its most basic level, policy evaluation is the process used to determine what the consequences of public policy are – what has and has not been achieved. It involves assessing whether a policy has met its stated goals, whether it has used resources efficiently, and what its overall impact has been on the intended population and society at large.

The OECD defines public policy evaluation as a structured, evidence-based assessment that examines the relevance, coherence, efficiency, effectiveness, impact, and sustainability of a policy based on its objectives. This definition is deliberately broad, covering a wide range of approaches – from experimental methods to theory-based evaluations – and applying to policies, programmes, and legislation alike.

Evaluation is not merely about passing judgment on a policy. It is an exercise in learning. Each type of evaluation serves a specific purpose in ensuring accountability, identifying unintended consequences, and measuring both the successes and shortcomings of public policies. It provides the critical feedback loop that helps governments improve or adjust their strategies over time.

Why policy evaluation matters 🔗

Public policies are funded by taxpayers. Whether it is the construction of rural roads under PMGSY or subsidised cooking gas under the Ujjwala Yojana, public expenditure represents both a financial commitment and a promise to citizens. The public has a right to expect that government officials are accountable for the validity, efficiency, and effectiveness of those policies. Evaluation is the primary mechanism through which this accountability is exercised.

Beyond accountability, evaluation serves a forward-looking purpose. When evaluators examine what worked and what did not, their findings directly shape the design of future interventions. Policies that receive positive evaluations tend to be continued or expanded, while those that perform poorly may be reformed or discontinued. Favorable evaluations of a given policy will tend to perpetuate its implementation and life-cycle, while unfavorable evaluations may give rise to change or possibly policy termination.

Evaluation also plays a crucial role in detecting unintended consequences – outcomes that policymakers did not anticipate when a policy was designed. A scheme meant to improve girl-child education, for instance, may also inadvertently reinforce certain social norms or have differential effects across income groups. Evaluation catches these nuances before they become entrenched problems.

Key criteria used in policy evaluation 🔗

Evaluators do not assess a policy against a single yardstick. Several criteria are used together to build a comprehensive picture of how a policy has performed. The most widely accepted criteria – internationally recognised and also used formally in India – are as follows.

Effectiveness 🔗

Effectiveness asks the most fundamental question: did the policy achieve what it set out to do? If the goal of a rural employment programme was to provide 100 days of wage employment to rural households, effectiveness measures the extent to which this target was actually met. It focuses on outcomes rather than just the activities carried out.

Efficiency 🔗

Efficiency examines whether the outcomes were achieved at a reasonable cost. A programme that delivers excellent results but consumes disproportionate resources may not be sustainable in the long run. Cost-benefit analysis is a common tool used to measure efficiency, comparing the monetary and non-monetary value of policy outcomes against the inputs invested.

Relevance 🔗

Relevance assesses whether the policy addressed a genuine and high-priority problem. Relevance reflects the extent to which a policy has addressed the problems of high-priority beneficiaries and any other people who might have been its beneficiaries. A highly efficient policy that solves the wrong problem still represents a failure of governance.

Impact 🔗

Impact evaluation focuses on the broader, longer-term changes attributable to the policy. It tries to isolate the specific effect of the intervention from other factors that may have independently caused change. For example, if maternal mortality rates fall after a public health programme, impact evaluation tries to determine how much of that decline is actually due to the programme and how much would have happened anyway.

Sustainability 🔗

Sustainability considers whether the benefits of a policy will continue after the policy intervention ends or evolves. In specific terms, sustainability would mean the maintenance of physical facilities produced, as well as the continued use of physical and intangible resources after the policy’s current phase concludes.

Equity 🔗

Equity asks whether the benefits and burdens of a policy are distributed fairly across different groups in society. The criterion of equity implies asking whether costs and benefits are distributed equitably among different groups. Policies designed to redistribute income, social benefits, and employment opportunities are especially evaluated on this criterion.

Types of policy evaluation 🔗

Policy evaluation can be classified in several ways – by timing, purpose, or methodology. Understanding these types helps in choosing the right kind of evaluation for the right stage of a policy’s life.

Ex-ante evaluation 🔗

Ex-ante evaluation, as the term suggests, happens before a policy is implemented. Its intention is to forecast the potential impacts of a proposed policy, using modelling techniques, scenario planning, and expert consultations to anticipate likely outcomes and identify potential risks. Ex-ante evaluation is particularly useful during policy design, allowing planners to optimise key features before committing significant resources. For instance, before launching a major housing scheme, planners can use models to estimate demand, project costs, and identify possible implementation gaps.

Formative evaluation 🔗

Formative evaluation is conducted during the development or early implementation of a policy. Formative evaluations are carried out during the development and implementation of the programme, and their usefulness is manifested primarily in obtaining guidance on how to best achieve the objectives of the programme or how to improve it. These evaluations are especially valuable for pilot projects, where course corrections can still be made before the policy is rolled out at scale.

Process evaluation 🔗

Process evaluation focuses on how well a policy or programme is being administered. This type of evaluation is employed more often by programme managers to determine what can be done to improve implementation and service delivery. It identifies bottlenecks, inefficiencies, and gaps in how the policy is being carried out on the ground, without necessarily measuring final outcomes.

Summative evaluation 🔗

Summative evaluation is conducted at the end of a policy or programme to provide an overall assessment of its worth. Summative evaluations are carried out when programmes are well established and allow determining to what extent the programme achieves its goals. They are used to decide whether to continue, expand, or terminate a policy, and are often used by governments to report on scheme performance to legislative bodies and the public.

Ex-post evaluation 🔗

Ex-post evaluation differs from summative evaluation in that it is usually conducted some time after a policy has concluded, by independent external evaluators. Ex-post evaluation is crucial for accountability and learning, helping us understand what worked, what did not, and why. It provides the deepest insight into a policy’s long-term impact and sustainability.

Methods used in policy evaluation 🔗

The choice of methodology depends on the evaluation questions being asked, the available data, and the resources at hand. At a very general level, quantitative and qualitative methods are distinguished by the density and breadth of the type of information they produce. Quantitative methods can generate statistical findings across a large number of cases, while qualitative methods produce contextualised, in-depth understanding of a smaller set of situations. In practice, robust evaluations often use both.

Common quantitative tools include surveys, statistical analysis, randomised controlled trials (RCTs), and quasi-experimental designs. Qualitative tools include in-depth interviews, focus group discussions, case studies, and observation. Cost-benefit analysis is a widely used economic tool that values policy outcomes in monetary terms, allowing comparison of different interventions. Policy evaluation is increasingly using the components of political science, economics, sociology, psychology, law, and public administration – making it an inherently inter-disciplinary exercise.

Policy evaluation in India 🔗

The institutional architecture for policy evaluation in India has evolved significantly over the decades. At the national level, the primary agency responsible for this function today is the Development Monitoring and Evaluation Office (DMEO), which is an attached office under NITI Aayog. DMEO evaluates the performance of all line ministries on the basis of the output and outcomes achieved in the various central and centrally sponsored schemes, and reviews the progress of infrastructure departments for periodic review by the Prime Minister.

A significant step was taken when the Government of India made evaluation of all Centrally Sponsored Schemes (CSS) mandatory before they come up for fresh appraisal. The schemes are assessed based on the internationally recognised evaluation framework RCEESI – Relevance, Coherence, Efficiency, Effectiveness, Sustainability, and Impact – contextualised to also include equity, making it RCEESI+E in line with national priorities.

However, challenges remain. Several ministries continue to treat evaluation as an exercise in accountability rather than learning, preferring to create ad hoc evaluation units at scheme-level or get evaluated through a limited set of research institutions. Financial reporting remains a dominant feature of scheme performance reports, with limited focus on actual outcomes. Among the states, Karnataka is the only one to have an evaluation policy and a specialised evaluation authority, highlighting the extent of the gap that still needs to be bridged.

Data quality is another persistent challenge. In the absence of a national evaluation policy, there is no unified framework in place to collect data based on necessary indicators, leading to wide variation in the quality and frequency of evaluations. The evaluation of the Bhagyalakshmi scheme in Karnataka – which found that while the programme reduced gender disparity in school attendance, it was being used primarily to fund marriages – illustrates the kind of nuanced insight that rigorous evaluation can uncover, and the type of evidence that leads to meaningful policy reform.

The relationship between monitoring and evaluation 🔗

Monitoring and evaluation (M&E) are often discussed together, but they are distinct activities. Monitoring is a continuous process that tracks inputs, activities, and outputs as a policy is being implemented. Evaluation, by contrast, is conducted periodically and goes much deeper – it assesses outcomes and impacts, and seeks to understand causal relationships between the policy and the changes observed. M&E processes are a necessary step towards establishing institutionalised mechanisms for achieving transparency and accountability, generating lessons for real-time improvement, and ensuring effective dissemination of knowledge amongst stakeholders and beneficiaries.

The two processes are complementary. Good monitoring generates the data that makes credible evaluation possible. Without strong monitoring systems in place – including reliable baseline data – evaluation is constrained in what it can conclude. This is why the push for outcome-based budgeting and real-time dashboards in government programmes is directly linked to the goal of strengthening evaluation capacity.

Challenges in conducting policy evaluation 🔗

Even when institutions and resources are in place, policy evaluation faces several real-world challenges. Attribution is perhaps the most difficult: isolating the specific effect of a policy from other simultaneously occurring changes in society is rarely straightforward. Economic growth, demographic shifts, or parallel programmes may all influence the same outcomes that a policy is trying to change.

Political pressures also pose a challenge. Policy evaluation is as political and divisive as any other stage of the policy process, with different interest groups often trying to influence how evaluation findings are interpreted and used. Evaluators who are institutionally embedded within the implementing ministry face inherent conflicts of interest. Transparency and credibility require the independence of the evaluators, which is why third-party evaluations commissioned by external bodies are generally regarded as more reliable.

Time and resource constraints further complicate the picture. The retrospective analysis of any public policy is bounded by constraints such as time, budget, ethical considerations, and policy restrictions, as well as political ideologies, values, experiences, measurement instruments, goal clarity, and institutional biases. Comprehensive impact evaluations, in particular, can take years to complete, which means their findings often arrive after key policy decisions have already been made.

The evolving nature of policy evaluation 🔗

Policy evaluation is not a static discipline. Over the years, public policy evaluation has become more sophisticated – moving from simple analysis of outcomes and cost-benefit analysis to a methodology that also focuses on non-monetary policy outcomes, measuring retarding factors, equity, effectiveness, and organisational and human factors. Evaluation is also becoming more proactive: rather than waiting for a policy to fully conclude before examining results, there is a growing emphasis on pre-adoption projections and deductive modelling.

Technology is reshaping evaluation practice as well. Real-time data systems, geospatial mapping, big data analytics, and AI-assisted analysis are making it possible to track policy outcomes at a granularity and speed that was previously unimaginable. The push to build a National Data and Analytics Platform by NITI Aayog is a step in this direction – aiming to make government data more accessible for evidence-based policymaking and evaluation.

The future of policy evaluation also lies in greater participation. Engaging communities, civil society organisations, and the intended beneficiaries of a policy in the evaluation process not only improves the quality of findings but also strengthens public trust in governance. Evaluation, at its best, is not just a technical exercise – it is a democratic one.

What do you think? Given that most welfare schemes in India involve multiple ministries and multiple levels of government, should there be a single independent national evaluation authority with statutory powers – rather than leaving it to individual ministries? And with technology enabling real-time data collection at the grassroots level, what might be the risks of relying too heavily on quantitative metrics while evaluating policies that address deeply social problems like malnutrition or gender inequality?

References

1. https://courses.worldcampus.psu.edu/welcome/plsc490/lesson05_07.html
2. https://www.oecd.org/content/dam/oecd/en/publications/reports/2025/02/implementation-toolkit-for-the-oecd-recommendation-on-public-policy-evaluation_f24516be/77faa4fe-en.pdf
3. https://www.researchgate.net/publication/385524691_Assessing_Public_Policies_A_Comprehensive_Review_of_Evaluation_Methods
4. https://niu.edu.in/sla/online-classes/MPA-203-UNDERSTANDING-POLICY-EVALUATION.pdf
5. https://energy.sustainability-directory.com/term/policy-evaluation-methods/
6. https://pmc.ncbi.nlm.nih.gov/articles/PMC7552366/
7. https://courses.worldcampus.psu.edu/welcome/plsc490/lesson05_08.html
8. https://scienceetbiencommun.pressbooks.pub/pubpolevaluation/front-matter/introduction/
9. https://dmeo.gov.in/evaluation
10. https://www.chandlerinstitute.org/governancematters/niti-aayog-the-role-of-a-policy-thinktank
11. https://idronline.org/monitoring-and-evaluation-public-policies-rct-india/
12. https://www.athenainfonomics.com/blog-posts/monitoring-evaluation-systems-role-relevance-central-government-schemes
13. https://shs.cairn.info/article/E_NCAE_001_0001?lang=en