Different Forms of Policy Evaluation and Their Impact

Every rupee spent on a government scheme carries a question: did it actually work? Policy evaluation is how that question gets answered, and the answer depends heavily on who is doing the asking. Evaluations conducted by an internal field officer will look very different from those done by an external audit body or a parliamentary committee. Each form of evaluation brings its own lens, strengths, and blind spots. Understanding these different forms helps us see why some government programmes get course-corrected while others quietly drift for years.

Let’s walk through the major forms of policy evaluation used in the governance ecosystem, what each one does well, and where each one struggles.

Evaluation by special agencies 🔗

Special agencies are dedicated bodies set up with the explicit mandate of evaluating government policies and programmes. They bring specialised expertise, research methodologies, and a degree of independence that internal departments usually cannot match.

In India, the most prominent example is the Development Monitoring and Evaluation Office (DMEO), an attached office of NITI Aayog. DMEO was constituted on 18 September 2015 by merging the erstwhile Programme Evaluation Organisation (PEO) and the Independent Evaluation Office (IEO). Its mandate is to actively monitor and evaluate the implementation of central government programmes and identify the resources needed to strengthen their success.

DMEO has conducted evaluations of Centrally Sponsored Schemes (CSS) using an internationally recognised framework known as RCEESI+E – Relevance, Coherence, Efficiency, Effectiveness, Sustainability, Impact, and Equity. In 2019, it undertook evaluation of schemes under 28 Umbrella CSS through ten sector-level studies. These findings directly informed decisions on which schemes to continue, merge, or rationalise before the 15th Finance Commission cycle.

Strengths of special agency evaluations 🔗

Professional expertise: These agencies employ trained evaluators skilled in research design, statistical analysis, and programme assessment. Their methods are more rigorous than routine administrative reviews.

Relative independence: Because they are structurally distinct from the ministries running the programmes, they can offer assessments with less institutional bias.

Comparative perspective: Evaluating many programmes across sectors gives them a cross-cutting view that individual departments lack.

Challenges they face 🔗

Special agencies can face delays in accessing departmental data, limited enforcement power over their recommendations, and sometimes a disconnect between their analytical reports and the ground-level political decisions that actually drive programme changes.

Evaluation by operating staff 🔗

The people implementing a policy on the ground – block development officers, district magistrates, scheme nodal officers – are often the first to spot what’s working and what isn’t. Evaluation by operating staff refers to this kind of internal, practitioner-led assessment.

Take MGNREGA. The officers managing job card registration, muster rolls, and wage payments see patterns invisible to outsiders: which villages have procurement bottlenecks, which panchayats delay payments, where leakages occur. Their feedback, often collected through monthly reports and review meetings, feeds into ongoing programme refinement. The iterative nature of MGNREGA, with multiple revisions based on field experience and social audits, reflects this practitioner-driven learning.

Why operating staff evaluations matter 🔗

Granular ground truth: No one knows implementation realities better than the people doing the work. They can identify context-specific barriers – cultural, logistical, infrastructural – that external evaluators may miss.

Real-time feedback: Internal evaluations happen continuously, allowing mid-course corrections without waiting for a formal study.

Low cost: Using existing staff avoids the overhead of commissioning external studies.

Where this form falls short 🔗

The risks are well-known. Operating staff have an understandable incentive to present their own work in a favourable light. There’s limited independence, and the evaluations may focus on narrow operational details rather than whether the broader policy is achieving its social goals. Staff may also lack the research training needed to measure outcomes rigorously.

Evaluation by legislative committees 🔗

Parliament’s oversight of executive action is a core feature of a parliamentary democracy, and legislative committees are where this oversight actually happens. Parliamentary committees have been called “mini-legislatures” because they carry out the detailed scrutiny that the full House simply cannot manage.

The three financial committees are the heavyweights of legislative evaluation:

Public Accounts Committee (PAC) 🔗

The Public Accounts Committee was introduced in 1921 under the Government of India Act, 1919. Its primary function is to examine the audit reports of the Comptroller and Auditor General after they are laid before Parliament. The PAC’s findings have triggered some of India’s most consequential policy course-corrections – the 2G spectrum allocation inquiry being a well-known example where PAC scrutiny, combined with CAG reporting, reshaped telecom licensing policy.

One notable feature: since 1967, the PAC chairperson has been drawn from the opposition, usually the Leader of Opposition, which strengthens its independence from the ruling government.

Estimates Committee 🔗

The Estimates Committee scrutinises the functioning of government ministries in terms of expenditure and fund utilisation. Its mandate includes reporting on potential economies, organisational improvements, and administrative reforms consistent with policy objectives. It can also suggest alternative policies to improve administrative efficiency.

Departmentally Related Standing Committees (DRSCs) 🔗

There are 24 DRSCs covering all central ministries. Each has 31 members – 21 from Lok Sabha and 10 from Rajya Sabha. They examine bills, demands for grants, and policy implementation on a continuous basis.

Strengths of committee-based evaluation 🔗

Committees summon ministers and senior officials, demand documents, and conduct hearings behind closed doors – a non-partisan setting that enables more honest conversation than floor debates. They act as a continuous accountability mechanism and often provide technical depth that general parliamentary debate cannot.

Their limitations 🔗

Committee reports are recommendatory, not binding. Delays in discussion of reports, short member tenures of just one year for DRSCs, and high absenteeism reduce their impact. In recent Lok Sabhas, the share of bills referred to committees has dropped significantly, weakening this form of evaluation.

Evaluation by the Comptroller and Auditor General (CAG) 🔗

The CAG is arguably the single most powerful independent evaluator of public policy in India. Established under Article 148 of the Constitution, the CAG audits all receipts and expenditure of the central and state governments, along with autonomous bodies and government-owned corporations.

What makes the CAG unusual is that it goes well beyond compliance auditing. The office conducts performance audits that assess the economy, efficiency, and effectiveness of government schemes – essentially, full-blown policy evaluations. Recent performance audits have examined schemes like Ayushman Bharat and the functioning of Micro Project Agencies for development, revealing implementation gaps that feed back into policy redesign.

Why CAG evaluations carry weight 🔗

Constitutional independence: The CAG’s tenure (six years or age 65, whichever is earlier), protection of salary and service conditions, and removal procedure modelled on a Supreme Court judge all insulate the office from executive pressure.

Direct link to Parliament: CAG reports are laid before Parliament and state legislatures, where they are examined by the PAC and Committees on Public Undertakings. This creates a chain of accountability that converts audit findings into political action.

Breadth of audit types: Beyond financial audits, the CAG conducts compliance audits, performance audits, and increasingly environmental and social audits – a near 360-degree review of public expenditure.

Historically, CAG audits have exposed scams and triggered reforms, including the 2G spectrum and coal block allocation cases, both of which fundamentally altered how public resources are allocated in those sectors.

CAG’s structural limits 🔗

The CAG operates post-facto – it audits expenditure after it has already occurred. It cannot prevent misuse in real time. The office is also not, in practice, a Comptroller: it lacks control over the actual issuance of funds from the Consolidated Fund. Reports are sometimes tabled long after the events they describe, reducing their policy-correction value.

Evaluation by statutory commissions 🔗

Statutory commissions are bodies created by specific laws passed by Parliament. They evaluate policies affecting particular social groups, rights areas, or governance domains. Unlike constitutional bodies like the CAG, their authority flows from legislation, but their impact on policy evaluation can be substantial.

Examples include the National Human Rights Commission, the National Commission for Women, the National Commission for Scheduled Castes, the National Commission for Scheduled Tribes, and the National Commission for Protection of Child Rights. Each examines whether government policies are delivering on their promises to the constituency the commission serves.

What statutory commissions add 🔗

Focus on societal impact: Where CAG and PAC evaluations often centre on financial and procedural propriety, statutory commissions ask whether policies are actually advancing rights, welfare, and inclusion.

Domain expertise: They bring specialised knowledge of the lived realities of the groups they represent – something general evaluators rarely possess.

Advocacy and recommendation power: They can summon officials, conduct inquiries, and publish annual reports that pressure governments to address shortcomings.

Their weaknesses 🔗

Statutory commissions frequently face resource constraints, vacant leadership positions, and recommendations that are not binding. Their effectiveness depends heavily on whether governments choose to act on their findings.

How these forms complement each other 🔗

No single form of evaluation captures the full picture of a policy’s performance. Operating staff know the granular detail but lack distance. Special agencies bring methodological rigour but limited enforcement power. Legislative committees add political accountability but move slowly. The CAG provides constitutional audit authority but works post-facto. Statutory commissions foreground societal impact but often lack teeth.

A mature policy ecosystem uses all of them together. The CAG’s performance audit of a scheme might be examined by the PAC, referenced by a DMEO evaluation, and supplemented by a National Commission for Women report on gender outcomes – with operating staff feedback shaping day-to-day corrections. When this layered system works, policies get refined continuously. When one or more layers weaken – say, bills skipping committee review, or CAG reports tabled years late – the feedback loop breaks and public money gets wasted.

What do you think? Which form of policy evaluation, in your view, carries the most weight in actually changing how a scheme is run – and why do some evaluation reports lead to real reforms while others sit unread on a shelf?

References

1. https://dmeo.gov.in/content/overview-0
2. https://dmeo.gov.in/evaluation
3. https://journalism.university/journalistic-writings/6-stages-public-policy-process-india/
4. https://www.drishtiias.com/daily-news-analysis/public-accounts-committee-pac
5. https://prsindia.org/parliamentary-committees/public-accounts
6. https://sansad.in/ls/committee/introduction
7. https://cag.gov.in/en
8. https://en.wikipedia.org/wiki/Comptroller_and_Auditor_General_of_India
9. https://en.wikipedia.org/wiki/Public_Accounts_Committee_(India)