Cost-Effectiveness Measurement in Development : Accounting for Local Costs and Noisy Impacts
As evidence from rigorous impact evaluations grows in development, there have been more calls to complement impact evaluation analysis with cost analysis, so that policy makers can make investment decisions based on costs as well as impacts. This paper discusses important considerations for implementing cost-effectiveness analysis in the policy making process. The analysis is applied in the context of education interventions, although the findings generalize to other areas. First, the paper demonstrates a systematic method for characterizing the sensitivity of impact estimates. Second, the concept of context-specificity is applied to cost measurement: program costs vary greatly across contexts -- both within and across countries -- and with program complexity. The paper shows how adapting a single cost ingredient across settings dramatically shifts cost-effectiveness measures. Third, the paper provides evidence that interventions with fewer beneficiaries tend to have higher per-beneficiary costs, resulting in potential cost overestimates when extrapolating to large-scale applications. At the same time, recall bias may result in cost underestimates. The paper also discusses other challenges in measuring and extrapolating cost-effectiveness measures. For cost-effectiveness analysis to be useful, policy makers will require detailed, comparable, and timely cost reporting, as well as significant effort to ensure costs are relevant to the local environment.
id |
dig-okr-1098620333 |
---|---|
record_format |
koha |
spelling |
dig-okr-10986203332024-08-08T13:46:45Z Cost-Effectiveness Measurement in Development : Accounting for Local Costs and Noisy Impacts Popova, Anna Evans, David K. ACCOUNTING ACHIEVEMENT ANNUAL COST BENEFICIARIES CASH TRANSFERS CIVIL SERVICE CLASSROOM CLASSROOMS COMMUNITY PARTICIPATION COMPUTER ASSISTED LEARNING COST ESTIMATES COST MEASUREMENT COST PER STUDENT COST-BENEFIT ANALYSIS COST-EFFECTIVENESS COSTS OF PROGRAMS CRITICAL THINKING DEGREES DEMONSTRATION DISADVANTAGED STUDENT DISTANCE LEARNING EARLY LITERACY ECONOMIES OF SCALE EDUCATION POLICY EDUCATION PROGRAM EDUCATION PROGRAMS EDUCATION SECTOR EDUCATIONAL EFFECTIVENESS EDUCATIONAL INVESTMENTS EDUCATIONAL QUALITY EFFECTIVENESS OF EDUCATION ENROLLMENT EXCHANGE RATES EXPENDITURES FURTHER EDUCATION GASOLINE GOVERNMENT BUDGET HEALTH INTERVENTIONS HIGH SCHOOL HIGH SCHOOL GRADUATES HOUSEHOLD EXPENDITURES HUMAN CAPITAL INFLATION JOB MARKET LABOR MARKETS LEARNING LEARNING IMPACTS LEARNING OUTCOMES LEARNING PROGRAMS LITERACY LITERACY TESTS LITERATURE LOCAL CURRENCY MONETARY VALUES NUMBER OF STUDENTS OPEN ACCESS OPPORTUNITY COST PAPERS PEDAGOGICAL MATERIALS PRIMARY EDUCATION PRIMARY SCHOOLS PROGRAM EVALUATION PUBLIC EXPENDITURE PUBLIC HEALTH PUPIL-TEACHER RATIOS READING REFORM PROJECT REMEDIAL EDUCATION RETURNS TO EDUCATION SCHOLARSHIP PROGRAM SCHOLARSHIPS SCHOOL COMMITTEE SCHOOL COMPLETION SCHOOL DAY SCHOOL DROPOUTS SCHOOL GOVERNANCE SCHOOL GRADUATE SCHOOL PARTICIPATION SCHOOL UNIFORMS SCHOOLING SCHOOLS SHOW HOW SOCIAL RETURN STUDENT LEARNING STUDENT PARTICIPATION STUDENT POPULATION STUDENT_LEARNING TEACHER TEACHER INCENTIVES TEACHER SALARIES TEACHER TRAINING TEACHERS TEST SCORES TEXTBOOKS TRAINING PROGRAMS TRANSPORT TRANSPORT INFRASTRUCTURE TRANSPORTATION TRANSPORTATION COST TRANSPORTATION COSTS TRUE TUTORING UNCERTAINTY VITAMIN A WORKERS As evidence from rigorous impact evaluations grows in development, there have been more calls to complement impact evaluation analysis with cost analysis, so that policy makers can make investment decisions based on costs as well as impacts. This paper discusses important considerations for implementing cost-effectiveness analysis in the policy making process. The analysis is applied in the context of education interventions, although the findings generalize to other areas. First, the paper demonstrates a systematic method for characterizing the sensitivity of impact estimates. Second, the concept of context-specificity is applied to cost measurement: program costs vary greatly across contexts -- both within and across countries -- and with program complexity. The paper shows how adapting a single cost ingredient across settings dramatically shifts cost-effectiveness measures. Third, the paper provides evidence that interventions with fewer beneficiaries tend to have higher per-beneficiary costs, resulting in potential cost overestimates when extrapolating to large-scale applications. At the same time, recall bias may result in cost underestimates. The paper also discusses other challenges in measuring and extrapolating cost-effectiveness measures. For cost-effectiveness analysis to be useful, policy makers will require detailed, comparable, and timely cost reporting, as well as significant effort to ensure costs are relevant to the local environment. 2014-10-02T19:44:38Z 2014-10-02T19:44:38Z 2014-09 http://documents.worldbank.org/curated/en/2014/09/20196499/cost-effectiveness-measurement-development-accounting-local-costs-noisy-impacts-cost-effectiveness-measurement-development-accounting-local-costs-noisy-impacts https://hdl.handle.net/10986/20333 English en_US Policy Research Working Paper;No. 7027 CC BY 3.0 IGO http://creativecommons.org/licenses/by/3.0/igo/ application/pdf text/plain World Bank Group, Washington, DC |
institution |
Banco Mundial |
collection |
DSpace |
country |
Estados Unidos |
countrycode |
US |
component |
Bibliográfico |
access |
En linea |
databasecode |
dig-okr |
tag |
biblioteca |
region |
America del Norte |
libraryname |
Biblioteca del Banco Mundial |
language |
English en_US |
topic |
ACCOUNTING ACHIEVEMENT ANNUAL COST BENEFICIARIES CASH TRANSFERS CIVIL SERVICE CLASSROOM CLASSROOMS COMMUNITY PARTICIPATION COMPUTER ASSISTED LEARNING COST ESTIMATES COST MEASUREMENT COST PER STUDENT COST-BENEFIT ANALYSIS COST-EFFECTIVENESS COSTS OF PROGRAMS CRITICAL THINKING DEGREES DEMONSTRATION DISADVANTAGED STUDENT DISTANCE LEARNING EARLY LITERACY ECONOMIES OF SCALE EDUCATION POLICY EDUCATION PROGRAM EDUCATION PROGRAMS EDUCATION SECTOR EDUCATIONAL EFFECTIVENESS EDUCATIONAL INVESTMENTS EDUCATIONAL QUALITY EFFECTIVENESS OF EDUCATION ENROLLMENT EXCHANGE RATES EXPENDITURES FURTHER EDUCATION GASOLINE GOVERNMENT BUDGET HEALTH INTERVENTIONS HIGH SCHOOL HIGH SCHOOL GRADUATES HOUSEHOLD EXPENDITURES HUMAN CAPITAL INFLATION JOB MARKET LABOR MARKETS LEARNING LEARNING IMPACTS LEARNING OUTCOMES LEARNING PROGRAMS LITERACY LITERACY TESTS LITERATURE LOCAL CURRENCY MONETARY VALUES NUMBER OF STUDENTS OPEN ACCESS OPPORTUNITY COST PAPERS PEDAGOGICAL MATERIALS PRIMARY EDUCATION PRIMARY SCHOOLS PROGRAM EVALUATION PUBLIC EXPENDITURE PUBLIC HEALTH PUPIL-TEACHER RATIOS READING REFORM PROJECT REMEDIAL EDUCATION RETURNS TO EDUCATION SCHOLARSHIP PROGRAM SCHOLARSHIPS SCHOOL COMMITTEE SCHOOL COMPLETION SCHOOL DAY SCHOOL DROPOUTS SCHOOL GOVERNANCE SCHOOL GRADUATE SCHOOL PARTICIPATION SCHOOL UNIFORMS SCHOOLING SCHOOLS SHOW HOW SOCIAL RETURN STUDENT LEARNING STUDENT PARTICIPATION STUDENT POPULATION STUDENT_LEARNING TEACHER TEACHER INCENTIVES TEACHER SALARIES TEACHER TRAINING TEACHERS TEST SCORES TEXTBOOKS TRAINING PROGRAMS TRANSPORT TRANSPORT INFRASTRUCTURE TRANSPORTATION TRANSPORTATION COST TRANSPORTATION COSTS TRUE TUTORING UNCERTAINTY VITAMIN A WORKERS ACCOUNTING ACHIEVEMENT ANNUAL COST BENEFICIARIES CASH TRANSFERS CIVIL SERVICE CLASSROOM CLASSROOMS COMMUNITY PARTICIPATION COMPUTER ASSISTED LEARNING COST ESTIMATES COST MEASUREMENT COST PER STUDENT COST-BENEFIT ANALYSIS COST-EFFECTIVENESS COSTS OF PROGRAMS CRITICAL THINKING DEGREES DEMONSTRATION DISADVANTAGED STUDENT DISTANCE LEARNING EARLY LITERACY ECONOMIES OF SCALE EDUCATION POLICY EDUCATION PROGRAM EDUCATION PROGRAMS EDUCATION SECTOR EDUCATIONAL EFFECTIVENESS EDUCATIONAL INVESTMENTS EDUCATIONAL QUALITY EFFECTIVENESS OF EDUCATION ENROLLMENT EXCHANGE RATES EXPENDITURES FURTHER EDUCATION GASOLINE GOVERNMENT BUDGET HEALTH INTERVENTIONS HIGH SCHOOL HIGH SCHOOL GRADUATES HOUSEHOLD EXPENDITURES HUMAN CAPITAL INFLATION JOB MARKET LABOR MARKETS LEARNING LEARNING IMPACTS LEARNING OUTCOMES LEARNING PROGRAMS LITERACY LITERACY TESTS LITERATURE LOCAL CURRENCY MONETARY VALUES NUMBER OF STUDENTS OPEN ACCESS OPPORTUNITY COST PAPERS PEDAGOGICAL MATERIALS PRIMARY EDUCATION PRIMARY SCHOOLS PROGRAM EVALUATION PUBLIC EXPENDITURE PUBLIC HEALTH PUPIL-TEACHER RATIOS READING REFORM PROJECT REMEDIAL EDUCATION RETURNS TO EDUCATION SCHOLARSHIP PROGRAM SCHOLARSHIPS SCHOOL COMMITTEE SCHOOL COMPLETION SCHOOL DAY SCHOOL DROPOUTS SCHOOL GOVERNANCE SCHOOL GRADUATE SCHOOL PARTICIPATION SCHOOL UNIFORMS SCHOOLING SCHOOLS SHOW HOW SOCIAL RETURN STUDENT LEARNING STUDENT PARTICIPATION STUDENT POPULATION STUDENT_LEARNING TEACHER TEACHER INCENTIVES TEACHER SALARIES TEACHER TRAINING TEACHERS TEST SCORES TEXTBOOKS TRAINING PROGRAMS TRANSPORT TRANSPORT INFRASTRUCTURE TRANSPORTATION TRANSPORTATION COST TRANSPORTATION COSTS TRUE TUTORING UNCERTAINTY VITAMIN A WORKERS |
spellingShingle |
ACCOUNTING ACHIEVEMENT ANNUAL COST BENEFICIARIES CASH TRANSFERS CIVIL SERVICE CLASSROOM CLASSROOMS COMMUNITY PARTICIPATION COMPUTER ASSISTED LEARNING COST ESTIMATES COST MEASUREMENT COST PER STUDENT COST-BENEFIT ANALYSIS COST-EFFECTIVENESS COSTS OF PROGRAMS CRITICAL THINKING DEGREES DEMONSTRATION DISADVANTAGED STUDENT DISTANCE LEARNING EARLY LITERACY ECONOMIES OF SCALE EDUCATION POLICY EDUCATION PROGRAM EDUCATION PROGRAMS EDUCATION SECTOR EDUCATIONAL EFFECTIVENESS EDUCATIONAL INVESTMENTS EDUCATIONAL QUALITY EFFECTIVENESS OF EDUCATION ENROLLMENT EXCHANGE RATES EXPENDITURES FURTHER EDUCATION GASOLINE GOVERNMENT BUDGET HEALTH INTERVENTIONS HIGH SCHOOL HIGH SCHOOL GRADUATES HOUSEHOLD EXPENDITURES HUMAN CAPITAL INFLATION JOB MARKET LABOR MARKETS LEARNING LEARNING IMPACTS LEARNING OUTCOMES LEARNING PROGRAMS LITERACY LITERACY TESTS LITERATURE LOCAL CURRENCY MONETARY VALUES NUMBER OF STUDENTS OPEN ACCESS OPPORTUNITY COST PAPERS PEDAGOGICAL MATERIALS PRIMARY EDUCATION PRIMARY SCHOOLS PROGRAM EVALUATION PUBLIC EXPENDITURE PUBLIC HEALTH PUPIL-TEACHER RATIOS READING REFORM PROJECT REMEDIAL EDUCATION RETURNS TO EDUCATION SCHOLARSHIP PROGRAM SCHOLARSHIPS SCHOOL COMMITTEE SCHOOL COMPLETION SCHOOL DAY SCHOOL DROPOUTS SCHOOL GOVERNANCE SCHOOL GRADUATE SCHOOL PARTICIPATION SCHOOL UNIFORMS SCHOOLING SCHOOLS SHOW HOW SOCIAL RETURN STUDENT LEARNING STUDENT PARTICIPATION STUDENT POPULATION STUDENT_LEARNING TEACHER TEACHER INCENTIVES TEACHER SALARIES TEACHER TRAINING TEACHERS TEST SCORES TEXTBOOKS TRAINING PROGRAMS TRANSPORT TRANSPORT INFRASTRUCTURE TRANSPORTATION TRANSPORTATION COST TRANSPORTATION COSTS TRUE TUTORING UNCERTAINTY VITAMIN A WORKERS ACCOUNTING ACHIEVEMENT ANNUAL COST BENEFICIARIES CASH TRANSFERS CIVIL SERVICE CLASSROOM CLASSROOMS COMMUNITY PARTICIPATION COMPUTER ASSISTED LEARNING COST ESTIMATES COST MEASUREMENT COST PER STUDENT COST-BENEFIT ANALYSIS COST-EFFECTIVENESS COSTS OF PROGRAMS CRITICAL THINKING DEGREES DEMONSTRATION DISADVANTAGED STUDENT DISTANCE LEARNING EARLY LITERACY ECONOMIES OF SCALE EDUCATION POLICY EDUCATION PROGRAM EDUCATION PROGRAMS EDUCATION SECTOR EDUCATIONAL EFFECTIVENESS EDUCATIONAL INVESTMENTS EDUCATIONAL QUALITY EFFECTIVENESS OF EDUCATION ENROLLMENT EXCHANGE RATES EXPENDITURES FURTHER EDUCATION GASOLINE GOVERNMENT BUDGET HEALTH INTERVENTIONS HIGH SCHOOL HIGH SCHOOL GRADUATES HOUSEHOLD EXPENDITURES HUMAN CAPITAL INFLATION JOB MARKET LABOR MARKETS LEARNING LEARNING IMPACTS LEARNING OUTCOMES LEARNING PROGRAMS LITERACY LITERACY TESTS LITERATURE LOCAL CURRENCY MONETARY VALUES NUMBER OF STUDENTS OPEN ACCESS OPPORTUNITY COST PAPERS PEDAGOGICAL MATERIALS PRIMARY EDUCATION PRIMARY SCHOOLS PROGRAM EVALUATION PUBLIC EXPENDITURE PUBLIC HEALTH PUPIL-TEACHER RATIOS READING REFORM PROJECT REMEDIAL EDUCATION RETURNS TO EDUCATION SCHOLARSHIP PROGRAM SCHOLARSHIPS SCHOOL COMMITTEE SCHOOL COMPLETION SCHOOL DAY SCHOOL DROPOUTS SCHOOL GOVERNANCE SCHOOL GRADUATE SCHOOL PARTICIPATION SCHOOL UNIFORMS SCHOOLING SCHOOLS SHOW HOW SOCIAL RETURN STUDENT LEARNING STUDENT PARTICIPATION STUDENT POPULATION STUDENT_LEARNING TEACHER TEACHER INCENTIVES TEACHER SALARIES TEACHER TRAINING TEACHERS TEST SCORES TEXTBOOKS TRAINING PROGRAMS TRANSPORT TRANSPORT INFRASTRUCTURE TRANSPORTATION TRANSPORTATION COST TRANSPORTATION COSTS TRUE TUTORING UNCERTAINTY VITAMIN A WORKERS Popova, Anna Evans, David K. Cost-Effectiveness Measurement in Development : Accounting for Local Costs and Noisy Impacts |
description |
As evidence from rigorous impact
evaluations grows in development, there have been more calls
to complement impact evaluation analysis with cost analysis,
so that policy makers can make investment decisions based on
costs as well as impacts. This paper discusses important
considerations for implementing cost-effectiveness analysis
in the policy making process. The analysis is applied in the
context of education interventions, although the findings
generalize to other areas. First, the paper demonstrates a
systematic method for characterizing the sensitivity of
impact estimates. Second, the concept of context-specificity
is applied to cost measurement: program costs vary greatly
across contexts -- both within and across countries -- and
with program complexity. The paper shows how adapting a
single cost ingredient across settings dramatically shifts
cost-effectiveness measures. Third, the paper provides
evidence that interventions with fewer beneficiaries tend to
have higher per-beneficiary costs, resulting in potential
cost overestimates when extrapolating to large-scale
applications. At the same time, recall bias may result in
cost underestimates. The paper also discusses other
challenges in measuring and extrapolating cost-effectiveness
measures. For cost-effectiveness analysis to be useful,
policy makers will require detailed, comparable, and timely
cost reporting, as well as significant effort to ensure
costs are relevant to the local environment. |
topic_facet |
ACCOUNTING ACHIEVEMENT ANNUAL COST BENEFICIARIES CASH TRANSFERS CIVIL SERVICE CLASSROOM CLASSROOMS COMMUNITY PARTICIPATION COMPUTER ASSISTED LEARNING COST ESTIMATES COST MEASUREMENT COST PER STUDENT COST-BENEFIT ANALYSIS COST-EFFECTIVENESS COSTS OF PROGRAMS CRITICAL THINKING DEGREES DEMONSTRATION DISADVANTAGED STUDENT DISTANCE LEARNING EARLY LITERACY ECONOMIES OF SCALE EDUCATION POLICY EDUCATION PROGRAM EDUCATION PROGRAMS EDUCATION SECTOR EDUCATIONAL EFFECTIVENESS EDUCATIONAL INVESTMENTS EDUCATIONAL QUALITY EFFECTIVENESS OF EDUCATION ENROLLMENT EXCHANGE RATES EXPENDITURES FURTHER EDUCATION GASOLINE GOVERNMENT BUDGET HEALTH INTERVENTIONS HIGH SCHOOL HIGH SCHOOL GRADUATES HOUSEHOLD EXPENDITURES HUMAN CAPITAL INFLATION JOB MARKET LABOR MARKETS LEARNING LEARNING IMPACTS LEARNING OUTCOMES LEARNING PROGRAMS LITERACY LITERACY TESTS LITERATURE LOCAL CURRENCY MONETARY VALUES NUMBER OF STUDENTS OPEN ACCESS OPPORTUNITY COST PAPERS PEDAGOGICAL MATERIALS PRIMARY EDUCATION PRIMARY SCHOOLS PROGRAM EVALUATION PUBLIC EXPENDITURE PUBLIC HEALTH PUPIL-TEACHER RATIOS READING REFORM PROJECT REMEDIAL EDUCATION RETURNS TO EDUCATION SCHOLARSHIP PROGRAM SCHOLARSHIPS SCHOOL COMMITTEE SCHOOL COMPLETION SCHOOL DAY SCHOOL DROPOUTS SCHOOL GOVERNANCE SCHOOL GRADUATE SCHOOL PARTICIPATION SCHOOL UNIFORMS SCHOOLING SCHOOLS SHOW HOW SOCIAL RETURN STUDENT LEARNING STUDENT PARTICIPATION STUDENT POPULATION STUDENT_LEARNING TEACHER TEACHER INCENTIVES TEACHER SALARIES TEACHER TRAINING TEACHERS TEST SCORES TEXTBOOKS TRAINING PROGRAMS TRANSPORT TRANSPORT INFRASTRUCTURE TRANSPORTATION TRANSPORTATION COST TRANSPORTATION COSTS TRUE TUTORING UNCERTAINTY VITAMIN A WORKERS |
author |
Popova, Anna Evans, David K. |
author_facet |
Popova, Anna Evans, David K. |
author_sort |
Popova, Anna |
title |
Cost-Effectiveness Measurement in Development : Accounting for Local Costs and Noisy Impacts |
title_short |
Cost-Effectiveness Measurement in Development : Accounting for Local Costs and Noisy Impacts |
title_full |
Cost-Effectiveness Measurement in Development : Accounting for Local Costs and Noisy Impacts |
title_fullStr |
Cost-Effectiveness Measurement in Development : Accounting for Local Costs and Noisy Impacts |
title_full_unstemmed |
Cost-Effectiveness Measurement in Development : Accounting for Local Costs and Noisy Impacts |
title_sort |
cost-effectiveness measurement in development : accounting for local costs and noisy impacts |
publisher |
World Bank Group, Washington, DC |
publishDate |
2014-09 |
url |
http://documents.worldbank.org/curated/en/2014/09/20196499/cost-effectiveness-measurement-development-accounting-local-costs-noisy-impacts-cost-effectiveness-measurement-development-accounting-local-costs-noisy-impacts https://hdl.handle.net/10986/20333 |
work_keys_str_mv |
AT popovaanna costeffectivenessmeasurementindevelopmentaccountingforlocalcostsandnoisyimpacts AT evansdavidk costeffectivenessmeasurementindevelopmentaccountingforlocalcostsandnoisyimpacts |
_version_ |
1807159574069772288 |