When Does Rigorous Impact Evaluation Make a Difference? The Case of the Millennium Villages
When is the rigorous impact evaluation of development projects a luxury, and when a necessity? The authors study one high-profile case: the Millennium Villages Project (MVP), an experimental and intensive package intervention to spark sustained local economic development in rural Africa. They illustrate the benefits of rigorous impact evaluation in this setting by showing that estimates of the project's effects depend heavily on the evaluation method. Comparing trends at the MVP intervention sites in Kenya, Ghana, and Nigeria with trends in the surrounding areas yields much more modest estimates of the project's effects than the before-versus-after comparisons published thus far by the MVP. Neither approach constitutes a rigorous impact evaluation of the MVP, which is impossible to perform due to weaknesses in the evaluation design of the project's initial phase. These weaknesses include the subjective choice of intervention sites, the subjective choice of comparison sites, the lack of baseline data on comparison sites, the small sample size, and the short time horizon. The authors describe one of many ways that the next wave of the intervention could be designed to allow proper evaluation of the MVP's impact at little additional cost.
Main Authors: | , |
---|---|
Format: | Journal Article biblioteca |
Language: | en_US |
Published: |
Taylor and Francis
2011-09-26
|
Subjects: | evaluation, village, package, Millennium Development Goals, MDGs, |
Online Access: | http://hdl.handle.net/10986/13323 |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
id |
dig-okr-1098613323 |
---|---|
record_format |
koha |
spelling |
dig-okr-10986133232021-04-23T14:03:07Z When Does Rigorous Impact Evaluation Make a Difference? The Case of the Millennium Villages Clemens, Michael A. Demombynes, Gabriel evaluation village package Millennium Development Goals MDGs When is the rigorous impact evaluation of development projects a luxury, and when a necessity? The authors study one high-profile case: the Millennium Villages Project (MVP), an experimental and intensive package intervention to spark sustained local economic development in rural Africa. They illustrate the benefits of rigorous impact evaluation in this setting by showing that estimates of the project's effects depend heavily on the evaluation method. Comparing trends at the MVP intervention sites in Kenya, Ghana, and Nigeria with trends in the surrounding areas yields much more modest estimates of the project's effects than the before-versus-after comparisons published thus far by the MVP. Neither approach constitutes a rigorous impact evaluation of the MVP, which is impossible to perform due to weaknesses in the evaluation design of the project's initial phase. These weaknesses include the subjective choice of intervention sites, the subjective choice of comparison sites, the lack of baseline data on comparison sites, the small sample size, and the short time horizon. The authors describe one of many ways that the next wave of the intervention could be designed to allow proper evaluation of the MVP's impact at little additional cost. 2013-05-07T19:02:25Z 2013-05-07T19:02:25Z 2011-09-26 Journal Article Journal of Development Effectiveness 1943-9342 http://hdl.handle.net/10986/13323 en_US Journal of Development Effectiveness;3(3) http://creativecommons.org/licenses/by-nc-nd/3.0/igo CC BY-NC-ND 3.0 IGO http://creativecommons.org/licenses/by-nc-nd/3.0/igo/ World Bank Taylor and Francis Journal Article Ghana Kenya Nigeria |
institution |
Banco Mundial |
collection |
DSpace |
country |
Estados Unidos |
countrycode |
US |
component |
Bibliográfico |
access |
En linea |
databasecode |
dig-okr |
tag |
biblioteca |
region |
America del Norte |
libraryname |
Biblioteca del Banco Mundial |
language |
en_US |
topic |
evaluation village package Millennium Development Goals MDGs evaluation village package Millennium Development Goals MDGs |
spellingShingle |
evaluation village package Millennium Development Goals MDGs evaluation village package Millennium Development Goals MDGs Clemens, Michael A. Demombynes, Gabriel When Does Rigorous Impact Evaluation Make a Difference? The Case of the Millennium Villages |
description |
When is the rigorous impact evaluation of development projects a luxury, and when a necessity? The authors study one high-profile case: the Millennium Villages Project (MVP), an experimental and intensive package intervention to spark sustained local economic development in rural Africa. They illustrate the benefits of rigorous impact evaluation in this setting by showing that estimates of the project's effects depend heavily on the evaluation method. Comparing trends at the MVP intervention sites in Kenya, Ghana, and Nigeria with trends in the surrounding areas yields much more modest estimates of the project's effects than the before-versus-after comparisons published thus far by the MVP. Neither approach constitutes a rigorous impact evaluation of the MVP, which is impossible to perform due to weaknesses in the evaluation design of the project's initial phase. These weaknesses include the subjective choice of intervention sites, the subjective choice of comparison sites, the lack of baseline data on comparison sites, the small sample size, and the short time horizon. The authors describe one of many ways that the next wave of the intervention could be designed to allow proper evaluation of the MVP's impact at little additional cost. |
format |
Journal Article |
topic_facet |
evaluation village package Millennium Development Goals MDGs |
author |
Clemens, Michael A. Demombynes, Gabriel |
author_facet |
Clemens, Michael A. Demombynes, Gabriel |
author_sort |
Clemens, Michael A. |
title |
When Does Rigorous Impact Evaluation Make a Difference? The Case of the Millennium Villages |
title_short |
When Does Rigorous Impact Evaluation Make a Difference? The Case of the Millennium Villages |
title_full |
When Does Rigorous Impact Evaluation Make a Difference? The Case of the Millennium Villages |
title_fullStr |
When Does Rigorous Impact Evaluation Make a Difference? The Case of the Millennium Villages |
title_full_unstemmed |
When Does Rigorous Impact Evaluation Make a Difference? The Case of the Millennium Villages |
title_sort |
when does rigorous impact evaluation make a difference? the case of the millennium villages |
publisher |
Taylor and Francis |
publishDate |
2011-09-26 |
url |
http://hdl.handle.net/10986/13323 |
work_keys_str_mv |
AT clemensmichaela whendoesrigorousimpactevaluationmakeadifferencethecaseofthemillenniumvillages AT demombynesgabriel whendoesrigorousimpactevaluationmakeadifferencethecaseofthemillenniumvillages |
_version_ |
1756572728527159296 |